-- Logs begin at Mon 2022-08-01 14:36:41 UTC, end at Mon 2022-08-01 16:22:43 UTC. -- Aug 01 15:24:43.190175 dv-cinder-847536-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 15:24:43.199336 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 15:24:43 2022] *** Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: nodename: dv-cinder-847536-3-iscsi Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: machine: x86_64 Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: clock source: unix Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: pcre jit disabled Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: detected number of CPU cores: 4 Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: current working directory: / Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: detected binary path: /usr/bin/uwsgi-core Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: your processes number limit is 47680 Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: your memory page size is 4096 bytes Aug 01 15:24:43.201601 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: detected max file descriptor number: 2048 Aug 01 15:24:43.202478 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: lock engine: pthread robust mutexes Aug 01 15:24:43.202478 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: thunder lock: enabled Aug 01 15:24:43.202478 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 15:24:43.202478 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 15:24:43.240847 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: Python main interpreter initialized at 0x56552d5929c0 Aug 01 15:24:43.240847 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: python threads support enabled Aug 01 15:24:43.240847 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: your server socket listen backlog is limited to 100 connections Aug 01 15:24:43.240847 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: your mercy for graceful operations on workers is 90 seconds Aug 01 15:24:43.241236 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 15:24:43.241236 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: *** Operational MODE: preforking *** Aug 01 15:24:43.241515 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: *** uWSGI is running in multiple interpreter mode *** Aug 01 15:24:43.241515 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: spawned uWSGI master process (pid: 103347) Aug 01 15:24:43.241724 dv-cinder-847536-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 15:24:43.243350 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: spawned uWSGI worker 1 (pid: 103348, cores: 1) Aug 01 15:24:43.243350 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: spawned uWSGI worker 2 (pid: 103349, cores: 1) Aug 01 15:24:43.243350 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 15:24:43.899618 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:24:43.904469 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:24:44.982431 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:24:44.982431 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: from cryptography.utils import int_from_bytes Aug 01 15:24:44.983026 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:24:44.983026 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: from cryptography.utils import int_from_bytes Aug 01 15:24:44.985761 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:24:44.985761 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: from cryptography.utils import int_from_bytes Aug 01 15:24:44.986244 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:24:44.986244 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: from cryptography.utils import int_from_bytes Aug 01 15:24:47.486045 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:24:47.486724 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:24:47.486831 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:24:47.486831 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:24:47.487290 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:24:47.487290 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:24:47.487452 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:24:47.487539 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:24:47.487632 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:24:47.487782 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.487931 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:24:47.488112 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.488224 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.488424 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.488521 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.488738 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.488842 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.489065 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.489166 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.489370 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.489464 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.489691 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.489794 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.490024 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.490135 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.490346 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.490443 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.490685 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.491300 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.491465 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.491575 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.491792 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.491889 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847536-3-iscsi {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.492092 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.492194 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847536-3-iscsi {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.492392 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.492488 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.492697 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.492791 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.493003 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.493097 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.493451 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.493571 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.493660 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.494033 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.494245 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.494361 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.494473 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.494617 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.494741 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.495767 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.495921 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.496067 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.496203 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.496203 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.496419 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.496511 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.496602 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.496683 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.496816 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.496906 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.496993 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.497083 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.497191 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.497272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.497356 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.497441 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.497526 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.497732 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.497873 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.498140 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847536-3-iscsi {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.498272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847536-3-iscsi {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.498464 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.498590 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.498768 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.498866 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.499085 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.499200 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.499487 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.499598 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.499798 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.500016 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.500117 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.500199 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.500410 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.500502 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.500731 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.500841 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.501034 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.501152 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.501474 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.501588 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.501733 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.501867 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.502033 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.502160 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.502306 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.502443 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.502603 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.502696 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.502907 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.503008 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.503213 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.503309 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.503527 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.503613 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.503828 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.503918 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.504123 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.504219 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.504370 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.504462 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.504673 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.504759 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.504993 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.505092 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.505309 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.505402 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.505626 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.505715 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.505878 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.506039 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.506281 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.506378 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.506604 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.506701 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.506921 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.507007 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.507229 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.507365 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.507535 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.507701 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.507931 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.508057 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.508183 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.508309 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.508414 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.508540 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.508705 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.508836 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.509008 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.509168 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.509333 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.509471 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.509612 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.509703 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.509969 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.510074 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.510264 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.510355 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.510568 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.510654 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.510889 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.511016 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.511283 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.511380 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.511531 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.511621 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.511834 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.511931 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.512177 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.512292 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.512489 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.512585 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.512790 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.512884 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.513104 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.513190 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.513458 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.513555 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.513725 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.513821 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.514053 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.514141 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.514358 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.514460 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.514673 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.514808 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.515006 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.515090 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.515303 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.515388 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.515550 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.515650 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.515846 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.515936 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.516150 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.516240 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.516461 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.516547 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.516764 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.516857 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.517067 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.517161 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.517370 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.517462 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.517663 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.517752 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.517990 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.518137 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.518297 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.518390 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.518600 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.518686 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.518902 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.518987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.519204 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.519291 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.519505 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.519590 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.519805 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.519889 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.520106 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.520199 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.520404 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.520494 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.520716 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.520810 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.521029 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.521143 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.521331 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.521419 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.521632 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.521736 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.522068 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.522232 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.522390 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.522536 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.522668 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.522828 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.522971 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.523106 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.523251 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.523384 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.523540 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.523678 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.523832 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.523966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.524106 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.524250 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.524389 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.524534 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.524686 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.524818 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.524960 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.525045 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.525246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.525343 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.525544 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.525635 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.525850 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.525964 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.526189 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.526286 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.526526 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.526625 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.526797 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.526886 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.527095 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.527264 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.527392 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.527483 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.527692 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.527810 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.527992 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.528121 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.528306 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.528423 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.528588 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.528724 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.528888 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.529023 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.529199 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.529340 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.529515 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.529807 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.529954 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.530124 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.530272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.530420 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.530585 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.530727 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.530841 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.531049 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:24:47.531197 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.531379 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.531523 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.531716 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.531807 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.532032 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.532214 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.532357 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.532541 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.532737 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.533053 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.533196 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.533413 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.533560 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.533560 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.533969 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.534060 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.534256 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.534499 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.534699 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.534932 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.535153 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.535245 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.535331 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.535417 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.535496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.535583 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.535668 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.535746 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.535851 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.536006 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.536175 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.536318 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.536509 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.536634 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.536831 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.536930 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.537150 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.537246 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.538017 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.538277 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.538376 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.538524 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.538645 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.538833 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.538977 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.539171 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.539302 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.539509 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.539615 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.539820 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.539958 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.540141 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.540301 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.540460 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.540617 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.540768 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.540945 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.541082 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.541270 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.541385 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.541588 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.541724 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.541923 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.542036 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.542229 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.542334 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.542571 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.542685 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.542886 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.542983 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.543203 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.543301 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.543516 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.543605 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.543825 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.543921 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.544137 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.544225 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.544451 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.544548 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.544763 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.544864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.545076 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.545237 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.545383 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.545526 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.545687 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.545825 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.546026 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.546130 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.546338 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.546426 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.546648 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.546738 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.546950 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.547049 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.547252 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.547339 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.547552 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.547646 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.547857 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.547952 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.548156 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.548244 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.548460 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.548557 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.548771 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.548859 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.549073 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.549159 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.549394 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.549487 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.549693 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.549785 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.550024 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.550115 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.550333 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.550431 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.550642 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.550739 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.550945 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.551032 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.551257 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.551361 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.551568 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.551665 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.551871 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.551956 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.552186 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.552281 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.552490 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.552576 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.552795 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.552891 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.553679 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.553786 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.554025 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.554152 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.554339 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.554437 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.554667 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.554764 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.554975 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.555071 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.555283 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.555369 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.555593 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.555687 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.555902 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.555988 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.556217 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.556303 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.556528 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.556624 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.556838 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.556923 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.557163 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.557251 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.557479 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.557580 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.557779 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.557928 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.558125 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.558220 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.558449 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.558536 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.558758 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.558843 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.559055 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.559141 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.559363 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.559456 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.559663 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.559756 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.559964 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.560060 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.560264 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.560349 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.560568 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.560653 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.560869 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.560963 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.561170 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.561305 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.561470 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.561574 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.561849 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.562241 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.562437 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.562522 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.562691 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.562785 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.562926 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.563251 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.563346 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.563434 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.563514 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.563592 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.563683 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.563860 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.563946 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.564026 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.564205 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.564305 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.564497 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.564668 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.564778 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.565000 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.565087 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.565317 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.565418 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.565639 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.565726 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.565979 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.566070 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.566296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.566393 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.566637 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.566770 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.566915 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.567001 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.567224 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.567315 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.567534 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.567632 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.567852 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.567937 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.570256 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.570378 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.570531 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.570619 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.570751 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.570843 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.570980 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.571065 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.571197 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.571281 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.571413 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.571519 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.571519 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.571733 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.571840 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.571933 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.572065 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.572150 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.572281 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.572373 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.572506 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.572590 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.572711 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.572803 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.572927 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.573038 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.573143 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.573228 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.573357 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.573484 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.573571 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.573693 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.573775 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.573923 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.574008 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.574150 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.574235 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.574359 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.574458 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.574547 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.574626 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.574761 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.574853 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.575222 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.575305 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.575433 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.575541 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.575636 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.575795 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.576085 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.576085 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.576297 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.576396 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.576507 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.576710 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.576842 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.577037 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.577177 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.577346 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.577570 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.577767 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.577955 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.578046 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.578271 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.578376 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.578579 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.578665 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.578886 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.578984 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.579187 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.579287 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.579490 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.579576 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.579797 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.579895 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.580107 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.580197 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.580414 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.580502 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.580719 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.580807 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.581019 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.581107 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.581328 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.581414 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.581634 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.581719 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.581955 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.582045 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.582259 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.582356 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.582567 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.582659 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.582875 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.582977 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.583179 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.583270 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.583489 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.583582 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.583800 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.583885 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.584136 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.584388 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.584528 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.584631 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.584848 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.584944 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.585154 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.585240 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.585456 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.585556 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.585757 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.585847 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.586091 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.586187 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.586428 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.586523 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.586732 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.586823 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.587032 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.587125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.587347 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.587434 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.587665 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.587750 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.587990 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.588115 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.588286 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.588378 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.588660 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.588787 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.588902 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.588989 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.589218 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.589310 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.589531 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.589616 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.589837 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.589951 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.590171 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.590268 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.590485 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.590571 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.590829 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.590937 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.591108 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.591195 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.591431 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.591569 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.591744 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.591886 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.592055 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.592199 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.592365 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.592507 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.592655 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.592804 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.592952 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.593091 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.593266 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.593398 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.593570 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.593844 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.593953 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.594199 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.594298 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.594515 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.594775 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.594870 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.595113 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.595206 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.595434 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.595521 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.595758 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.595852 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.596085 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.596172 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.596408 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.596495 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.596716 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.596849 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.597026 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.597181 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.597329 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.597528 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.597623 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.597839 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.598006 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.598185 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.598271 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.598492 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.598585 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.598798 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.598893 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.599103 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.599188 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.599405 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.599492 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.599707 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.599807 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.600519 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.600617 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.600820 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.600913 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.601122 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.601217 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.601419 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.601504 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.601722 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.601847 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.602056 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.602152 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.602373 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.602459 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.602677 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.602764 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.602991 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.603078 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.603347 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.603446 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.603590 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.603683 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.603914 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.604011 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.604221 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.604308 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.604525 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.604619 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.604830 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.604920 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.605175 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.605261 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.605474 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.605568 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.605775 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.605935 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.606126 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.606219 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.606427 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.606522 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.606727 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.606814 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.607026 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.607113 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.607332 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.607426 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.607636 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.607723 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.607934 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.608026 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.608242 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.608337 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.608550 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.608642 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.608856 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.608941 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.609157 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.609252 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.609458 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.609544 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.609763 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.609848 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.610085 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.610181 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.610396 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.610481 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.610700 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.610785 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.611001 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.611087 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.611299 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.611397 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.611604 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.611698 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.611908 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.611994 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.612205 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.612339 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.612506 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.612600 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.612803 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.612888 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.613113 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.613197 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.613416 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.613545 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.613718 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.613819 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.614038 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.614139 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.614352 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.614463 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.614658 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.614755 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.614966 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.615074 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.615268 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.615366 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.616113 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.616330 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.616420 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.616499 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.616722 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.616826 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.617042 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.617129 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.617353 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.617439 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.617652 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.617738 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.617979 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.618066 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.618294 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.618382 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.618602 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.618691 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.618897 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.618990 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.619201 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.619288 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.619503 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.619591 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.619803 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.619896 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.620103 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.620198 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.620407 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.620493 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.620706 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.620794 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.621006 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.621099 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.621305 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.621391 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.621602 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.621688 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.621914 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.622061 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.622221 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.622307 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.622525 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.622623 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.622824 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.622919 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.623123 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.623207 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.623420 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.623635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.623739 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.623821 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.624028 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.624123 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.624331 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.624419 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.624649 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.624764 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.624971 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.625072 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.625271 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.625363 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.625579 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.625664 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.625901 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.626013 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.626297 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.626382 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.626599 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.626687 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.626910 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.627004 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.627215 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.627311 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.627524 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.627611 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.627821 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.627907 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.628120 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.628216 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.628435 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.628528 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.628743 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.628829 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.629051 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.629150 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.629367 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.629454 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.629682 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.629776 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.630028 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.630136 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.630330 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.630416 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.630633 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.630725 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.630939 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.631037 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.631272 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.631398 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.631601 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.631727 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.631906 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.631993 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.632216 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.632312 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.632522 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.632608 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.632827 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.632913 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.633133 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.633218 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.633437 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.633522 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.633749 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.633845 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.634090 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.634178 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.634406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.634492 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.634719 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.634807 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.635027 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.635113 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.635337 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.635443 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.635639 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.635739 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.635941 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.636017 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.636265 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.636355 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.636576 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.636653 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.636881 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.636957 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.637190 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.637399 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.637579 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.637670 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.637939 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.638039 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.638120 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.638293 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.638542 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.638628 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.638856 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.638944 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.639171 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.639259 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.639476 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.639563 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.639776 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.639861 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.640088 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.640174 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.640406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.640493 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.640723 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.640810 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.641026 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.641114 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.641355 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.641440 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.641655 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.641741 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.641983 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.642074 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.642306 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.642400 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.642605 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.642702 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.642903 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.642996 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.643201 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.643288 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.643518 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.643612 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.643818 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.643903 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.644129 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.644215 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.644433 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.644527 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.644757 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.644852 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.645061 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.645162 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.645383 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.645511 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.645798 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.645936 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.646133 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.646219 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.646440 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.646536 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.646806 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.646902 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.647136 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.647231 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.647438 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.647526 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.647752 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.647836 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.648058 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.648235 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.648377 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.648473 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.648695 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.648783 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.649006 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.649092 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.649314 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.649399 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.649611 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.649698 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.649952 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.650044 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.650275 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.650360 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.650585 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.650672 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.650889 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.650975 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.651215 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.651317 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.651538 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.651633 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.651852 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.651939 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.652175 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.652275 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.652511 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.652604 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.652813 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.652907 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.653113 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.653209 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.653420 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.653506 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.653722 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.653808 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.654047 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.654159 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.654369 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.654455 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.654671 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.654756 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.654979 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.655067 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.655290 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.655376 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.655596 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.655681 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.655896 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.655983 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.656203 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.656290 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.656514 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.656599 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.656813 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.656898 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.657119 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.657204 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.657443 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.657593 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.657739 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.657833 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.658073 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.658176 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.658375 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.658469 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.658694 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.658780 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.659000 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.659086 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.659301 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.659401 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.659603 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.659688 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.659904 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.659989 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.660220 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.660316 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.660527 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.660621 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.660833 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.660921 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.661140 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.661235 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.661465 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.661553 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.661772 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.661864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.662126 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.662225 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.662964 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.663064 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.663280 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.663373 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.663589 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.663677 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.663911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.664083 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.664212 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.664299 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.664514 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.664601 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.664820 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.664908 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.665121 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.665215 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.665425 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.665511 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.665727 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.665813 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.666057 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.666159 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.666360 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.666448 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.666681 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.666779 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.666962 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.667057 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.667268 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.667361 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.667568 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.667653 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.667871 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.667965 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.668177 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.668274 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.668474 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.668567 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.668778 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.668865 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.669078 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.669164 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.669392 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.669480 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.669699 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.669787 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.670030 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.670120 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.670338 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.670424 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.670665 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.670758 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.670973 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.671060 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.671285 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.671369 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.671604 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.671691 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.671917 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.672011 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.672231 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.672330 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.672541 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.672627 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.672851 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.672956 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.673168 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.673343 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.673477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.673564 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.673789 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.673874 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.674129 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.674226 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.674444 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.674531 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.674759 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.674852 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.675074 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.675168 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.675387 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.675613 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.675701 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.675936 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.676028 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.676249 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.676338 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.676560 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.676836 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.676923 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.677168 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.677261 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.677477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.677562 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.677784 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.677872 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.678664 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.678774 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.678978 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.679073 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.679285 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.679372 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.679594 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.679681 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.679906 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.679992 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.680217 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.680317 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.680527 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.680614 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.680843 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.680939 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.681154 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.681259 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.681464 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.681551 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.681774 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.681862 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.682123 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.682223 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.682442 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.682531 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.682742 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.682827 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.683052 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.683203 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.683367 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.683491 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.683676 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.683795 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.683984 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.684084 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.684292 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.684391 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.684602 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.684710 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.684910 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.685007 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.685214 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.685324 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.685518 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.685643 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.685827 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.685945 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.686159 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.686247 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.686469 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.686559 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.686781 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.686876 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.687095 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.687183 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.687400 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.687487 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.687709 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.687805 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.688019 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.688106 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.688346 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.688529 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.688668 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.688839 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.688982 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.689165 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.689300 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.689484 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.689802 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.689928 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.690139 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.690240 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.690454 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.690542 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.690776 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.690867 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.691097 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.691203 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.691414 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.691505 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.691702 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.691799 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.692007 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.692111 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.692316 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.692456 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.692619 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.692755 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.692928 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.693043 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.693269 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.693445 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.693738 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.693829 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.693964 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.694114 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.694200 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.694476 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.694636 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.694795 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.695008 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.695099 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.695415 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.695630 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.695754 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.695982 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.696190 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.696303 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.696681 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.696782 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.696963 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.697285 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.697382 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.697642 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.697859 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.698014 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.698238 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.698340 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.698568 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.698793 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.698946 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.699208 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.699365 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.699516 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.699823 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.700160 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.700419 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.700714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.700801 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.701027 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.701198 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.701364 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.701531 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.701759 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.701937 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.702117 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.702404 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.702528 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.702940 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.703031 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.703253 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.703528 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.703648 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.703896 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.703982 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.704205 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.704307 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.704571 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.704670 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.704883 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.705010 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.705203 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.705372 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.705515 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.705627 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.705824 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.705981 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.706165 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.706291 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.706470 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.706607 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.706790 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.706914 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.707095 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.707228 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.707406 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.707586 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.707714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.707911 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.708030 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.708218 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.708335 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.708523 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.708644 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.708847 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.708994 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.709157 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.709340 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.709507 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.709646 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.709822 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.709956 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.710165 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.710262 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.710518 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.710607 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.710837 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.710928 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.711177 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.711389 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.711479 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.711725 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.711822 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.712048 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.712139 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.712385 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.712661 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.712775 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.712995 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.713086 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.713310 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.713412 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.713622 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.713748 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.713983 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.714094 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.714291 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.714380 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.714597 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.714694 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.714900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.715000 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.715209 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.715297 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.715515 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.715611 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.715823 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.715911 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.716130 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.716218 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.716439 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.716535 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.716749 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.716839 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.717053 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.717152 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.717362 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.717450 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.717671 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.717767 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.718006 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.718097 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.718320 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.718417 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.718641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.718731 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.718966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.719055 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.719276 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.719366 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.719583 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.719677 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.719896 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.719994 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.720211 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.720306 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.720525 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.720614 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.720833 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.720931 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.721141 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.721270 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.721449 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.721538 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.721754 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.721858 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.722084 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.722173 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.722391 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.722479 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.722695 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.722784 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.723007 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.723117 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.723333 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.723423 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.723647 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.723780 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.723951 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.724059 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.724352 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.724449 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.724726 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.724828 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.725588 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.725705 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.725825 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.725963 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.726156 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.726244 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.726476 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.726689 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.726801 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.726900 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.727110 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.727201 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.727429 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.727517 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.727737 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.727841 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.728057 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.728145 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.728362 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.728458 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.728673 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.728772 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.728983 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.729072 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.729290 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.729378 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.729592 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.729715 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.729928 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.730054 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.730222 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.730359 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.730541 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.730672 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.730847 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.730977 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.731146 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.731283 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.731429 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.731588 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.731738 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.731893 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.732040 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.732202 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.732341 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.732504 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.732641 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.732809 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.732940 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.733112 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.733242 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.733414 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.733542 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.733732 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.733904 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.734046 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.734141 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.734362 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.734451 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.734666 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.734756 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.734963 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.735056 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.735262 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.735351 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.735567 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.735665 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.735866 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.735967 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.736216 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.736311 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.736468 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.736566 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.736773 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.736877 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.737098 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.737226 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.737426 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.737651 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.737813 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.738051 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.738152 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.738368 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.738480 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.738682 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.738890 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.738981 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.739226 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.739316 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.739583 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.739672 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.739893 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.739992 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.740197 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.740319 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.741159 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.741262 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.741473 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.741563 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.741783 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.741880 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.742121 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.742220 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.742429 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.742518 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.742737 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.742833 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.743044 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.743133 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.743367 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.743456 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.743674 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.743769 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.743980 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.744121 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.744301 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.744399 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.744615 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.744713 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.744927 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.745014 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.745235 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.745328 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.745545 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.745635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.745863 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.745991 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.746194 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.746290 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.746507 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.746596 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.746816 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.746903 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.747125 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.747213 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.747435 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.747533 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.747747 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.747835 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.748052 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.748152 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.748362 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.748451 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.748675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.748763 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.748987 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.749084 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.749308 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.749397 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.749618 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.749706 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.749947 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.750060 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.750272 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.750361 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.750593 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.750684 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.750933 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.751030 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.751241 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.751329 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.751587 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.751687 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.751899 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.751988 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.752208 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.752295 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.752513 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.752602 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.752759 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:24:47.752851 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:24:47.753040 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:24:47.907297 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] Registered counter for database nova_api Aug 01 15:24:47.908308 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Registered counter for database nova_api Aug 01 15:24:47.929625 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:24:47.931194 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:24:47.936377 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:24:47.937796 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:24:47.992328 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.context [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),67c0a4a7-1fcd-43c5-96b9-b81917d6c715(cell1) {{(pid=103349) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:24:47.994193 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.context [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),67c0a4a7-1fcd-43c5-96b9-b81917d6c715(cell1) {{(pid=103348) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:24:47.996224 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.997802 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:47.998116 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.998612 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.999681 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.000477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:48.000570 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.002472 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.002579 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] Registered counter for database nova_cell0 Aug 01 15:24:48.004432 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Registered counter for database nova_cell0 Aug 01 15:24:48.008585 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] Registered counter for database nova_cell1 Aug 01 15:24:48.010547 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Registered counter for database nova_cell1 Aug 01 15:24:48.016623 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:24:48.018285 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:24:48.020411 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:24:48.021319 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:24:48.025625 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:24:48.026007 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:24:48.029497 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:24:48.029730 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:24:48.171100 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] Registered counter for database nova_cell0 Aug 01 15:24:48.176415 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Registered counter for database nova_cell0 Aug 01 15:24:48.181117 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:24:48.185648 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:24:48.186241 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:24:48.190559 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:24:48.526668 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:24:48.534046 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:24:48.534456 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:24:48.544929 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:24:48.875774 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:24:48.882364 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:24:48.887625 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56552d5929c0 pid: 103348 (default app) Aug 01 15:24:48.889712 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:48.890913 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] 10.222.0.83 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001773 Aug 01 15:24:48.891324 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 788 bytes} [Mon Aug 1 15:24:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:48.892572 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:24:48.898893 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-66dff7be-9430-4c05-af8c-08ff5ab747d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:24:48.904244 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56552d5929c0 pid: 103349 (default app) Aug 01 15:26:05.896409 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:05.897578 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Aug 01 15:26:05.898430 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 2/2] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:05.910192 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=3 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:05.911334 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell1:SELECT=3 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:05.912427 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell0:SELECT=3 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:05.913262 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:06.797921 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-f067d85d-c4b3-425c-9034-90bf4aa7b294 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:06.830725 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-f067d85d-c4b3-425c-9034-90bf4aa7b294 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925645 Aug 01 15:26:06.831535 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 1/3] 10.222.0.83 () {60 vars in 1291 bytes} [Mon Aug 1 15:26:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:09.060186 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:09.061650 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-b44d0b3a-a431-4301-b363-7facc0fab91e None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001929 Aug 01 15:26:09.068237 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 3/4] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:09 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:09.567235 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-00502543-6fed-4252-889f-38a9fec46262 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "id": "c1"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:09.590116 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:26:09.590116 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: warnings.warn(msg) Aug 01 15:26:09.621826 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-00502543-6fed-4252-889f-38a9fec46262 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.552230 Aug 01 15:26:09.623174 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 2/5] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Aug 1 15:26:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:26:09.636375 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:09.637512 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:09.638473 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell1:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:09.639189 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:09.895299 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-2291f163-dd3a-4cb0-a904-50163f53e466 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:09.899680 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:26:09.899680 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Aug 01 15:26:09.965844 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-2291f163-dd3a-4cb0-a904-50163f53e466 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.334570 Aug 01 15:26:09.970277 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 4/6] 10.222.0.83 () {64 vars in 1335 bytes} [Mon Aug 1 15:26:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:12.239491 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-00502543-6fed-4252-889f-38a9fec46262 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:12.240504 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-00502543-6fed-4252-889f-38a9fec46262 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 Aug 01 15:26:12.240899 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 3/7] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:12.925974 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-376903ca-8bee-4776-a3fc-e9805119cfb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:12.947633 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:26:12.947633 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Aug 01 15:26:12.971309 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-376903ca-8bee-4776-a3fc-e9805119cfb6 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.724274 Aug 01 15:26:12.972122 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 5/8] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Aug 1 15:26:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:26:12.985034 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-042d12aa-7ccd-4a89-acb3-9b67fdb16b9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:12.988385 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:26:12.988385 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: warnings.warn(msg) Aug 01 15:26:13.026930 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-042d12aa-7ccd-4a89-acb3-9b67fdb16b9d admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046066 Aug 01 15:26:13.033840 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 4/9] 10.222.0.83 () {64 vars in 1335 bytes} [Mon Aug 1 15:26:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:15.288568 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-376903ca-8bee-4776-a3fc-e9805119cfb6 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:15.289970 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-376903ca-8bee-4776-a3fc-e9805119cfb6 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 01 15:26:15.294658 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 6/10] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:15.735978 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-3e89c8bf-fce6-4b64-bf04-4b4909a65b8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:15.762326 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-3e89c8bf-fce6-4b64-bf04-4b4909a65b8a admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466727 Aug 01 15:26:15.762879 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 5/11] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Aug 1 15:26:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:26:15.774944 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-fc9e2609-9fd3-4eab-8b5f-d2d76fccd812 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:15.802018 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-fc9e2609-9fd3-4eab-8b5f-d2d76fccd812 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030579 Aug 01 15:26:15.802500 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 7/12] 10.222.0.83 () {64 vars in 1335 bytes} [Mon Aug 1 15:26:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:18.031575 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-3e89c8bf-fce6-4b64-bf04-4b4909a65b8a admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:18.033404 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-3e89c8bf-fce6-4b64-bf04-4b4909a65b8a admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 Aug 01 15:26:18.034053 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 6/13] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:18.480564 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-7720b4c9-5177-4289-830e-7bbf05a2e53e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:18.498766 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-7720b4c9-5177-4289-830e-7bbf05a2e53e admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458012 Aug 01 15:26:18.499301 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 8/14] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Aug 1 15:26:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:26:18.514005 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-30aba996-4619-4b7c-83b3-ae8539d8127c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:18.544859 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-30aba996-4619-4b7c-83b3-ae8539d8127c admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034854 Aug 01 15:26:18.547027 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 7/15] 10.222.0.83 () {64 vars in 1335 bytes} [Mon Aug 1 15:26:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:20.830251 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-7720b4c9-5177-4289-830e-7bbf05a2e53e admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:20.831630 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-7720b4c9-5177-4289-830e-7bbf05a2e53e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001762 Aug 01 15:26:20.832875 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 9/16] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:21.340650 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-c76d71de-b730-41c4-8b11-965244cd79a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "swap": 0, "name": "ds4G"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:21.360777 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-c76d71de-b730-41c4-8b11-965244cd79a7 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520200 Aug 01 15:26:21.361755 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 8/17] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Aug 1 15:26:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:26:21.373575 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-15aa0c8f-fcf6-4fa2-bcc4-10465049bb83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:21.403049 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-15aa0c8f-fcf6-4fa2-bcc4-10465049bb83 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033167 Aug 01 15:26:21.404079 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 10/18] 10.222.0.83 () {64 vars in 1335 bytes} [Mon Aug 1 15:26:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:23.690547 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-c76d71de-b730-41c4-8b11-965244cd79a7 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:23.692029 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-c76d71de-b730-41c4-8b11-965244cd79a7 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001991 Aug 01 15:26:23.692662 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 9/19] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:24.121068 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-a73a9a7b-8e92-4105-b8d8-0eaacfdf6f5e admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:24.145764 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-a73a9a7b-8e92-4105-b8d8-0eaacfdf6f5e admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447191 Aug 01 15:26:24.146371 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 11/20] 10.222.0.83 () {60 vars in 1291 bytes} [Mon Aug 1 15:26:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:26.492828 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-c76d71de-b730-41c4-8b11-965244cd79a7 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:26.493860 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-c76d71de-b730-41c4-8b11-965244cd79a7 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 01 15:26:26.494312 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 10/21] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:26:26.941119 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-9d2852ac-f45d-4347-ab8b-f6edf01d28f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 512, "id": "1", "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:26.963241 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-9d2852ac-f45d-4347-ab8b-f6edf01d28f6 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.462302 Aug 01 15:26:26.963821 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 12/22] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Aug 1 15:26:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:26:26.976259 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-d5147a4c-df95-4645-9f11-052bab7df10f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:27.000506 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-d5147a4c-df95-4645-9f11-052bab7df10f admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028423 Aug 01 15:26:27.001089 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 11/23] 10.222.0.83 () {64 vars in 1332 bytes} [Mon Aug 1 15:26:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:29.235891 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-9d2852ac-f45d-4347-ab8b-f6edf01d28f6 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:29.236922 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-9d2852ac-f45d-4347-ab8b-f6edf01d28f6 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 01 15:26:29.237410 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 13/24] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:29.641272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-dd682444-9de7-415a-bc34-7e141a511226 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "swap": 0}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:29.666603 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-dd682444-9de7-415a-bc34-7e141a511226 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.422629 Aug 01 15:26:29.667532 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 12/25] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Aug 1 15:26:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:26:29.680107 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-1b46423d-3537-4c78-aff2-c87059cf4c8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:29.705342 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-1b46423d-3537-4c78-aff2-c87059cf4c8d admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028922 Aug 01 15:26:29.706472 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 14/26] 10.222.0.83 () {64 vars in 1332 bytes} [Mon Aug 1 15:26:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:31.962251 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-dd682444-9de7-415a-bc34-7e141a511226 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:31.963311 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-dd682444-9de7-415a-bc34-7e141a511226 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Aug 01 15:26:31.963721 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 13/27] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:32.391011 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-7a78d7d8-b6ba-4c01-8d5a-545a392fac9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:32.412125 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-7a78d7d8-b6ba-4c01-8d5a-545a392fac9a admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.441767 Aug 01 15:26:32.412660 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 15/28] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Aug 1 15:26:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:26:32.424640 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-89974f64-0390-4ab7-a3dd-4e69627d6657 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:32.450231 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-89974f64-0390-4ab7-a3dd-4e69627d6657 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029266 Aug 01 15:26:32.451203 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 14/29] 10.222.0.83 () {64 vars in 1332 bytes} [Mon Aug 1 15:26:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:26:34.784812 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-7a78d7d8-b6ba-4c01-8d5a-545a392fac9a admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:34.785751 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-7a78d7d8-b6ba-4c01-8d5a-545a392fac9a admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 01 15:26:34.786181 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 16/30] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:35.251118 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-e8c3f8df-d0b7-417f-9649-98d6e52da6eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:35.272490 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-e8c3f8df-d0b7-417f-9649-98d6e52da6eb admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.479892 Aug 01 15:26:35.273134 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 15/31] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Aug 1 15:26:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:26:35.285166 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-16e59415-1307-4a88-ad53-6b94a94bda6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:35.313469 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-16e59415-1307-4a88-ad53-6b94a94bda6c admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031988 Aug 01 15:26:35.314084 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 17/32] 10.222.0.83 () {64 vars in 1332 bytes} [Mon Aug 1 15:26:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:26:37.575882 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-e8c3f8df-d0b7-417f-9649-98d6e52da6eb admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:37.577966 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-e8c3f8df-d0b7-417f-9649-98d6e52da6eb admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002492 Aug 01 15:26:37.584888 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 16/33] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:37 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:38.053149 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-edf4fe7c-af56-46a3-b50f-c83026cf9700 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "id": "5"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:38.074277 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-edf4fe7c-af56-46a3-b50f-c83026cf9700 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.488967 Aug 01 15:26:38.075152 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 18/34] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Aug 1 15:26:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:26:38.088131 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-cffa6dda-840e-4434-bffb-c3667d79ca47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:38.096542 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:38.115155 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-cffa6dda-840e-4434-bffb-c3667d79ca47 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030967 Aug 01 15:26:38.116339 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 17/35] 10.222.0.83 () {64 vars in 1332 bytes} [Mon Aug 1 15:26:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:26:58.468048 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-edf4fe7c-af56-46a3-b50f-c83026cf9700 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:58.469063 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-edf4fe7c-af56-46a3-b50f-c83026cf9700 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 01 15:26:58.469458 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 19/36] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:26:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:58.880405 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-10c93829-abc6-451d-bd51-f1e893825bea admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:58.898600 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-10c93829-abc6-451d-bd51-f1e893825bea admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.421588 Aug 01 15:26:58.899067 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 18/37] 10.222.0.83 () {60 vars in 1291 bytes} [Mon Aug 1 15:26:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:59.983838 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-edf4fe7c-af56-46a3-b50f-c83026cf9700 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:59.984863 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-edf4fe7c-af56-46a3-b50f-c83026cf9700 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 01 15:26:59.985262 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 20/38] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 1 15:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:00.516111 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-429b3205-e4d2-4d18-9262-6ae5411c0747 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:00.522374 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.wsgi [None req-429b3205-e4d2-4d18-9262-6ae5411c0747 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-429b3205-e4d2-4d18-9262-6ae5411c0747 admin admin] Request method failure captured: Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Accept: application/json Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Accept-Encoding: gzip, deflate Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Connection: keep-alive Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Content-Length: 0 Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Host: 10.222.0.83 Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Openstack-Api-Version: compute 2.90 Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Openstack-System-Scope: None Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: User-Agent: python-novaclient Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Auth-Token: gAAAAABi5_DDbZsQIrWTQnxXzVYqaeX5UGN9RQPzynh7vpm19JFLMqbLacoN6eeLhtKbrvqAfGJEChT1OvFZwIYPRATmM_pZv3l6pz9z37sKHZlOdHCWvLzy9h69QgmrAmLTlztHCr8Wezw3slW9lu2FABJEqj8XcNBxFEwNDEBGy0IPMJ-DTDc Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Domain-Id: None Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Domain-Name: None Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Identity-Status: Confirmed Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Is-Admin-Project: True Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Project-Domain-Id: default Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Project-Domain-Name: Default Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Project-Id: 6c0cb293301d4dcdbc4412b1e11a284f Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Project-Name: admin Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Role: admin,reader,member Aug 01 15:27:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Roles: admin,reader,member Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6c0cb293301d4dcdbc4412b1e11a284f"}]}] Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Tenant: admin Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Tenant-Id: 6c0cb293301d4dcdbc4412b1e11a284f Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Tenant-Name: admin Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User: admin Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User-Domain-Id: default Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User-Domain-Name: Default Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User-Id: 01b3cc95b90b46cf85a902fea655d1ea Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User-Name: admin Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: method: > Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: exception: Flavor 42 could not be found. Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: action_args: {'id': '42'} Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:00.527496 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:00.528635 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:00.530109 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-429b3205-e4d2-4d18-9262-6ae5411c0747 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:00.531429 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-429b3205-e4d2-4d18-9262-6ae5411c0747 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.401078 Aug 01 15:27:00.531429 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 19/39] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 1 15:27:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:27:00.537006 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0329e890-057c-4c08-a8a3-971c4a7b58ef admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:00.541219 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:00.562292 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0329e890-057c-4c08-a8a3-971c4a7b58ef admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028853 Aug 01 15:27:00.562871 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 21/40] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 1 15:27:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:00.573470 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-75e092a3-9d92-4b21-b9cf-895ab2f9e0df admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:00.597387 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-75e092a3-9d92-4b21-b9cf-895ab2f9e0df admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027588 Aug 01 15:27:00.597950 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 20/41] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 1 15:27:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:00.607759 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-e63befdd-a5c8-4dd9-97b2-189e41e1f55e admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:00.614708 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-e63befdd-a5c8-4dd9-97b2-189e41e1f55e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-e63befdd-a5c8-4dd9-97b2-189e41e1f55e admin admin] Request method failure captured: Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Accept: application/json Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Connection: keep-alive Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Content-Length: 0 Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Host: 10.222.0.83 Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABi5_DDbZsQIrWTQnxXzVYqaeX5UGN9RQPzynh7vpm19JFLMqbLacoN6eeLhtKbrvqAfGJEChT1OvFZwIYPRATmM_pZv3l6pz9z37sKHZlOdHCWvLzy9h69QgmrAmLTlztHCr8Wezw3slW9lu2FABJEqj8XcNBxFEwNDEBGy0IPMJ-DTDc Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Project-Id: 6c0cb293301d4dcdbc4412b1e11a284f Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Role: admin,reader,member Aug 01 15:27:00.618022 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Roles: admin,reader,member Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6c0cb293301d4dcdbc4412b1e11a284f"}]}] Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Tenant: admin Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Tenant-Id: 6c0cb293301d4dcdbc4412b1e11a284f Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User: admin Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User-Id: 01b3cc95b90b46cf85a902fea655d1ea Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User-Name: admin Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: method: > Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: exception: Flavor 42 could not be found. Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: action_args: {'id': '42'} Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:00.619675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:00.620675 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:00.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-e63befdd-a5c8-4dd9-97b2-189e41e1f55e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:00.623227 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-e63befdd-a5c8-4dd9-97b2-189e41e1f55e admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015560 Aug 01 15:27:00.623227 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 22/42] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 1 15:27:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 01 15:27:01.610322 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-75e092a3-9d92-4b21-b9cf-895ab2f9e0df admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:01.611320 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-75e092a3-9d92-4b21-b9cf-895ab2f9e0df admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 01 15:27:01.611709 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 21/43] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 1 15:27:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:02.153305 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-1887a4d4-7096-4e2f-91c8-65aad85f218b admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:02.159811 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-1887a4d4-7096-4e2f-91c8-65aad85f218b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-1887a4d4-7096-4e2f-91c8-65aad85f218b admin admin] Request method failure captured: Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Accept: application/json Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Connection: keep-alive Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Content-Length: 0 Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Host: 10.222.0.83 Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABi5_DFT8Y8YI80ZI5EQXZwPzyriNtbYe0Sp9d5jnYtINEZW8exqjBG_CmQy754Jf0Vv1cv3jqmxJeBFMCgNvRUjTMvqF7bTs8xja2YUXxj_cr7LNN9taENx6nWmY5AV7l-MJe0-2WGoX309I8PfuqdqEihleECNgpC9YdQq_SFkjYgbDM Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Project-Id: 6c0cb293301d4dcdbc4412b1e11a284f Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Role: admin,reader,member Aug 01 15:27:02.161296 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Roles: admin,reader,member Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6c0cb293301d4dcdbc4412b1e11a284f"}]}] Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Tenant: admin Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Tenant-Id: 6c0cb293301d4dcdbc4412b1e11a284f Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User: admin Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User-Id: 01b3cc95b90b46cf85a902fea655d1ea Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User-Name: admin Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: method: > Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: exception: Flavor 84 could not be found. Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: action_args: {'id': '84'} Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:02.162864 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:02.163714 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:02.164911 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-1887a4d4-7096-4e2f-91c8-65aad85f218b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:02.165977 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-1887a4d4-7096-4e2f-91c8-65aad85f218b admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.410947 Aug 01 15:27:02.165977 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 23/44] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 1 15:27:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:27:02.172367 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-cc5c8d33-1521-4b7b-bb34-777f59c63aa0 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:02.187478 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-cc5c8d33-1521-4b7b-bb34-777f59c63aa0 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018613 Aug 01 15:27:02.188027 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 22/45] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 1 15:27:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:02.197840 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-72190325-47a7-4cea-84b0-808e9c80f2db admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:02.213665 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-72190325-47a7-4cea-84b0-808e9c80f2db admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019556 Aug 01 15:27:02.214212 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 24/46] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 1 15:27:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:02.223779 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-ba41584d-4ab1-4acb-8994-4f1fdaac3c8b admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:02.229195 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.wsgi [None req-ba41584d-4ab1-4acb-8994-4f1fdaac3c8b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-ba41584d-4ab1-4acb-8994-4f1fdaac3c8b admin admin] Request method failure captured: Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Accept: application/json Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Accept-Encoding: gzip, deflate Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Connection: keep-alive Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Content-Length: 0 Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Host: 10.222.0.83 Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Openstack-Api-Version: compute 2.90 Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Openstack-System-Scope: None Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: User-Agent: python-novaclient Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Auth-Token: gAAAAABi5_DFT8Y8YI80ZI5EQXZwPzyriNtbYe0Sp9d5jnYtINEZW8exqjBG_CmQy754Jf0Vv1cv3jqmxJeBFMCgNvRUjTMvqF7bTs8xja2YUXxj_cr7LNN9taENx6nWmY5AV7l-MJe0-2WGoX309I8PfuqdqEihleECNgpC9YdQq_SFkjYgbDM Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Domain-Id: None Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Domain-Name: None Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Identity-Status: Confirmed Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Is-Admin-Project: True Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Project-Domain-Id: default Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Project-Domain-Name: Default Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Project-Id: 6c0cb293301d4dcdbc4412b1e11a284f Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Project-Name: admin Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Role: admin,reader,member Aug 01 15:27:02.230707 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Roles: admin,reader,member Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6c0cb293301d4dcdbc4412b1e11a284f"}]}] Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Tenant: admin Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Tenant-Id: 6c0cb293301d4dcdbc4412b1e11a284f Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Tenant-Name: admin Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User: admin Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User-Domain-Id: default Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User-Domain-Name: Default Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User-Id: 01b3cc95b90b46cf85a902fea655d1ea Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User-Name: admin Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: method: > Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: exception: Flavor 84 could not be found. Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: action_args: {'id': '84'} Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:02.232246 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:02.233125 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:02.234272 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-ba41584d-4ab1-4acb-8994-4f1fdaac3c8b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:02.235317 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-ba41584d-4ab1-4acb-8994-4f1fdaac3c8b admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011957 Aug 01 15:27:02.235317 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 23/47] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 1 15:27:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 01 15:27:03.240713 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-72190325-47a7-4cea-84b0-808e9c80f2db admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:03.241723 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-72190325-47a7-4cea-84b0-808e9c80f2db admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 01 15:27:03.242152 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 25/48] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 1 15:27:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:03.788249 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-ed884373-d96b-4392-be88-ee3b7c90c1bc admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:03.793928 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.wsgi [None req-ed884373-d96b-4392-be88-ee3b7c90c1bc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-ed884373-d96b-4392-be88-ee3b7c90c1bc admin admin] Request method failure captured: Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Accept: application/json Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Accept-Encoding: gzip, deflate Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Connection: keep-alive Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Content-Length: 0 Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Host: 10.222.0.83 Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Openstack-Api-Version: compute 2.90 Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Openstack-System-Scope: None Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: User-Agent: python-novaclient Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Auth-Token: gAAAAABi5_DHmODj1zw8idbR2wfpvOZJcbfq3ZSm2dKKPnJENlXHwYV4m3fITY9mwoseTPjff8ih91VsUlb5f2S-TmaO55KAVT5LCoO8AtHXokDw69uim45aF6EGGjiARpncQH-2Mxiia9Oegpam-O_cGLa0Wag6VdVKAXzdZBSaJk_DZDaoDBw Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Domain-Id: None Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Domain-Name: None Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Identity-Status: Confirmed Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Is-Admin-Project: True Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Project-Domain-Id: default Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Project-Domain-Name: Default Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Project-Id: 6c0cb293301d4dcdbc4412b1e11a284f Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Project-Name: admin Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Role: admin,reader,member Aug 01 15:27:03.795406 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Roles: admin,reader,member Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6c0cb293301d4dcdbc4412b1e11a284f"}]}] Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Tenant: admin Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Tenant-Id: 6c0cb293301d4dcdbc4412b1e11a284f Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-Tenant-Name: admin Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User: admin Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User-Domain-Id: default Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User-Domain-Name: Default Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User-Id: 01b3cc95b90b46cf85a902fea655d1ea Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: X-User-Name: admin Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: method: > Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: exception: Flavor 451 could not be found. Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: action_args: {'id': '451'} Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:03.796987 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:03.798040 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Aug 01 15:27:03.799499 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-ed884373-d96b-4392-be88-ee3b7c90c1bc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:03.800788 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-ed884373-d96b-4392-be88-ee3b7c90c1bc admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.411690 Aug 01 15:27:03.800788 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 24/49] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 1 15:27:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:27:03.806576 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-a451b803-ddd4-4414-a4f4-33b257116da0 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:03.821319 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-a451b803-ddd4-4414-a4f4-33b257116da0 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018280 Aug 01 15:27:03.821852 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 26/50] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 1 15:27:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:03.832801 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:03.848969 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020062 Aug 01 15:27:03.849607 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 25/51] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 1 15:27:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:03.859204 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-36abe714-aeb8-42aa-8787-d9215df43efd admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:03.864922 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-36abe714-aeb8-42aa-8787-d9215df43efd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-36abe714-aeb8-42aa-8787-d9215df43efd admin admin] Request method failure captured: Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Accept: application/json Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Connection: keep-alive Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Content-Length: 0 Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Host: 10.222.0.83 Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABi5_DHmODj1zw8idbR2wfpvOZJcbfq3ZSm2dKKPnJENlXHwYV4m3fITY9mwoseTPjff8ih91VsUlb5f2S-TmaO55KAVT5LCoO8AtHXokDw69uim45aF6EGGjiARpncQH-2Mxiia9Oegpam-O_cGLa0Wag6VdVKAXzdZBSaJk_DZDaoDBw Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Project-Id: 6c0cb293301d4dcdbc4412b1e11a284f Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Role: admin,reader,member Aug 01 15:27:03.866447 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Roles: admin,reader,member Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6c0cb293301d4dcdbc4412b1e11a284f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6c0cb293301d4dcdbc4412b1e11a284f"}]}] Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Tenant: admin Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Tenant-Id: 6c0cb293301d4dcdbc4412b1e11a284f Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User: admin Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User-Id: 01b3cc95b90b46cf85a902fea655d1ea Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: X-User-Name: admin Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: method: > Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: exception: Flavor 451 could not be found. Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: action_args: {'id': '451'} Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:03.867900 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:03.869012 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Aug 01 15:27:03.870477 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-36abe714-aeb8-42aa-8787-d9215df43efd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:03.871749 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-36abe714-aeb8-42aa-8787-d9215df43efd admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012235 Aug 01 15:27:03.871749 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 27/52] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 1 15:27:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:27:04.985758 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:04.987421 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 01 15:27:04.987824 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 26/53] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 1 15:27:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:05.521501 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-c65ddf1c-df10-456e-86d5-1d33adbcd124 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:05.540986 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-c65ddf1c-df10-456e-86d5-1d33adbcd124 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.414653 Aug 01 15:27:05.541517 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 28/54] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Aug 1 15:27:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:27:06.525459 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:06.526490 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 01 15:27:06.526938 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 27/55] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 1 15:27:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:27:07.060130 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-c8eb9f61-cabd-462f-a804-e4dace076958 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:07.079305 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-c8eb9f61-cabd-462f-a804-e4dace076958 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.412501 Aug 01 15:27:07.079850 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 29/56] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Aug 1 15:27:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:27:08.087211 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:08.088210 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 01 15:27:08.088605 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 28/57] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 1 15:27:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:08.621880 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-d54a70f0-51f8-4f1f-a1d9-19f0d90e4260 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:08.640668 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-d54a70f0-51f8-4f1f-a1d9-19f0d90e4260 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.412777 Aug 01 15:27:08.641206 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 30/58] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Aug 1 15:27:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:27:09.619849 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:09.620835 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 01 15:27:09.621226 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 29/59] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 1 15:27:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:10.154454 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-b573ef76-ac71-4119-8c2d-1ca179a34e77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:10.173171 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-b573ef76-ac71-4119-8c2d-1ca179a34e77 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.415637 Aug 01 15:27:10.173699 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 31/60] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Aug 1 15:27:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:27:11.150788 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:11.151794 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 01 15:27:11.152190 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 30/61] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 1 15:27:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:11.697115 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-713f887d-d788-4c11-9cc1-85bc60cda059 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:11.720683 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-713f887d-d788-4c11-9cc1-85bc60cda059 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.427531 Aug 01 15:27:11.721766 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 32/62] 10.222.0.83 () {60 vars in 1202 bytes} [Mon Aug 1 15:27:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:28:04.016570 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.017596 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0208952b-7290-42c2-993e-228777c0de74 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 01 15:28:04.018012 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 31/63] 10.222.0.83 () {54 vars in 930 bytes} [Mon Aug 1 15:28:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:04.028627 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:04.424465 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-dfe3c84b-5ae7-4c52-9457-06fa7dcf408d admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.444939 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-dfe3c84b-5ae7-4c52-9457-06fa7dcf408d admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420692 Aug 01 15:28:04.445422 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 33/64] 10.222.0.83 () {60 vars in 1291 bytes} [Mon Aug 1 15:28:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:28:04.467576 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:04.472007 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-bd025be7-68d1-4f09-87bb-f2743e0ea544 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.480342 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-bd025be7-68d1-4f09-87bb-f2743e0ea544 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014367 Aug 01 15:28:04.480880 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 32/65] 10.222.0.83 () {60 vars in 1282 bytes} [Mon Aug 1 15:28:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:04.492760 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-2e4664d3-4dce-41b6-8f94-f41b113f102f admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.500645 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-2e4664d3-4dce-41b6-8f94-f41b113f102f admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011425 Aug 01 15:28:04.501170 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 34/66] 10.222.0.83 () {60 vars in 1285 bytes} [Mon Aug 1 15:28:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:04.512713 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-5605fa63-425b-4f47-aca0-70dc21603947 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.522687 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-5605fa63-425b-4f47-aca0-70dc21603947 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013483 Aug 01 15:28:04.523217 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 33/67] 10.222.0.83 () {60 vars in 1285 bytes} [Mon Aug 1 15:28:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:04.535167 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-3e89dabb-4284-449e-8941-ce4d4e9d1df4 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.542833 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-3e89dabb-4284-449e-8941-ce4d4e9d1df4 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011853 Aug 01 15:28:04.543348 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 35/68] 10.222.0.83 () {60 vars in 1282 bytes} [Mon Aug 1 15:28:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:37.517016 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-5605fa63-425b-4f47-aca0-70dc21603947 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:37.518161 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-5605fa63-425b-4f47-aca0-70dc21603947 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002354 Aug 01 15:31:37.518569 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 34/69] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 1 15:31:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:37.664500 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=6 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:37.833912 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-34e87742-eb79-476b-9bb1-9d826fffe22e admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:37.836367 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:31:37.836367 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Aug 01 15:31:37.837584 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-34e87742-eb79-476b-9bb1-9d826fffe22e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:37.838065 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-34e87742-eb79-476b-9bb1-9d826fffe22e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:37.838860 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-34e87742-eb79-476b-9bb1-9d826fffe22e admin admin] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:37.839291 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-34e87742-eb79-476b-9bb1-9d826fffe22e admin admin] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:37.879912 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-34e87742-eb79-476b-9bb1-9d826fffe22e admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.216820 Aug 01 15:31:37.880750 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 36/70] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 1 15:31:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:31:38.738426 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-5605fa63-425b-4f47-aca0-70dc21603947 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:38.739522 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-5605fa63-425b-4f47-aca0-70dc21603947 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 Aug 01 15:31:38.739943 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 35/71] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 1 15:31:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:38.935891 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-69c8661a-9756-497c-9fc2-be2bdee322a3 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:38.940252 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:31:38.940252 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Aug 01 15:31:38.941803 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-69c8661a-9756-497c-9fc2-be2bdee322a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:38.942292 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-69c8661a-9756-497c-9fc2-be2bdee322a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:38.943086 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-69c8661a-9756-497c-9fc2-be2bdee322a3 admin admin] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:38.943520 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-69c8661a-9756-497c-9fc2-be2bdee322a3 admin admin] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:38.964813 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-69c8661a-9756-497c-9fc2-be2bdee322a3 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085000 Aug 01 15:31:38.965427 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 37/72] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 1 15:31:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:31:50.249547 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-5605fa63-425b-4f47-aca0-70dc21603947 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:50.250619 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-5605fa63-425b-4f47-aca0-70dc21603947 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 Aug 01 15:31:50.251010 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 36/73] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 1 15:31:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:50.394856 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=4 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:50.395574 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell1:SELECT=4 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:50.396204 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=8 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:50.444338 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-aab40017-4a71-4a80-a24a-5deffbd9dc27 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:50.446799 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:31:50.446799 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Aug 01 15:31:50.448011 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-aab40017-4a71-4a80-a24a-5deffbd9dc27 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:50.448451 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-aab40017-4a71-4a80-a24a-5deffbd9dc27 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:50.449223 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-aab40017-4a71-4a80-a24a-5deffbd9dc27 admin admin] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:50.449647 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-aab40017-4a71-4a80-a24a-5deffbd9dc27 admin admin] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:50.474141 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-aab40017-4a71-4a80-a24a-5deffbd9dc27 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083511 Aug 01 15:31:50.474687 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 38/74] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 1 15:31:50 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:31:51.321376 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-5605fa63-425b-4f47-aca0-70dc21603947 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:51.322439 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-5605fa63-425b-4f47-aca0-70dc21603947 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 01 15:31:51.322866 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 37/75] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 1 15:31:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:51.513939 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-918c3ce0-4616-4a52-bfaa-d65fdcc58681 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:51.516357 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:31:51.516357 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Aug 01 15:31:51.517548 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-918c3ce0-4616-4a52-bfaa-d65fdcc58681 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:51.518016 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-918c3ce0-4616-4a52-bfaa-d65fdcc58681 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:51.518797 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-918c3ce0-4616-4a52-bfaa-d65fdcc58681 admin admin] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:51.519344 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-918c3ce0-4616-4a52-bfaa-d65fdcc58681 admin admin] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:51.543091 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-918c3ce0-4616-4a52-bfaa-d65fdcc58681 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080760 Aug 01 15:31:51.543741 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 39/76] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 1 15:31:51 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:32:52.819259 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: Mon Aug 1 15:32:52 2022 - graceful shutdown triggered... Aug 01 15:32:52.819818 dv-cinder-847536-3-iscsi devstack@n-api.service[103349]: Gracefully killing worker 2 (pid: 103349)... Aug 01 15:32:52.819381 dv-cinder-847536-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 15:32:52.820606 dv-cinder-847536-3-iscsi devstack@n-api.service[103348]: Gracefully killing worker 1 (pid: 103348)... Aug 01 15:32:53.820323 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: worker 1 buried after 1 seconds Aug 01 15:32:53.820323 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: worker 2 buried after 1 seconds Aug 01 15:32:53.821224 dv-cinder-847536-3-iscsi devstack@n-api.service[103347]: goodbye to uWSGI. Aug 01 15:32:53.821962 dv-cinder-847536-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 15:32:53.822503 dv-cinder-847536-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 15:32:53.825302 dv-cinder-847536-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 15:32:53.837465 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 15:32:53.839876 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 15:32:53 2022] *** Aug 01 15:32:53.839876 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 15:32:53.839876 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 15:32:53.839876 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: nodename: dv-cinder-847536-3-iscsi Aug 01 15:32:53.839876 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: machine: x86_64 Aug 01 15:32:53.839876 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: clock source: unix Aug 01 15:32:53.839876 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: pcre jit disabled Aug 01 15:32:53.839876 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: detected number of CPU cores: 4 Aug 01 15:32:53.839876 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: current working directory: / Aug 01 15:32:53.839876 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: detected binary path: /usr/bin/uwsgi-core Aug 01 15:32:53.839876 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: your processes number limit is 47680 Aug 01 15:32:53.840599 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: your memory page size is 4096 bytes Aug 01 15:32:53.840599 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: detected max file descriptor number: 2048 Aug 01 15:32:53.840599 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: lock engine: pthread robust mutexes Aug 01 15:32:53.840599 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: thunder lock: enabled Aug 01 15:32:53.840599 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 15:32:53.840599 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 15:32:53.881869 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: Python main interpreter initialized at 0x556a671709c0 Aug 01 15:32:53.881869 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: python threads support enabled Aug 01 15:32:53.881869 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: your server socket listen backlog is limited to 100 connections Aug 01 15:32:53.881869 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: your mercy for graceful operations on workers is 90 seconds Aug 01 15:32:53.882522 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 15:32:53.882522 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: *** Operational MODE: preforking *** Aug 01 15:32:53.882756 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: *** uWSGI is running in multiple interpreter mode *** Aug 01 15:32:53.882756 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: spawned uWSGI master process (pid: 124510) Aug 01 15:32:53.882823 dv-cinder-847536-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 15:32:53.885397 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: spawned uWSGI worker 1 (pid: 124526, cores: 1) Aug 01 15:32:53.885622 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: spawned uWSGI worker 2 (pid: 124527, cores: 1) Aug 01 15:32:53.885936 dv-cinder-847536-3-iscsi devstack@n-api.service[124510]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 15:32:54.570384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:32:54.570991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:32:55.782208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:32:55.782208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: from cryptography.utils import int_from_bytes Aug 01 15:32:55.782981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:32:55.782981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: from cryptography.utils import int_from_bytes Aug 01 15:32:55.800840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:32:55.800840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: from cryptography.utils import int_from_bytes Aug 01 15:32:55.801481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:32:55.801481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: from cryptography.utils import int_from_bytes Aug 01 15:32:58.254546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:32:58.255624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:32:58.256448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:32:58.257082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:32:58.257526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:32:58.257979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.258326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.258662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.258996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.259351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.259669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.260014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.260344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.260687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.260958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.261283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.261619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847536-3-iscsi {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.261981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.262489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.262807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.263325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.263670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.263979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.264473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.264826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.265329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.265653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.266015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.266376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.266699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.267022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.267351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.267669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.268006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.268322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.268739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847536-3-iscsi {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.269341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.269477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.269701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.270194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.270702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.270843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.271154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.271608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.271812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.272150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.272474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.272803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.273141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.273453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.273787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.274130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.274471 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.274783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.275096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.275359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.275672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.276034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.276332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.276667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.276927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.277187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.277518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.277850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.278193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.278514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.278821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.279137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.279454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.279769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.280082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.280390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.280727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.281090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.281419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.281739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.282102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.282523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.282781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.283105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.283464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.283791 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.284109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.284440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.284772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.285087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.285403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.285716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.286083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.286432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.286748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.287005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.287345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.287634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.287963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.288275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.288588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.288900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.289208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.289522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.289832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.290205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.290590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.290797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.291114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.291425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.291739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.292053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.292391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.292724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.293047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.293361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.293695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.294023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.294355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.294670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.294986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.295476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.295954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.296970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.297836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.298682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.299008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.299348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.299828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.300314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.300827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.301300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.301784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.302298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.302622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.302946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.303269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.303588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.303906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.304219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.304590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.304895 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.305330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.305533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.305849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.306815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.306815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.307121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.307256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.307585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.307937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.308282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.308617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.308939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.309268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.309610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.309959 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.310285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.310607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.310933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.311262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.311604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.311930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.312863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.313138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.313460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.313786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.314186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.314500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.314820 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.315171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.315529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.315856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.316190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.316538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.316843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.317194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.317476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.317808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.318186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.318512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.318841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.319163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.319484 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.319799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.320115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.320436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.320792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.321113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.321440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.321779 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.322115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.322432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.322753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.323072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.323386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.323761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.324015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.324342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.324659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.324994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.325336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.325652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.326206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.326664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.327169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.327672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.328160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.328630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.329121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.329615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.329970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.330307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.330634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.330952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.331293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.331614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.331929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.332515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.332840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.333164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.333485 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.333808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.334184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.334516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.334838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.335281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.335527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.335841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.336177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.336510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.336837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.337149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.337473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.337788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.338113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.338433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.338749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.339060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.339375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.339686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.339998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.340307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.340639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.341135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.341557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.341794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.342187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.342407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.342793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.343069 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.343986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.344318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.344723 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.345417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.345735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.345921 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:32:58.346410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.346591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:32:58.346739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.346901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:32:58.347054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.347224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:32:58.347503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.347652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:32:58.347812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.347968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.348112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.348304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.348460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.348604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.348746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.348903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.349057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.349200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.349343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.349494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.349651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.349805 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.349999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.350151 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.350294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.350437 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.350589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.350793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.350949 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.351095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.351237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.351378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847536-3-iscsi {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.351599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.351748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.351908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.352051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.352195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.352349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.352502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.352653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.352909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.354139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.354328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.354486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.354638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.354783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.354953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.354953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.354953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.355369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.356117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.356117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.356447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.356600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.356600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.356884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.357036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.357191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.357334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.357334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.357758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.360014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.360200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.360364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.360364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.360651 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.360857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.361017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.361170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.361170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.361463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.361609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.361609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.361967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.362201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.362436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.362667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.362667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.363108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847536-3-iscsi {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.363275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.363275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.365060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.365206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.365206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.365523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.365687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.365687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.366263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.366416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.366416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.366718 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.366961 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.366961 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.367419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.367566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.367566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.367986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.368140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.368140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.368425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.368569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.368722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.368866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.368866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.369139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.369282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.369433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.369587 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.369587 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.369909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.370062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.370206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.370369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.370513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.370656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.370656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.370985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.371144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.371144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.371427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.371570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.371570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.371868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.372019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.372019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.372313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.372463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.372680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.372828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.372972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.372972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.374768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.374768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.375060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.375227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.375382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.375528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.375677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.375827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.375995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.376264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.376430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.376430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.376716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.377626 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.377812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.378014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.378269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.378419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.378564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.378707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.378849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.379003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.379147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.379147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.379427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.379579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.379579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.379880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.382176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.382176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.382474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.382621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.382775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.382935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.383091 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.383269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.383532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.383692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.383836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.383986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.384141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.384284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.384459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.384615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.384760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.384904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.385054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.385198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.385376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.385522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.385673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.385819 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.386018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.386165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.388596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.388764 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.388997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.389163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.389163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.389477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.389630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.389775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.389937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.390098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.390286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.390460 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.390616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.390768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.390919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.391072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.391282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.391282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.391588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.391732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.391732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.392005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.392216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.392216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.392522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.392682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.392682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.392963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.393118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.393282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.393432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.393708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.393866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.394115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.394296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.394456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.394611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.394611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.394892 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.395044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.395197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.395349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.395492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.395643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.395787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.395787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.396149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.396302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.396453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.396614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.396757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.396909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.397059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.397208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.397358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.397510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.397661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.397816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.397994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.398147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.398292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.398460 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.398813 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.398978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.399163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.399348 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.399533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.399737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.399964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.400185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.400398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.400618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.400833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.401045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.401247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.401474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.401687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.401957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.402165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.402424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.402646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.402849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.403218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.403822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.404066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.404275 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.404538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.404796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.405023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.405242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.405448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.405663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.406398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.406606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.406826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.407052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.407265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.407478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.407683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.407896 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.408113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.408352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.408568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.409042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.409267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.409474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.409806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.410081 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.410442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.410649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.410863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.411070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.411070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.411508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.411740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.411957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.412154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.412329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.412587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.412743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.412894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.413054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.413213 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.413372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.413540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:32:58.413691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.413881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.414206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.414368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.414530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.414688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.414869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.415058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.415221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.415221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.415569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.415753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.415910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.416061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.416232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.416383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.416676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.416891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.417103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.417335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.417516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.417683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.417836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.418012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.418176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.418336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.418506 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.418666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.418824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.418999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.419382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.419537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.419695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.419856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.420007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.420165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.420316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.420468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.420631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.420809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.420961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.421112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.421277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.421497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.422220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.422431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.422651 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.422809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.422961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.423120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.423341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.423558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.423796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.424012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.424353 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.424607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.425000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.425206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.425363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.425514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.425665 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.425824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.426067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.426229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.426392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.426554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.426707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.426707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.427016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.427166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.427323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.427481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.427639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.427803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.427954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.428120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.428271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.428431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.428581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.428740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.428891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.429048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.429226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.429591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.429795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.430037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.430275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.430490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.430490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.430937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.431178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.431178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.431178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.431629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.431780 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.431939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.431939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.432241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.432404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.432576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.432840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.432999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.433158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.433158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.433465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.433465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.433760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.433760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.434117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.434117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.434526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.434683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.434833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.434999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.435196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.435420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.435627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.435820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.435981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.436149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.436309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.436467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.436620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.436620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.436923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.436923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.436923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.437402 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.437565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.437565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.437565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.438329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.438486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.438637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.438788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.438939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.438939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.439243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.439400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.439835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.440005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.440178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.440414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.440735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.440903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.441056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.441222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.441376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.441536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.441695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.441858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.442044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.442211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.442372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.442556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.442713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.442928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.443085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.443085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.443393 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.443546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.443697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.443848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.443848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.444148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.444313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.444313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.444313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.444825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.444985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.445137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.445297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.445457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.445608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.445766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.445942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.446110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.446271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.446430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.446592 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.446750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.446909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.447070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.447228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.447228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.447522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.447674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.447832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.448062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.448222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.448381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.448532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.448702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.449067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.449246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.449400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.449562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.449861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.449861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.450304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.450474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.450630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.450894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.451060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.451060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.451372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.451524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.451683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.451683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.451970 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.452129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.452289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.452571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.452571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.452987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.453153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.453153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.453476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.453637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.453797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.454018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.454018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.454311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.454478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.454478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.454781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.454941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.454941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.455248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.455399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.455824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.456007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.456007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.456305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.456477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.456477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.456772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.456924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.457075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.457478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.457478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.457779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.457966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.457966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.458290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.458448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.458448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.458754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.458913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.458913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.459215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.459380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.459380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.459667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.459836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.460124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.460411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.460411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.460720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.460890 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.460890 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.461299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.461452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.461452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.461761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.461941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.462100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.462263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.462263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.462582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.462734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.462734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.463087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.463244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.463407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.463566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.463717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.463868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.464121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.464278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.464440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.464603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.464762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.464914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.464914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.465199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.465359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.465511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.465661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.465812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.466032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.466185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.466348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.466501 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.466671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.466831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.466990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.467151 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.467312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.467464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.467615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.467775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.467934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.468099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.468257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.468940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.469092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.469318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.469485 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.469655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.469807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.469981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.470256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.470443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.470709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.470878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.471039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.471304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.471463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.471614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.471795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.471956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.472116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.472281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.472433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.472591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.472753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.472912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.472912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.473261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.473425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.473576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.473752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.473947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.474105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.474268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.474418 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.474567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.474727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.474879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.475030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.475030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.475322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.475473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.475637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.475806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.475966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.476125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.476284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.476450 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.476602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.476752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.476902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.477059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.477219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.477379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.477531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.477689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.477928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.478091 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.478269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.478437 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.478598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.478756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.478934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.479109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.479281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.479444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.479605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.479765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.479936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.480090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.480343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.480612 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.480912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.481079 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.481233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.481510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.481677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.481833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.482008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.482174 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.482337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.482503 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.482655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.482806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.482957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.483109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.483329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.483499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.483652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.483803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.484012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.484668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.484830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.485005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.485158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.485310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.485462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.485462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.485759 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.485998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.485998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.485998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.486443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.486596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.486758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.486921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.486921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.487216 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.487369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.487369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.487671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.487830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.487989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.488141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.488292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.488453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.488453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.488740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.488910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.488910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.489208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.489370 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.489530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.489691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.489691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.490034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.490189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.490189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.490484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.490763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.491053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.491226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.491226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.491646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.491812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.491812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.492109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.492261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.492261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.492547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.492547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.492834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.492834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.493151 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.493302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.493302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.493657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.493809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.494091 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.494245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.494245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.494563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.494724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.494724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.495027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.495177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.495177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.495481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.495641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.495794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.495943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.495943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.496228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.496378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.496378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.496681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.496681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.496983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.497134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.497308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.497459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.497459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.497753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.497931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.497931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.498364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.498528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.498689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.498840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.498840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.499140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.499318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.499479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.499667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.499667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.499965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.500125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.500125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.500437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.500605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.500605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.501034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.501312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.501470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.501660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.501932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.502103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.502264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.502502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.502502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.502801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.502960 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.503111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.503379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.503604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.503761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.503912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.504074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.504225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.504376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.504536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.504687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.504892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.505056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.505208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.505369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.505521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.505671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.505828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.506091 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.506257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.506423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.506575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.506734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.506893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.507050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.507201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.507361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.507522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.507681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.507839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.507990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.508150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.508316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.508316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.508612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.508772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.508772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.509081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.509241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.509399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.509551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.509701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.509858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.510152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.510323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.510483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.510637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.510796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.510947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.511251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.511529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.511704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.511865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.512123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.512287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.512448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.512602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.512763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.512914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.513064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.513225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.513387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.513545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.513750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.513927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.514085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.514249 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.514409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.514568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.515667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.515834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.516004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.516167 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.516320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.516481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.516705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.516873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.517035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.517196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.517348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.517448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.517683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.517776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.517871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.517987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.518123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.518261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.518399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.518536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.518675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.518806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.518936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.519064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.519192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.519321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.519466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.519605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.519605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.519850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.519988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.520127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.520265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.520265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.520521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.520652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.520652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.520918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.521053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.521204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.521425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.521425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.521785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.521991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.521991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.522344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.522477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.522477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.522736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.522876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.523015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.523146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.523146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.523405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.523543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.523731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.523874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.523874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.524121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.524259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.524259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.524513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.524794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.524940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.525072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.525072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.525327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.525327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.525580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.525710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.525848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.526006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.526006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.526006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.526391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.526521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.526650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.526789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.526919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.527056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.527185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.527315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.527451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.527590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.527727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.527864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.528012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.528142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.528278 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.528426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.528572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.528710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.528839 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.528967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.529110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.529247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.529378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.529650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.529786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.529995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.530139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.530279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.530419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.530564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.530564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.531364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.531364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.531838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.531838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.532096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.532234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.532234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.532659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.532794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.532924 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.533061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.533190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.533190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.533445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.533575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.533711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.533908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.534053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.534429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.534599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.534877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.535019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.535271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.535416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.535692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.535838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.536100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.536261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.536544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.536694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.536903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.537059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.537284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.537518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.537661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.537994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.538133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.538354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.538499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.538688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.538903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.539046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.539359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.539493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.539687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.540098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.540251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.540391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.540656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.540955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.541135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.541316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.541658 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.541862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.542168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.542354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.542519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.542776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.542926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.543060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.543188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.543318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.543570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.543704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.543920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.544055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.544377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.544531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.544671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.544870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.545038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.545182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.545438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.545576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.545809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.545995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.546171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.546414 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.547094 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.547383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.547580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.547725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.548039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.548182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.548376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.548562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.548704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.549010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.549145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.549345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.549509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.549710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.550259 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.550426 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.550568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.550707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.550838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.551053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.551258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.551394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.551675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.551917 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.552050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:32:58.552317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.552830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.553235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.553625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.554066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.554473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.554866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.555258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.555713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.556038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.556446 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.556849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.557233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.557630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.558044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.558432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.559278 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.559278 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.559546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.560931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.560931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.560931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.561539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.561991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.562373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.562755 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.563142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.563527 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.563912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.564316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.564777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.565134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.565565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.566016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.566426 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.566816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.567256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.567668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.568015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.568784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.568784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.569198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.569946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.569946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.570525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.571078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.571283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.571720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.572181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.572566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.572948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.573355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.573739 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.574178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.574567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.574949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.575345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.575725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.576148 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.576530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.576940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.577341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.577777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.578199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.578587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.578991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.579384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.579775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.580168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.580730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.581186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.581507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.581915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.582710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.583109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.583505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.583840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.584431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.584770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.585097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.585424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.585747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.586097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.586426 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.586746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.587068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.587397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.587898 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.588088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.588430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.588768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.589115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.589440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.589763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.590114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.590438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.590837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.591159 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.591603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.591794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.592117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.592439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.592782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.593100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.593962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.594287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.594651 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.594962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.595284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.595604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.595941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.596283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.596611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.596931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.597251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.597576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.598358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.598559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.598905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.599243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.599686 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.599902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.600225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.600562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.600874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.601183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.601507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.601825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.602162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.602493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.602812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.603133 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.603441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.603760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.610077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.610077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.610077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.610077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.610077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.610077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.610077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.610077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.611153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.611153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.611153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.611153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.611153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.611153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.611153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.611153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.612018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.612018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.612018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.612018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.612018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.612018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.612018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.612775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.612775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.612775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.613109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.613358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.613537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.613846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.614189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.614499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.614813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.615125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.615441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.616940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO dbcounter [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] Registered counter for database nova_api Aug 01 15:32:58.617100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.617100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.617100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.617100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.617100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.617734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.617734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.619026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.619026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.619026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.619026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.619667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.619982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.620309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.620788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.621133 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.621458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.621775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.622118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.622454 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.622775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.623096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.623433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.623728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.624048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.624371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.624723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.625046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.625393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.625682 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.626029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.626342 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.626664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.626979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.627302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.627660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.627988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.628312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.628668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.628963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.629285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.629601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.629935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.630250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.630571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.630911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.631238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.631633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.633068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.633068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.633068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.633491 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.633796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.633978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.634274 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.634600 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.634927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.635247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.635596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.635999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.636340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.636809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.636984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.637155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_db.sqlalchemy.engines [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:32:58.637344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.637632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.638158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.638322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.638613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.639411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.639411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.639693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.639939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.640957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.640957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.641221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.641430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.641767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.642026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.642310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.642607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.642918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.643229 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.643546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.643858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.644165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.644404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writer thread running {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:32:58.644553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.644821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.645097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.645396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.645714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.646075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.646408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.646730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.647063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.647386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.647715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.648095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.648364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.648688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.649123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.649325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.649953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.650279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.650600 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.650921 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.651240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.651584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.651913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.652284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.652568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.652868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.653192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.653518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.653983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.654236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.654552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.654866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.655179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.655493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.656343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.656728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.657045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.657399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.657730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.658073 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.658411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.658751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.659067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.659537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.659862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.660208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.660541 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.660992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.661567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.661929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.662256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.662698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:32:58.662928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:32:58.701851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.context [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),67c0a4a7-1fcd-43c5-96b9-b81917d6c715(cell1) {{(pid=124526) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:32:58.709578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:58.709840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:58.710516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:58.713278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:58.715511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO dbcounter [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] Registered counter for database nova_cell0 Aug 01 15:32:58.721005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO dbcounter [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] Registered counter for database nova_cell1 Aug 01 15:32:58.727737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO dbcounter [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] Registered counter for database nova_api Aug 01 15:32:58.728962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_db.sqlalchemy.engines [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:32:58.730420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_db.sqlalchemy.engines [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:32:58.735248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writer thread running {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:32:58.750234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_db.sqlalchemy.engines [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:32:58.758219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writer thread running {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:32:58.815774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.context [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),67c0a4a7-1fcd-43c5-96b9-b81917d6c715(cell1) {{(pid=124527) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:32:58.819883 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:58.821671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:58.822537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:58.824589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:58.826627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO dbcounter [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] Registered counter for database nova_cell0 Aug 01 15:32:58.831440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO dbcounter [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] Registered counter for database nova_cell1 Aug 01 15:32:58.839288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_db.sqlalchemy.engines [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:32:58.840617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_db.sqlalchemy.engines [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:32:58.848630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writer thread running {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:32:58.848981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writer thread running {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:32:58.884621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writer thread running {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:32:58.894982 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO dbcounter [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] Registered counter for database nova_cell0 Aug 01 15:32:58.903011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_db.sqlalchemy.engines [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:32:58.910770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writer thread running {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:32:59.002312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO dbcounter [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] Registered counter for database nova_cell0 Aug 01 15:32:59.011498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_db.sqlalchemy.engines [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:32:59.020096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writer thread running {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:32:59.279285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: WARNING keystonemiddleware.auth_token [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:32:59.287979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: WARNING keystonemiddleware.auth_token [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:32:59.383569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: WARNING keystonemiddleware.auth_token [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:32:59.391292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: WARNING keystonemiddleware.auth_token [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:32:59.652456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: WARNING keystonemiddleware.auth_token [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:32:59.660344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: WARNING keystonemiddleware.auth_token [None req-0bdd49b4-1e62-47f1-9644-925b0969675f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:32:59.666858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a671709c0 pid: 124526 (default app) Aug 01 15:32:59.744211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: WARNING keystonemiddleware.auth_token [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:32:59.750442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: WARNING keystonemiddleware.auth_token [None req-81031065-8a69-42c0-98d8-c8044f08bbb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:32:59.756035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a671709c0 pid: 124527 (default app) Aug 01 15:33:42.187255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=3 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:42.188410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=3 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:42.189430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=3 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:42.190201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=3 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:43.502531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c5d1db64-0c90-4d45-8e03-9f835a91ed7a tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Action: 'create', calling method: .version_select at 0x7feb180a9f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-162306562"}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:46.045465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c5d1db64-0c90-4d45-8e03-9f835a91ed7a tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.873193 Aug 01 15:33:46.063106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1/1] 10.222.0.83 () {60 vars in 1155 bytes} [Mon Aug 1 15:33:42 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3894 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 15:33:46.757974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b0262549-29d9-4b95-9bd2-1395543b573c tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb18183a60>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:46.812386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=3 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:46.813978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=3 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:46.815357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=3 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:46.816550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=3 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:47.775366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b0262549-29d9-4b95-9bd2-1395543b573c tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831" status: 200 len: 345 microversion: 2.1 time: 1.711584 Aug 01 15:33:47.776396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1/2] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 15:33:46 2022] GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831 => generated 345 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:47.792319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0b2b2809-2029-4ee1-8cc9-15f9a01600ae tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Action: 'create', calling method: .version_select at 0x7feb17f27d30>, body: {"snapshot": {"volume_id": "4ab31349-7a89-4f86-a58c-d79abd823831", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1548943902"}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:48.242626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0b2b2809-2029-4ee1-8cc9-15f9a01600ae tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.455187 Aug 01 15:33:48.243711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2/3] 10.222.0.83 () {60 vars in 1162 bytes} [Mon Aug 1 15:33:47 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:48.263240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-46af37eb-b1d6-4639-a000-0ab1a218fbb8 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17fd6dc0>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:48.334177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-46af37eb-b1d6-4639-a000-0ab1a218fbb8 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a" status: 200 len: 287 microversion: 2.1 time: 0.078596 Aug 01 15:33:48.339033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 2/4] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 1 15:33:48 2022] GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:48.361290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-36339d4c-0288-4cf1-8ab7-bca850bfbada tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f3bee0>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:48.642672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-36339d4c-0288-4cf1-8ab7-bca850bfbada tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.289168 Aug 01 15:33:48.643618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 3/5] 10.222.0.83 () {58 vars in 1140 bytes} [Mon Aug 1 15:33:48 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:48.662656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6b3ca23f-107a-4327-8656-26933a170455 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17fd6a60>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:48.722616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6b3ca23f-107a-4327-8656-26933a170455 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a" status: 200 len: 287 microversion: 2.1 time: 0.065382 Aug 01 15:33:48.723829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 3/6] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 1 15:33:48 2022] GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:49.741734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1603e1c0-b539-42d6-8ffd-0282478dd5cb tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f3bb80>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:50.127866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1603e1c0-b539-42d6-8ffd-0282478dd5cb tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a" status: 200 len: 287 microversion: 2.1 time: 0.393197 Aug 01 15:33:50.134307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 4/7] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 1 15:33:49 2022] GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a => generated 287 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:51.141650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-86049177-a867-4877-8f86-1c404edd6b72 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f1f5e0>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:51.227925 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-86049177-a867-4877-8f86-1c404edd6b72 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a" status: 200 len: 287 microversion: 2.1 time: 0.090798 Aug 01 15:33:51.228912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 4/8] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 1 15:33:51 2022] GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:52.245214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-076d7b57-5131-498c-9f32-5626d72ef562 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f3b430>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:52.315028 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-076d7b57-5131-498c-9f32-5626d72ef562 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a" status: 200 len: 288 microversion: 2.1 time: 0.077650 Aug 01 15:33:52.315765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 5/9] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 1 15:33:52 2022] GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a => generated 288 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:33:52.327976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8aba816d-a58f-4408-8ba9-a11f7cbb848c tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f1fca0>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:52.444170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8aba816d-a58f-4408-8ba9-a11f7cbb848c tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "DELETE /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a" status: 202 len: 0 microversion: 2.1 time: 0.120982 Aug 01 15:33:52.444754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 5/10] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 1 15:33:52 2022] DELETE /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:33:52.454274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d14aebb4-6266-41c9-b4b2-eff494f14586 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f27e50>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:52.547746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d14aebb4-6266-41c9-b4b2-eff494f14586 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a" status: 200 len: 287 microversion: 2.1 time: 0.098402 Aug 01 15:33:52.553152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 6/11] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 1 15:33:52 2022] GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:53.561239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-898f1fd5-2ea8-4a5f-a986-4b7861e0999c tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f2c3a0>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:53.607204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-898f1fd5-2ea8-4a5f-a986-4b7861e0999c tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] HTTP exception thrown: Snapshot 41482cae-f040-4595-90fd-f73685da194a could not be found. Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-898f1fd5-2ea8-4a5f-a986-4b7861e0999c tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Request method failure captured: Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a HTTP/1.1 Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_JWvJxizAwIGE5RVNYa1lPmtmUW0gwOqqf_0rvWMU6QQld2O3WSMRTd9dwKKnHhwCnKRHNywtJXhKG0WzbJK5A1teB6suexXaUX7z02X33uKDqpM26_TJVpFENvHfu8JroaAaDQvfkgQTUA1_RMYgIjEv00dAgt2voV_o3ATauhPPc Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 3904f939fbfb43c280dd8e547f3d4604 Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1176162376 Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:33:53.612311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3904f939fbfb43c280dd8e547f3d4604"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3904f939fbfb43c280dd8e547f3d4604"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3904f939fbfb43c280dd8e547f3d4604"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3904f939fbfb43c280dd8e547f3d4604"}]}] Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1176162376 Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 3904f939fbfb43c280dd8e547f3d4604 Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1176162376 Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-VolumesSnapshotsTestJSON-1176162376-project Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 3bd2843f2b2a4aaeb39b9dd10b32351a Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1176162376-project Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Snapshot 41482cae-f040-4595-90fd-f73685da194a could not be found. Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '41482cae-f040-4595-90fd-f73685da194a'} Aug 01 15:33:53.613494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 41482cae-f040-4595-90fd-f73685da194a could not be found. (HTTP 404) (Request-ID: req-300f56f0-36b3-4c1b-a9f3-8e1540e012f8) Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:53.614240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:33:53.615298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 41482cae-f040-4595-90fd-f73685da194a could not be found. Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 15:33:53.616277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:33:53.617257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 41482cae-f040-4595-90fd-f73685da194a could not be found. Aug 01 15:33:53.617257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:53.617257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:53.617257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:53.617257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:53.617257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:53.617257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:53.617257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:33:53.617257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:33:53.617257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 41482cae-f040-4595-90fd-f73685da194a could not be found. Aug 01 15:33:53.617257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:53.619749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-898f1fd5-2ea8-4a5f-a986-4b7861e0999c tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Returning 404 to user: Snapshot 41482cae-f040-4595-90fd-f73685da194a could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:33:53.620836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-898f1fd5-2ea8-4a5f-a986-4b7861e0999c tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a" status: 404 len: 111 microversion: 2.1 time: 0.063790 Aug 01 15:33:53.626349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 6/12] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 1 15:33:53 2022] GET /compute/v2.1/os-snapshots/41482cae-f040-4595-90fd-f73685da194a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:33:53.635025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-48f2ebc9-593f-482c-9a8c-bb8de808d2ab tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f27dc0>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:53.834393 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-48f2ebc9-593f-482c-9a8c-bb8de808d2ab tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831" status: 202 len: 0 microversion: 2.1 time: 0.203362 Aug 01 15:33:53.838685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 7/13] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 1 15:33:53 2022] DELETE /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:33:53.844811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cf036b6e-23a8-4e20-b9e8-d61f5391984e tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f07700>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:53.981415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cf036b6e-23a8-4e20-b9e8-d61f5391984e tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831" status: 200 len: 344 microversion: 2.1 time: 0.141172 Aug 01 15:33:53.982608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 7/14] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 15:33:53 2022] GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:54.995774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-60b9448c-c6b9-4b6b-8f91-6d05e021c86f tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f3b5e0>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:55.139695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-60b9448c-c6b9-4b6b-8f91-6d05e021c86f tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831" status: 200 len: 344 microversion: 2.1 time: 0.147223 Aug 01 15:33:55.141620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 8/15] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 15:33:54 2022] GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:56.160565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9acdbeda-ee25-455a-9447-bafdaf5f0092 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f07160>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:56.340894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9acdbeda-ee25-455a-9447-bafdaf5f0092 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831" status: 200 len: 344 microversion: 2.1 time: 0.187875 Aug 01 15:33:56.341702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 8/16] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 15:33:56 2022] GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:57.365999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2b4e2878-c3d4-4a2a-9e3f-71f2655969d2 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f3bdc0>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:57.450614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-2b4e2878-c3d4-4a2a-9e3f-71f2655969d2 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] HTTP exception thrown: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2b4e2878-c3d4-4a2a-9e3f-71f2655969d2 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Request method failure captured: Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831 HTTP/1.1 Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_JWvJxizAwIGE5RVNYa1lPmtmUW0gwOqqf_0rvWMU6QQld2O3WSMRTd9dwKKnHhwCnKRHNywtJXhKG0WzbJK5A1teB6suexXaUX7z02X33uKDqpM26_TJVpFENvHfu8JroaAaDQvfkgQTUA1_RMYgIjEv00dAgt2voV_o3ATauhPPc Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 3904f939fbfb43c280dd8e547f3d4604 Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1176162376 Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 15:33:57.476430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3904f939fbfb43c280dd8e547f3d4604"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3904f939fbfb43c280dd8e547f3d4604"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3904f939fbfb43c280dd8e547f3d4604"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3904f939fbfb43c280dd8e547f3d4604"}]}] Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1176162376 Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 3904f939fbfb43c280dd8e547f3d4604 Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1176162376 Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-VolumesSnapshotsTestJSON-1176162376-project Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: 3bd2843f2b2a4aaeb39b9dd10b32351a Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1176162376-project Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': '4ab31349-7a89-4f86-a58c-d79abd823831'} Aug 01 15:33:57.478509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. (HTTP 404) (Request-ID: req-58bf3fb5-09ee-4bbc-9db8-53335a9b8971) Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:57.479273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:33:57.480224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:33:57.481214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:33:57.482368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.482368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.482368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:57.482368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.482368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:57.482368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:57.482368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:57.482368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:33:57.482368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:33:57.482368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.482368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.483800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2b4e2878-c3d4-4a2a-9e3f-71f2655969d2 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Returning 404 to user: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:33:57.486964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2b4e2878-c3d4-4a2a-9e3f-71f2655969d2 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831" status: 404 len: 109 microversion: 2.1 time: 0.134040 Aug 01 15:33:57.488623 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 9/17] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 15:33:57 2022] GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:33:57.505217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1557bb42-82c6-4dc2-837f-3dd65ed36526 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f075e0>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:57.591455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-1557bb42-82c6-4dc2-837f-3dd65ed36526 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] HTTP exception thrown: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1557bb42-82c6-4dc2-837f-3dd65ed36526 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Request method failure captured: Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: DELETE /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831 HTTP/1.1 Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_JWvJxizAwIGE5RVNYa1lPmtmUW0gwOqqf_0rvWMU6QQld2O3WSMRTd9dwKKnHhwCnKRHNywtJXhKG0WzbJK5A1teB6suexXaUX7z02X33uKDqpM26_TJVpFENvHfu8JroaAaDQvfkgQTUA1_RMYgIjEv00dAgt2voV_o3ATauhPPc Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 3904f939fbfb43c280dd8e547f3d4604 Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1176162376 Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:33:57.594539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3904f939fbfb43c280dd8e547f3d4604"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3904f939fbfb43c280dd8e547f3d4604"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3904f939fbfb43c280dd8e547f3d4604"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3904f939fbfb43c280dd8e547f3d4604"}]}] Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1176162376 Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 3904f939fbfb43c280dd8e547f3d4604 Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1176162376 Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-VolumesSnapshotsTestJSON-1176162376-project Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 3bd2843f2b2a4aaeb39b9dd10b32351a Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1176162376-project Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '4ab31349-7a89-4f86-a58c-d79abd823831'} Aug 01 15:33:57.595973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. (HTTP 404) (Request-ID: req-0420ca0d-def6-41b5-ab79-fcf32c61a2f9) Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:57.596771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:33:57.598012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 15:33:57.599236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:33:57.600379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.600379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.600379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:57.600379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.600379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:57.600379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:57.600379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:57.600379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:33:57.600379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:33:57.600379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.600379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.602011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1557bb42-82c6-4dc2-837f-3dd65ed36526 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Returning 404 to user: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:33:57.603117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1557bb42-82c6-4dc2-837f-3dd65ed36526 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831" status: 404 len: 109 microversion: 2.1 time: 0.104852 Aug 01 15:33:57.607278 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 9/18] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 1 15:33:57 2022] DELETE /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:33:57.613821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-75653a37-09fc-4e9a-849f-b8f07e751749 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Calling method '.version_select at 0x7feb17f40790>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:57.664557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-75653a37-09fc-4e9a-849f-b8f07e751749 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] HTTP exception thrown: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-75653a37-09fc-4e9a-849f-b8f07e751749 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Request method failure captured: Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831 HTTP/1.1 Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_JWvJxizAwIGE5RVNYa1lPmtmUW0gwOqqf_0rvWMU6QQld2O3WSMRTd9dwKKnHhwCnKRHNywtJXhKG0WzbJK5A1teB6suexXaUX7z02X33uKDqpM26_TJVpFENvHfu8JroaAaDQvfkgQTUA1_RMYgIjEv00dAgt2voV_o3ATauhPPc Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 3904f939fbfb43c280dd8e547f3d4604 Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1176162376 Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 15:33:57.669199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3904f939fbfb43c280dd8e547f3d4604"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3904f939fbfb43c280dd8e547f3d4604"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3904f939fbfb43c280dd8e547f3d4604"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3904f939fbfb43c280dd8e547f3d4604"}]}] Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1176162376 Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 3904f939fbfb43c280dd8e547f3d4604 Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1176162376 Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-VolumesSnapshotsTestJSON-1176162376-project Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: 3bd2843f2b2a4aaeb39b9dd10b32351a Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1176162376-project Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': '4ab31349-7a89-4f86-a58c-d79abd823831'} Aug 01 15:33:57.670657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. (HTTP 404) (Request-ID: req-de8d58a7-0a62-46d0-b561-c68d30e9241f) Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:57.671664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:33:57.672831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:33:57.674679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:33:57.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:57.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:57.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:57.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:57.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:33:57.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:33:57.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. Aug 01 15:33:57.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:33:57.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-75653a37-09fc-4e9a-849f-b8f07e751749 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] Returning 404 to user: Volume 4ab31349-7a89-4f86-a58c-d79abd823831 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:33:57.677629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-75653a37-09fc-4e9a-849f-b8f07e751749 tempest-VolumesSnapshotsTestJSON-1176162376 tempest-VolumesSnapshotsTestJSON-1176162376-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831" status: 404 len: 109 microversion: 2.1 time: 0.068574 Aug 01 15:33:57.678723 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 10/19] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 15:33:57 2022] GET /compute/v2.1/os-volumes/4ab31349-7a89-4f86-a58c-d79abd823831 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:33:58.829252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a5118f4a-b1a6-4bfe-9432-dbbccf81c740 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Action: 'create', calling method: .version_select at 0x7feb1877b8b0>, body: {"keypair": {"name": "tempest-keypair-1801485675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1maxWkhD+jDSbvUuyRq8xn3YJKtDdCiq/Wp89LUEz1QzPkPuF5+We+5J9nDW6JaDL+fVln2ShMr7bOf+RU3bjqF/V2EhrYsJaajpd7HbeOyK/7Ehfx9cFr1RJM3fMjUA=="}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:59.039701 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-a5118f4a-b1a6-4bfe-9432-dbbccf81c740 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Getting quotas for project 85354737a87146729a06bf22ddb3fefc. Resources: {'key_pairs'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:33:59.057601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-a5118f4a-b1a6-4bfe-9432-dbbccf81c740 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Getting quotas for user ba149d1623e849328e399d6dbdca3e0c and project 85354737a87146729a06bf22ddb3fefc. Resources: {'key_pairs'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:33:59.197246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a5118f4a-b1a6-4bfe-9432-dbbccf81c740 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.688517 Aug 01 15:33:59.202307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 10/20] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 1 15:33:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:01.507672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1960985970", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "networks": [{"uuid": "ab383535-3fcd-49d7-9325-5e27b628d50b"}]}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:01.785551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.network.neutron [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] validate_networks() for [('ab383535-3fcd-49d7-9325-5e27b628d50b', None, None, None, None, None)] {{(pid=124526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:34:03.560164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e37c536b-1141-47ce-bad5-7c348305911e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Action: 'create', calling method: .version_select at 0x7feb17e7f1f0>, body: {"keypair": {"name": "tempest-keypair-1926280563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0sluheQVsHQSD8hZ4X+7oeI4JW53eftu2ePZuAvMiPsw7Lt1UMQ42DscCM4vAXS4X5NCi+7FWNjgo6GkEeZq7i9QXO/zDpisjRtUoG9wmnTmf9AeciV+aPkp3YUiJdjw=="}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:03.606224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-e37c536b-1141-47ce-bad5-7c348305911e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Getting quotas for project e829698141514a009e2e769854fe66f0. Resources: {'key_pairs'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:34:03.623220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-e37c536b-1141-47ce-bad5-7c348305911e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Getting quotas for user 7d1b6c388c7642a892c905d16f3b8d50 and project e829698141514a009e2e769854fe66f0. Resources: {'key_pairs'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:34:03.689099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e37c536b-1141-47ce-bad5-7c348305911e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.887856 Aug 01 15:34:03.690365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 11/21] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 1 15:34:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 890 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 15:34:05.505140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Flavor limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:34:05.506209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Image limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:34:05.506209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Flavor pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:34:05.506516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Image pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:34:05.506807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:34:05.589023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:05.590898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:05.612136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:05.612768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:05.798638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Getting quotas for project db84eff445df4738a5fccb348fe9afeb. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:34:05.823298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Getting quotas for user c07d9c30b18a4150aa0bc7a1705551d7 and project db84eff445df4738a5fccb348fe9afeb. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:34:05.868341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Going to run 1 instances... {{(pid=124526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:34:05.885456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:34:06.175332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0af3e427-f54c-4079-bb2f-6ba6ebb098d2 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.030046 Aug 01 15:34:06.176007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 11/22] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:34:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 5032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:34:06.189398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8e3152c4-767e-45ea-823f-ab5d8459eec5 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:06.190301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8e3152c4-767e-45ea-823f-ab5d8459eec5 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:06.564055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2044358119", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72e7acde-0e4d-40e2-93ad-82a4bd465289"}], "security_groups": [{"name": "tempest-securitygroup--915391680"}], "key_name": "tempest-keypair-1801485675", "user_data": "}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:06.593536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8e3152c4-767e-45ea-823f-ab5d8459eec5 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:06.663761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8e3152c4-767e-45ea-823f-ab5d8459eec5 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1215 microversion: 2.1 time: 0.478160 Aug 01 15:34:06.664359 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 12/23] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:06 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1215 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:06.919335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.network.neutron [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] validate_networks() for [('72e7acde-0e4d-40e2-93ad-82a4bd465289', None, None, None, None, None)] {{(pid=124526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:34:07.691069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5ab253b8-8cc8-467c-b7fb-f70ff5b221b1 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:07.692324 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5ab253b8-8cc8-467c-b7fb-f70ff5b221b1 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:08.000067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5ab253b8-8cc8-467c-b7fb-f70ff5b221b1 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:08.023834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5ab253b8-8cc8-467c-b7fb-f70ff5b221b1 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1215 microversion: 2.1 time: 0.341465 Aug 01 15:34:08.026420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 13/24] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:07 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1215 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:09.046428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-644d06a1-5e70-4f27-9265-9b98e9de477c tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:09.047114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-644d06a1-5e70-4f27-9265-9b98e9de477c tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:09.084612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Flavor limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:34:09.085258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Image limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:34:09.085624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Flavor pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:34:09.086075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Image pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:34:09.086577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:34:09.114178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:09.116106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:09.120176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:09.125204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:09.250899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Getting quotas for project 85354737a87146729a06bf22ddb3fefc. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:34:09.277486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Getting quotas for user ba149d1623e849328e399d6dbdca3e0c and project 85354737a87146729a06bf22ddb3fefc. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:34:09.294165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Going to run 1 instances... {{(pid=124526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:34:09.297362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:34:09.419750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9aa2d3d5-e2fb-4642-9398-687f9106db8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.859915 Aug 01 15:34:09.431380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 12/25] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:34:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 2873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 15:34:09.450154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-18518df1-7cc3-4bb9-9faa-90d58bdb66ea tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:09.453574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-18518df1-7cc3-4bb9-9faa-90d58bdb66ea tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:09.585284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-644d06a1-5e70-4f27-9265-9b98e9de477c tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:09.595027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-644d06a1-5e70-4f27-9265-9b98e9de477c tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1215 microversion: 2.1 time: 0.552423 Aug 01 15:34:09.595625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 14/26] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:09 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1215 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:09.691581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-18518df1-7cc3-4bb9-9faa-90d58bdb66ea tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:09.746034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-18518df1-7cc3-4bb9-9faa-90d58bdb66ea tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1238 microversion: 2.1 time: 0.310387 Aug 01 15:34:09.761064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 13/27] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:09 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1238 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:10.647447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ee534467-7e56-4283-baeb-ed608f8f345a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:10.648240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ee534467-7e56-4283-baeb-ed608f8f345a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:10.662495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee534467-7e56-4283-baeb-ed608f8f345a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:10.667643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee534467-7e56-4283-baeb-ed608f8f345a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:10.668873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee534467-7e56-4283-baeb-ed608f8f345a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:10.671804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee534467-7e56-4283-baeb-ed608f8f345a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:11.111235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c0c7673e-f498-4aa4-8df6-dfcf59b9542e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Action: 'create', calling method: .version_select at 0x7feb175f6700>, body: {"keypair": {"name": "tempest-keypair-1148462189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwbvAwrhAalIR1gdD/nb1Bg5o/K45q7Qp09AcAa/IfZ5XGZRRqDtXw/cpQYA/XINhk5OqbDAq5G1bYaPGhk+PlZnAVUXfFkn7+BY5gY4iwWI9w6M2e8NKmGO0e4ACk2GQ=="}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:11.179384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-c0c7673e-f498-4aa4-8df6-dfcf59b9542e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'key_pairs'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:34:11.193926 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-c0c7673e-f498-4aa4-8df6-dfcf59b9542e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for user 4001e8ec57b34f57aae1654fad9217f8 and project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'key_pairs'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:34:11.250569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c0c7673e-f498-4aa4-8df6-dfcf59b9542e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.079147 Aug 01 15:34:11.252362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 15/28] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 1 15:34:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:11.258283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a1b397ad-49d6-4a19-82d5-692e687d5b74 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:11.259312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a1b397ad-49d6-4a19-82d5-692e687d5b74 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:11.673572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ee534467-7e56-4283-baeb-ed608f8f345a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:11.715738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ee534467-7e56-4283-baeb-ed608f8f345a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1267 microversion: 2.1 time: 1.072454 Aug 01 15:34:11.721984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 14/29] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:10 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1267 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:34:11.729005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-245272603", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51905392-82b2-4ec8-99b5-dedbdeb4aa80"}], "security_groups": [{"name": "tempest-securitygroup--1999862871"}], "key_name": "tempest-keypair-1926280563", "user_data": "}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:11.915947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a1b397ad-49d6-4a19-82d5-692e687d5b74 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:11.944714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a1b397ad-49d6-4a19-82d5-692e687d5b74 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1238 microversion: 2.1 time: 0.690891 Aug 01 15:34:11.948541 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 16/30] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:11 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1238 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:12.703690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.network.neutron [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] validate_networks() for [('51905392-82b2-4ec8-99b5-dedbdeb4aa80', None, None, None, None, None)] {{(pid=124526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:34:12.748499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-55714eeb-7b5c-4cbf-bf0b-23712be9ff0b tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:12.750102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-55714eeb-7b5c-4cbf-bf0b-23712be9ff0b tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:12.772911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-55714eeb-7b5c-4cbf-bf0b-23712be9ff0b tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:12.777123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-55714eeb-7b5c-4cbf-bf0b-23712be9ff0b tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:12.778402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-55714eeb-7b5c-4cbf-bf0b-23712be9ff0b tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:12.782218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-55714eeb-7b5c-4cbf-bf0b-23712be9ff0b tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:13.241926 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-55714eeb-7b5c-4cbf-bf0b-23712be9ff0b tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:13.283733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-55714eeb-7b5c-4cbf-bf0b-23712be9ff0b tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1273 microversion: 2.1 time: 0.540419 Aug 01 15:34:13.296215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 17/31] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:12 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1273 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:13.311574 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e29aca1e-f5fd-43af-b4eb-4b75896ca785 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:13.316285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e29aca1e-f5fd-43af-b4eb-4b75896ca785 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:13.354267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e29aca1e-f5fd-43af-b4eb-4b75896ca785 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:13.354724 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e29aca1e-f5fd-43af-b4eb-4b75896ca785 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:13.355657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e29aca1e-f5fd-43af-b4eb-4b75896ca785 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:13.356102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e29aca1e-f5fd-43af-b4eb-4b75896ca785 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:13.811868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e29aca1e-f5fd-43af-b4eb-4b75896ca785 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:13.828113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e29aca1e-f5fd-43af-b4eb-4b75896ca785 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1296 microversion: 2.1 time: 0.530103 Aug 01 15:34:13.847019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 18/32] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:13 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1296 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:14.324704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cf61fbe3-4a52-487e-9cfd-c7dcbc838fb4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:14.325778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cf61fbe3-4a52-487e-9cfd-c7dcbc838fb4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:14.344060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf61fbe3-4a52-487e-9cfd-c7dcbc838fb4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:14.344994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf61fbe3-4a52-487e-9cfd-c7dcbc838fb4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:14.347045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf61fbe3-4a52-487e-9cfd-c7dcbc838fb4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:14.355306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf61fbe3-4a52-487e-9cfd-c7dcbc838fb4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:15.803081 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cf61fbe3-4a52-487e-9cfd-c7dcbc838fb4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:15.832395 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cf61fbe3-4a52-487e-9cfd-c7dcbc838fb4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 1.511731 Aug 01 15:34:15.863177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 19/33] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:14 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:16.554461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-344135128", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:16.826388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.network.neutron [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] validate_networks() for [('ac89fec2-a975-42c8-b198-9fd04c31bc1f', None, None, None, None, None)] {{(pid=124527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:34:17.500360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Flavor limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:34:17.501043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Image limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:34:17.501458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Flavor pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:34:17.501954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Image pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:34:17.502419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:34:17.521798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:17.526815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:17.529173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:17.530743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:17.631542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Getting quotas for project e829698141514a009e2e769854fe66f0. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:34:17.673075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Getting quotas for user 7d1b6c388c7642a892c905d16f3b8d50 and project e829698141514a009e2e769854fe66f0. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:34:17.778621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Going to run 1 instances... {{(pid=124526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:34:17.789214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:34:17.992086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6e72c966-83b9-4de5-b5ec-f109c93a1da2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.263756 Aug 01 15:34:17.995367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 15/34] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 1 15:34:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 6272 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 15:34:18.060279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-43d6f598-cb86-49c9-bb38-4cc3f2e83b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:18.061763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-43d6f598-cb86-49c9-bb38-4cc3f2e83b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:18.119285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43d6f598-cb86-49c9-bb38-4cc3f2e83b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:18.120287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43d6f598-cb86-49c9-bb38-4cc3f2e83b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:18.131385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43d6f598-cb86-49c9-bb38-4cc3f2e83b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:18.134434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43d6f598-cb86-49c9-bb38-4cc3f2e83b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:18.618382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-43d6f598-cb86-49c9-bb38-4cc3f2e83b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:18.660207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-43d6f598-cb86-49c9-bb38-4cc3f2e83b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1296 microversion: 2.1 time: 0.657867 Aug 01 15:34:18.666397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 16/35] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:17 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1296 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:18.686429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-357796fd-533b-4710-bb2b-819fcce4ec72 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:18.690451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-357796fd-533b-4710-bb2b-819fcce4ec72 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:18.712864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-357796fd-533b-4710-bb2b-819fcce4ec72 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:18.713721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-357796fd-533b-4710-bb2b-819fcce4ec72 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:18.715364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-357796fd-533b-4710-bb2b-819fcce4ec72 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:18.718593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-357796fd-533b-4710-bb2b-819fcce4ec72 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:19.875421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-357796fd-533b-4710-bb2b-819fcce4ec72 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:19.901928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-357796fd-533b-4710-bb2b-819fcce4ec72 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 1.223842 Aug 01 15:34:19.904952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 17/36] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:18 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:19.959001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d3163012-2209-49d8-b1a9-f37b0341f22e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:19.962132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d3163012-2209-49d8-b1a9-f37b0341f22e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:20.013255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3163012-2209-49d8-b1a9-f37b0341f22e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:20.014403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3163012-2209-49d8-b1a9-f37b0341f22e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:20.016795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3163012-2209-49d8-b1a9-f37b0341f22e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:20.020608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3163012-2209-49d8-b1a9-f37b0341f22e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:20.560166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d3163012-2209-49d8-b1a9-f37b0341f22e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:20.616149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d3163012-2209-49d8-b1a9-f37b0341f22e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:20.619910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d3163012-2209-49d8-b1a9-f37b0341f22e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:20.626471 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d3163012-2209-49d8-b1a9-f37b0341f22e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1285 microversion: 2.20 time: 0.686157 Aug 01 15:34:20.627331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 18/37] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1285 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:20.643837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2ba0f3f3-7106-4cf2-a980-cd1c3928a18d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:20.645021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2ba0f3f3-7106-4cf2-a980-cd1c3928a18d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:20.662322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ba0f3f3-7106-4cf2-a980-cd1c3928a18d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:20.663431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ba0f3f3-7106-4cf2-a980-cd1c3928a18d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:20.665020 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ba0f3f3-7106-4cf2-a980-cd1c3928a18d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:20.666476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ba0f3f3-7106-4cf2-a980-cd1c3928a18d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:21.335450 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2ba0f3f3-7106-4cf2-a980-cd1c3928a18d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:21.353185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2ba0f3f3-7106-4cf2-a980-cd1c3928a18d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1363 microversion: 2.1 time: 0.718521 Aug 01 15:34:21.367199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 19/38] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:20 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1363 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:21.383072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8e3735c5-c389-4b4c-81fb-0b89b8707687 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:21.385206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8e3735c5-c389-4b4c-81fb-0b89b8707687 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:21.398097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e3735c5-c389-4b4c-81fb-0b89b8707687 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:21.400407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e3735c5-c389-4b4c-81fb-0b89b8707687 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:21.402196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e3735c5-c389-4b4c-81fb-0b89b8707687 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:21.403545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e3735c5-c389-4b4c-81fb-0b89b8707687 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:21.418703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Flavor limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:34:21.419379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Image limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:34:21.419379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Flavor pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:34:21.419734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Image pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:34:21.421215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:34:21.437058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:21.437906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:21.439012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:21.439823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:21.471080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Getting quotas for project 2d49f0b3378c42ada96c61586a38136e. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:34:21.476476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Getting quotas for user 5f0b12ba782244d7b44783c3f3532bfa and project 2d49f0b3378c42ada96c61586a38136e. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:34:21.500576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Going to run 1 instances... {{(pid=124527) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:34:21.505830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:34:21.804053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-71e5e76b-48e4-4d7a-a362-4e1a2a4ca5f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.938713 Aug 01 15:34:21.804974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 20/39] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:34:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 5941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:34:21.833251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1858898807", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f1bed6a-c264-454e-855c-f998e359854d"}], "security_groups": [{"name": "tempest-securitygroup--492333627"}], "key_name": "tempest-keypair-1148462189", "user_data": "}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:21.861613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8e3735c5-c389-4b4c-81fb-0b89b8707687 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:21.874142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8e3735c5-c389-4b4c-81fb-0b89b8707687 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 0.504538 Aug 01 15:34:21.875443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 20/40] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:21 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:22.530657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-85e55ef5-e69c-4da0-b9eb-8f97ad7ac240 req-14896388-e3d4-46be-8f21-eab043a9ef18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae", "tag": "cde27741-df9b-464c-a305-158d6606aed8"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:22.545434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=9 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:22.580131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-85e55ef5-e69c-4da0-b9eb-8f97ad7ac240 req-14896388-e3d4-46be-8f21-eab043a9ef18 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:22.581973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-85e55ef5-e69c-4da0-b9eb-8f97ad7ac240 req-14896388-e3d4-46be-8f21-eab043a9ef18 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:22.665679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-85e55ef5-e69c-4da0-b9eb-8f97ad7ac240 req-14896388-e3d4-46be-8f21-eab043a9ef18 service nova] Creating event network-changed:cde27741-df9b-464c-a305-158d6606aed8 for instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae on hv-cinder-84753 Aug 01 15:34:22.666979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-85e55ef5-e69c-4da0-b9eb-8f97ad7ac240 req-14896388-e3d4-46be-8f21-eab043a9ef18 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124526) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 15:34:22.672864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af1d3993-38c5-461b-a45d-dda59c6d51f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:22.682484 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af1d3993-38c5-461b-a45d-dda59c6d51f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:22.684030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af1d3993-38c5-461b-a45d-dda59c6d51f6 None None] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:22.684965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af1d3993-38c5-461b-a45d-dda59c6d51f6 None None] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:22.698756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.compute.rpcapi [None req-af1d3993-38c5-461b-a45d-dda59c6d51f6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 15:34:22.700203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af1d3993-38c5-461b-a45d-dda59c6d51f6 None None] Releasing lock "compute-rpcapi-router" {{(pid=124526) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 15:34:22.775448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-af1d3993-38c5-461b-a45d-dda59c6d51f6 None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.895622 Aug 01 15:34:22.780140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 21/41] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:22.816067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-550ff9c1-dde8-4c42-a583-d15d7281d77f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:22.817103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-550ff9c1-dde8-4c42-a583-d15d7281d77f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:22.835387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-550ff9c1-dde8-4c42-a583-d15d7281d77f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:22.836141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-550ff9c1-dde8-4c42-a583-d15d7281d77f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:22.837243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-550ff9c1-dde8-4c42-a583-d15d7281d77f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:22.840056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-550ff9c1-dde8-4c42-a583-d15d7281d77f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:22.861713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.network.neutron [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] validate_networks() for [('2f1bed6a-c264-454e-855c-f998e359854d', None, None, None, None, None)] {{(pid=124527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:34:23.623717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-550ff9c1-dde8-4c42-a583-d15d7281d77f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:23.645088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-550ff9c1-dde8-4c42-a583-d15d7281d77f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:23.648654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-550ff9c1-dde8-4c42-a583-d15d7281d77f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:23.650380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-550ff9c1-dde8-4c42-a583-d15d7281d77f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1333 microversion: 2.20 time: 0.868153 Aug 01 15:34:23.678475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 22/42] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:22 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1333 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:23.704023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7cc29b93-52a8-4e26-8fa8-e177e37c4f86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:23.707664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7cc29b93-52a8-4e26-8fa8-e177e37c4f86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:23.750814 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7cc29b93-52a8-4e26-8fa8-e177e37c4f86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:23.751390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7cc29b93-52a8-4e26-8fa8-e177e37c4f86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:23.756713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7cc29b93-52a8-4e26-8fa8-e177e37c4f86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:23.765314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7cc29b93-52a8-4e26-8fa8-e177e37c4f86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:24.039888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7cc29b93-52a8-4e26-8fa8-e177e37c4f86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:24.069634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7cc29b93-52a8-4e26-8fa8-e177e37c4f86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1273 microversion: 2.1 time: 0.389316 Aug 01 15:34:24.070531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 23/43] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:23 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1273 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:24.078110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-af6a2e92-1e25-4de3-9e0e-4e02a05cfe8e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:24.078907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-af6a2e92-1e25-4de3-9e0e-4e02a05cfe8e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:24.125202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af6a2e92-1e25-4de3-9e0e-4e02a05cfe8e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:24.128148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af6a2e92-1e25-4de3-9e0e-4e02a05cfe8e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:24.132238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af6a2e92-1e25-4de3-9e0e-4e02a05cfe8e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:24.134290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af6a2e92-1e25-4de3-9e0e-4e02a05cfe8e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:24.630706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Flavor limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:34:24.631293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Image limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:34:24.631601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Flavor pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:34:24.632029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Image pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:34:24.632428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:34:24.677231 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:24.683577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:24.684712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:24.685042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:24.750538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:34:24.765453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for user 4001e8ec57b34f57aae1654fad9217f8 and project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:34:24.806660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Going to run 1 instances... {{(pid=124527) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:34:24.815083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:34:24.948011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-01c416b7-f760-4604-9b74-b0a2c5a36e4a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.140853 Aug 01 15:34:24.962777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 21/44] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:34:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 3157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:34:24.969947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f09a7b99-3d93-4a07-a073-845a74b83bce tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:24.970968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f09a7b99-3d93-4a07-a073-845a74b83bce tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:24.996209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f09a7b99-3d93-4a07-a073-845a74b83bce tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:25.002457 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f09a7b99-3d93-4a07-a073-845a74b83bce tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:25.003683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f09a7b99-3d93-4a07-a073-845a74b83bce tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:25.004361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f09a7b99-3d93-4a07-a073-845a74b83bce tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:25.469074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-af6a2e92-1e25-4de3-9e0e-4e02a05cfe8e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:25.485557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-af6a2e92-1e25-4de3-9e0e-4e02a05cfe8e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1363 microversion: 2.1 time: 1.413589 Aug 01 15:34:25.502589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 24/45] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:24 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1363 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:25.511382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-920944636", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:25.730915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.network.neutron [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] validate_networks() for [('ac89fec2-a975-42c8-b198-9fd04c31bc1f', None, None, None, None, None)] {{(pid=124526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:34:26.400325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f09a7b99-3d93-4a07-a073-845a74b83bce tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:26.416587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f09a7b99-3d93-4a07-a073-845a74b83bce tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 1.452355 Aug 01 15:34:26.434766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 22/46] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:24 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:26.444481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-82cfd48e-57bb-4dca-b105-83754b5abb1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:26.445476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-82cfd48e-57bb-4dca-b105-83754b5abb1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:26.463264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-82cfd48e-57bb-4dca-b105-83754b5abb1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:26.470817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-82cfd48e-57bb-4dca-b105-83754b5abb1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:26.475068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-82cfd48e-57bb-4dca-b105-83754b5abb1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:26.475725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-82cfd48e-57bb-4dca-b105-83754b5abb1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:27.376065 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-82cfd48e-57bb-4dca-b105-83754b5abb1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:27.394838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-82cfd48e-57bb-4dca-b105-83754b5abb1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:27.396803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-82cfd48e-57bb-4dca-b105-83754b5abb1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:27.407958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-82cfd48e-57bb-4dca-b105-83754b5abb1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1339 microversion: 2.20 time: 0.971159 Aug 01 15:34:27.410636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 23/47] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1339 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:27.417956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bcf62d1d-b211-41dc-8498-0b675b5e787e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:27.439513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bcf62d1d-b211-41dc-8498-0b675b5e787e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:27.455594 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bcf62d1d-b211-41dc-8498-0b675b5e787e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:27.456773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bcf62d1d-b211-41dc-8498-0b675b5e787e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:27.460323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bcf62d1d-b211-41dc-8498-0b675b5e787e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:27.461021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bcf62d1d-b211-41dc-8498-0b675b5e787e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:27.751909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=20 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:28.442027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bcf62d1d-b211-41dc-8498-0b675b5e787e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:28.455337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bcf62d1d-b211-41dc-8498-0b675b5e787e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1294 microversion: 2.1 time: 1.041839 Aug 01 15:34:28.459721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 24/48] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:27 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1294 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:28.478138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8117630c-1d04-40a4-8b34-6dc41384cc00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:28.480408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8117630c-1d04-40a4-8b34-6dc41384cc00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:28.495985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:28.500505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8117630c-1d04-40a4-8b34-6dc41384cc00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:28.503803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8117630c-1d04-40a4-8b34-6dc41384cc00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:28.505125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8117630c-1d04-40a4-8b34-6dc41384cc00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:28.507062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8117630c-1d04-40a4-8b34-6dc41384cc00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:29.232589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8117630c-1d04-40a4-8b34-6dc41384cc00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:29.277091 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8117630c-1d04-40a4-8b34-6dc41384cc00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1363 microversion: 2.1 time: 0.813067 Aug 01 15:34:29.282285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 25/49] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:28 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1363 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:29.296087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9108443b-c0a7-4cfe-b6cc-9d5d9b203aaf tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:29.298822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9108443b-c0a7-4cfe-b6cc-9d5d9b203aaf tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:29.317659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9108443b-c0a7-4cfe-b6cc-9d5d9b203aaf tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:29.319787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9108443b-c0a7-4cfe-b6cc-9d5d9b203aaf tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:29.321479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9108443b-c0a7-4cfe-b6cc-9d5d9b203aaf tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:29.324037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9108443b-c0a7-4cfe-b6cc-9d5d9b203aaf tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:30.014057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Flavor limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:34:30.018061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Image limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:34:30.018061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Flavor pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:34:30.018061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Image pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:34:30.018061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:34:30.026302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:30.026751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:30.027573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:30.028003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:30.048459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Getting quotas for project 2d49f0b3378c42ada96c61586a38136e. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:34:30.067437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Getting quotas for user 5f0b12ba782244d7b44783c3f3532bfa and project 2d49f0b3378c42ada96c61586a38136e. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:34:30.080584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Going to run 1 instances... {{(pid=124526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:34:30.082995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:34:30.133119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c367def4-086c-4992-9d0a-801a3e3adfe3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.628808 Aug 01 15:34:30.140442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 25/50] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:34:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 4637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:34:30.145861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f73c533f-7dfd-41f6-8963-b655a77d0a1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:30.146797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f73c533f-7dfd-41f6-8963-b655a77d0a1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:30.154823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f73c533f-7dfd-41f6-8963-b655a77d0a1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:30.155621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f73c533f-7dfd-41f6-8963-b655a77d0a1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:30.156707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f73c533f-7dfd-41f6-8963-b655a77d0a1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:30.157330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f73c533f-7dfd-41f6-8963-b655a77d0a1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:30.416945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f73c533f-7dfd-41f6-8963-b655a77d0a1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:30.431623 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f73c533f-7dfd-41f6-8963-b655a77d0a1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:30.433953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f73c533f-7dfd-41f6-8963-b655a77d0a1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:30.444115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9108443b-c0a7-4cfe-b6cc-9d5d9b203aaf tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:30.454627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f73c533f-7dfd-41f6-8963-b655a77d0a1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1339 microversion: 2.20 time: 0.293642 Aug 01 15:34:30.455669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 26/51] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1339 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:30.457207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9108443b-c0a7-4cfe-b6cc-9d5d9b203aaf tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 1.173338 Aug 01 15:34:30.458137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 26/52] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:29 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:30.465129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5f44e1ee-7166-451e-818c-11b0475d30f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:30.466281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5f44e1ee-7166-451e-818c-11b0475d30f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:30.487458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5f44e1ee-7166-451e-818c-11b0475d30f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:30.488777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5f44e1ee-7166-451e-818c-11b0475d30f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:30.502407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5f44e1ee-7166-451e-818c-11b0475d30f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:30.505385 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5f44e1ee-7166-451e-818c-11b0475d30f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:30.741322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-4860d080-3bfe-4f17-b98a-17c8e475a6cd req-85d0f067-9bf8-4a43-9581-2788d46f68d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c377fe1d-1c49-46de-87e3-4a70f1253e63", "tag": "77c1695c-6c2d-450f-9b6b-5a55c9a1bf2f"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:30.755992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-4860d080-3bfe-4f17-b98a-17c8e475a6cd req-85d0f067-9bf8-4a43-9581-2788d46f68d0 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:30.756855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-4860d080-3bfe-4f17-b98a-17c8e475a6cd req-85d0f067-9bf8-4a43-9581-2788d46f68d0 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:30.779089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-4860d080-3bfe-4f17-b98a-17c8e475a6cd req-85d0f067-9bf8-4a43-9581-2788d46f68d0 service nova] Creating event network-changed:77c1695c-6c2d-450f-9b6b-5a55c9a1bf2f for instance c377fe1d-1c49-46de-87e3-4a70f1253e63 on hv-cinder-84753 Aug 01 15:34:30.786062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-4860d080-3bfe-4f17-b98a-17c8e475a6cd req-85d0f067-9bf8-4a43-9581-2788d46f68d0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.328336 Aug 01 15:34:30.787009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 27/53] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:30.794849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1761a9f7-6d9b-4f52-96f3-4dc538b60a87 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:30.796246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1761a9f7-6d9b-4f52-96f3-4dc538b60a87 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:30.896024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5f44e1ee-7166-451e-818c-11b0475d30f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:30.910053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5f44e1ee-7166-451e-818c-11b0475d30f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1300 microversion: 2.1 time: 0.450572 Aug 01 15:34:30.910708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 27/54] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1300 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:30.931967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6eac5368-8625-4b10-971c-5a8504ba5d13 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:30.932850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6eac5368-8625-4b10-971c-5a8504ba5d13 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:30.940792 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6eac5368-8625-4b10-971c-5a8504ba5d13 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:30.941532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6eac5368-8625-4b10-971c-5a8504ba5d13 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:30.942533 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6eac5368-8625-4b10-971c-5a8504ba5d13 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:30.943133 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6eac5368-8625-4b10-971c-5a8504ba5d13 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:31.115577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1761a9f7-6d9b-4f52-96f3-4dc538b60a87 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:31.131755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1761a9f7-6d9b-4f52-96f3-4dc538b60a87 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1221 microversion: 2.1 time: 0.342322 Aug 01 15:34:31.132347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 28/55] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:30 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1221 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:31.483709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b753a5f0-4c2b-4c27-ad2f-d0886db79364 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:31.484339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b753a5f0-4c2b-4c27-ad2f-d0886db79364 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:31.497135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b753a5f0-4c2b-4c27-ad2f-d0886db79364 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:31.500354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b753a5f0-4c2b-4c27-ad2f-d0886db79364 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:31.501328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b753a5f0-4c2b-4c27-ad2f-d0886db79364 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:31.501778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b753a5f0-4c2b-4c27-ad2f-d0886db79364 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:31.812378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6eac5368-8625-4b10-971c-5a8504ba5d13 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:31.845741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6eac5368-8625-4b10-971c-5a8504ba5d13 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1363 microversion: 2.1 time: 0.922426 Aug 01 15:34:31.853680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 28/56] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:30 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1363 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:31.876332 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-91f6c3e7-3d5c-476e-a750-9ee44a06b946 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:31.878352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-91f6c3e7-3d5c-476e-a750-9ee44a06b946 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:31.890515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91f6c3e7-3d5c-476e-a750-9ee44a06b946 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:31.890866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91f6c3e7-3d5c-476e-a750-9ee44a06b946 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:31.897361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91f6c3e7-3d5c-476e-a750-9ee44a06b946 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:31.898113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91f6c3e7-3d5c-476e-a750-9ee44a06b946 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:32.368674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b753a5f0-4c2b-4c27-ad2f-d0886db79364 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:32.376563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=79 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:32.380101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b753a5f0-4c2b-4c27-ad2f-d0886db79364 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:32.381654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b753a5f0-4c2b-4c27-ad2f-d0886db79364 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:32.382861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b753a5f0-4c2b-4c27-ad2f-d0886db79364 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.903805 Aug 01 15:34:32.383430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 29/57] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:34:32.390076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bd552904-1098-475a-841a-f1250b321a53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:32.391732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bd552904-1098-475a-841a-f1250b321a53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:32.402913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd552904-1098-475a-841a-f1250b321a53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:32.403977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd552904-1098-475a-841a-f1250b321a53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:32.404750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd552904-1098-475a-841a-f1250b321a53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:32.404990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd552904-1098-475a-841a-f1250b321a53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:32.481706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-91f6c3e7-3d5c-476e-a750-9ee44a06b946 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:32.497422 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-91f6c3e7-3d5c-476e-a750-9ee44a06b946 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 0.630221 Aug 01 15:34:32.498543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 29/58] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:31 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:32.503974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b66963ca-fb45-4e16-b893-64748a2f1f36 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:32.504929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b66963ca-fb45-4e16-b893-64748a2f1f36 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:32.514949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b66963ca-fb45-4e16-b893-64748a2f1f36 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:32.516283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b66963ca-fb45-4e16-b893-64748a2f1f36 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:32.518247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b66963ca-fb45-4e16-b893-64748a2f1f36 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:32.519486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b66963ca-fb45-4e16-b893-64748a2f1f36 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:32.544160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bd552904-1098-475a-841a-f1250b321a53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:32.567156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bd552904-1098-475a-841a-f1250b321a53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1300 microversion: 2.1 time: 0.181626 Aug 01 15:34:32.568474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 30/59] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:32 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1300 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:32.684295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b66963ca-fb45-4e16-b893-64748a2f1f36 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:32.695657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b66963ca-fb45-4e16-b893-64748a2f1f36 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1273 microversion: 2.1 time: 0.195451 Aug 01 15:34:32.706303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 30/60] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:32 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:32.848600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-3165cf92-8d28-48a5-b3f6-c2dd95f6b16c req-a6122e2f-ae70-4185-a56b-a9b8d7c98f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98608629-6a0a-496b-9d09-cdb8a2e5118e", "tag": "dbd0f21d-36cc-4868-9cff-11f0389cbba7"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:32.873980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-3165cf92-8d28-48a5-b3f6-c2dd95f6b16c req-a6122e2f-ae70-4185-a56b-a9b8d7c98f0b service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:32.876237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-3165cf92-8d28-48a5-b3f6-c2dd95f6b16c req-a6122e2f-ae70-4185-a56b-a9b8d7c98f0b service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:32.879985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5a8ce946-72da-4590-a3e3-71dfcce2a7f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:32.881647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5a8ce946-72da-4590-a3e3-71dfcce2a7f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:32.897348 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a8ce946-72da-4590-a3e3-71dfcce2a7f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:32.898088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a8ce946-72da-4590-a3e3-71dfcce2a7f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:32.899315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a8ce946-72da-4590-a3e3-71dfcce2a7f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:32.899926 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a8ce946-72da-4590-a3e3-71dfcce2a7f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:32.909381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-3165cf92-8d28-48a5-b3f6-c2dd95f6b16c req-a6122e2f-ae70-4185-a56b-a9b8d7c98f0b service nova] Creating event network-changed:dbd0f21d-36cc-4868-9cff-11f0389cbba7 for instance 98608629-6a0a-496b-9d09-cdb8a2e5118e on hv-cinder-84753 Aug 01 15:34:32.924817 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-3165cf92-8d28-48a5-b3f6-c2dd95f6b16c req-a6122e2f-ae70-4185-a56b-a9b8d7c98f0b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079428 Aug 01 15:34:32.931775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 31/61] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:33.406765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-101f68eb-e438-43f5-892b-dc26b91ed198 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:33.408294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-101f68eb-e438-43f5-892b-dc26b91ed198 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:33.418041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-101f68eb-e438-43f5-892b-dc26b91ed198 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:33.421943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-101f68eb-e438-43f5-892b-dc26b91ed198 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:33.423885 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-101f68eb-e438-43f5-892b-dc26b91ed198 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:33.426105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-101f68eb-e438-43f5-892b-dc26b91ed198 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:34.146519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5a8ce946-72da-4590-a3e3-71dfcce2a7f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:34.171567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5a8ce946-72da-4590-a3e3-71dfcce2a7f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1363 microversion: 2.1 time: 1.292609 Aug 01 15:34:34.174146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 31/62] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:32 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1363 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:34.186369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-696b7d3b-c437-488f-8011-235a693c9faa tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:34.188067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-696b7d3b-c437-488f-8011-235a693c9faa tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:34.202473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-696b7d3b-c437-488f-8011-235a693c9faa tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:34.203861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-696b7d3b-c437-488f-8011-235a693c9faa tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:34.205482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-696b7d3b-c437-488f-8011-235a693c9faa tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:34.207221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-696b7d3b-c437-488f-8011-235a693c9faa tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:34.725695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=4 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:34.792040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=32 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:34.811605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-101f68eb-e438-43f5-892b-dc26b91ed198 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:34.822281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-101f68eb-e438-43f5-892b-dc26b91ed198 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:34.825849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-101f68eb-e438-43f5-892b-dc26b91ed198 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:34.846952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-101f68eb-e438-43f5-892b-dc26b91ed198 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 1.427351 Aug 01 15:34:34.848529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 32/63] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:34:34.878943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9b0acf97-6d6e-452c-9d30-02edb78bad3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:34.880246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9b0acf97-6d6e-452c-9d30-02edb78bad3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:34.901243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b0acf97-6d6e-452c-9d30-02edb78bad3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:34.901712 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b0acf97-6d6e-452c-9d30-02edb78bad3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:34.906709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b0acf97-6d6e-452c-9d30-02edb78bad3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:34.907511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b0acf97-6d6e-452c-9d30-02edb78bad3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:35.525498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9b0acf97-6d6e-452c-9d30-02edb78bad3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:35.538303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9b0acf97-6d6e-452c-9d30-02edb78bad3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1367 microversion: 2.1 time: 0.688358 Aug 01 15:34:35.539128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 33/64] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:34 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1367 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:35.561434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-29a59e1d-ca36-4ae7-b1df-f5bd78a89998 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:35.562456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-29a59e1d-ca36-4ae7-b1df-f5bd78a89998 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:35.589563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29a59e1d-ca36-4ae7-b1df-f5bd78a89998 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:35.593482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29a59e1d-ca36-4ae7-b1df-f5bd78a89998 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:35.597494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29a59e1d-ca36-4ae7-b1df-f5bd78a89998 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:35.598507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29a59e1d-ca36-4ae7-b1df-f5bd78a89998 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:35.620867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-696b7d3b-c437-488f-8011-235a693c9faa tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:35.640083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-696b7d3b-c437-488f-8011-235a693c9faa tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 1.458203 Aug 01 15:34:35.641140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 32/65] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:34 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:35.653224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b98dddaf-d971-4ffe-bca6-4775f41b9981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:35.653869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b98dddaf-d971-4ffe-bca6-4775f41b9981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:35.664336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b98dddaf-d971-4ffe-bca6-4775f41b9981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:35.666552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b98dddaf-d971-4ffe-bca6-4775f41b9981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:35.675590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b98dddaf-d971-4ffe-bca6-4775f41b9981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:35.676820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b98dddaf-d971-4ffe-bca6-4775f41b9981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:35.819904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-29a59e1d-ca36-4ae7-b1df-f5bd78a89998 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:35.843603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-29a59e1d-ca36-4ae7-b1df-f5bd78a89998 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1279 microversion: 2.1 time: 0.299073 Aug 01 15:34:35.845361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 34/66] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:35 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1279 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:35.876499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-02a265b6-2bb7-440f-844b-fd9081f841aa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:35.878392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-02a265b6-2bb7-440f-844b-fd9081f841aa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:35.889551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02a265b6-2bb7-440f-844b-fd9081f841aa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:35.893691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02a265b6-2bb7-440f-844b-fd9081f841aa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:35.895881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02a265b6-2bb7-440f-844b-fd9081f841aa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:35.897963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02a265b6-2bb7-440f-844b-fd9081f841aa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:35.992182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b98dddaf-d971-4ffe-bca6-4775f41b9981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:36.001618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b98dddaf-d971-4ffe-bca6-4775f41b9981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1363 microversion: 2.1 time: 0.359049 Aug 01 15:34:36.004254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 33/67] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:35 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1363 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:36.178487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-02a265b6-2bb7-440f-844b-fd9081f841aa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:36.194743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-02a265b6-2bb7-440f-844b-fd9081f841aa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:36.198412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-02a265b6-2bb7-440f-844b-fd9081f841aa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:36.203042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-02a265b6-2bb7-440f-844b-fd9081f841aa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.330931 Aug 01 15:34:36.207838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 35/68] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:36.290553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-6b67f31e-7d7c-4299-9c16-a0d0c6e774eb req-de42f2ba-bd72-4c07-8987-b5fa82c5c556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2122c9a8-db75-40b5-bbbe-9c83c983d961", "tag": "419fa20b-5321-45c3-bf43-01c4530aa3fc"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:36.337988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-6b67f31e-7d7c-4299-9c16-a0d0c6e774eb req-de42f2ba-bd72-4c07-8987-b5fa82c5c556 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:36.338838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-6b67f31e-7d7c-4299-9c16-a0d0c6e774eb req-de42f2ba-bd72-4c07-8987-b5fa82c5c556 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:36.383717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-6b67f31e-7d7c-4299-9c16-a0d0c6e774eb req-de42f2ba-bd72-4c07-8987-b5fa82c5c556 service nova] Creating event network-changed:419fa20b-5321-45c3-bf43-01c4530aa3fc for instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 on hv-cinder-84753 Aug 01 15:34:36.384269 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-6b67f31e-7d7c-4299-9c16-a0d0c6e774eb req-de42f2ba-bd72-4c07-8987-b5fa82c5c556 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124527) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 15:34:36.387299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf800373-3a3a-4263-bb17-c22ff805b54f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:36.387752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf800373-3a3a-4263-bb17-c22ff805b54f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:36.389106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf800373-3a3a-4263-bb17-c22ff805b54f None None] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:36.389545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf800373-3a3a-4263-bb17-c22ff805b54f None None] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:36.422847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.compute.rpcapi [None req-bf800373-3a3a-4263-bb17-c22ff805b54f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 15:34:36.424313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf800373-3a3a-4263-bb17-c22ff805b54f None None] Releasing lock "compute-rpcapi-router" {{(pid=124527) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 15:34:36.491969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bf800373-3a3a-4263-bb17-c22ff805b54f None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214844 Aug 01 15:34:36.493265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 34/69] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:36.566749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6ac81dca-4c1a-49f0-84bf-93efcb1c59aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:36.567484 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6ac81dca-4c1a-49f0-84bf-93efcb1c59aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:36.596821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ac81dca-4c1a-49f0-84bf-93efcb1c59aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:36.597947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ac81dca-4c1a-49f0-84bf-93efcb1c59aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:36.601264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ac81dca-4c1a-49f0-84bf-93efcb1c59aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:36.602026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ac81dca-4c1a-49f0-84bf-93efcb1c59aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:36.671013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6bf7e43d-9212-4afe-8db8-f031eddc913f tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:36.671459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6bf7e43d-9212-4afe-8db8-f031eddc913f tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:36.694308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bf7e43d-9212-4afe-8db8-f031eddc913f tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:36.699718 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bf7e43d-9212-4afe-8db8-f031eddc913f tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:36.702623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bf7e43d-9212-4afe-8db8-f031eddc913f tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:36.703861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bf7e43d-9212-4afe-8db8-f031eddc913f tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:36.715840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:37.017213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6ac81dca-4c1a-49f0-84bf-93efcb1c59aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:37.027893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6ac81dca-4c1a-49f0-84bf-93efcb1c59aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1367 microversion: 2.1 time: 0.471078 Aug 01 15:34:37.032543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 36/70] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:36 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1367 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:37.040324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aa6c8cb4-a849-4a44-92ce-d55b9a582ee3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:37.040812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aa6c8cb4-a849-4a44-92ce-d55b9a582ee3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:37.058750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa6c8cb4-a849-4a44-92ce-d55b9a582ee3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:37.059189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa6c8cb4-a849-4a44-92ce-d55b9a582ee3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:37.059973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa6c8cb4-a849-4a44-92ce-d55b9a582ee3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:37.062872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa6c8cb4-a849-4a44-92ce-d55b9a582ee3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:37.325109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6bf7e43d-9212-4afe-8db8-f031eddc913f tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:37.343822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6bf7e43d-9212-4afe-8db8-f031eddc913f tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 0.679664 Aug 01 15:34:37.344559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 35/71] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:36 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:34:37.349687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cf423932-62e7-4e9e-bbfd-ea57de27bc6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:37.350346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cf423932-62e7-4e9e-bbfd-ea57de27bc6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:37.359460 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf423932-62e7-4e9e-bbfd-ea57de27bc6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:37.368111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf423932-62e7-4e9e-bbfd-ea57de27bc6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:37.368865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf423932-62e7-4e9e-bbfd-ea57de27bc6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:37.369251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf423932-62e7-4e9e-bbfd-ea57de27bc6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:37.695231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aa6c8cb4-a849-4a44-92ce-d55b9a582ee3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:37.715261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aa6c8cb4-a849-4a44-92ce-d55b9a582ee3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.678834 Aug 01 15:34:37.716321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 37/72] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:37 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:37.758208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-45adcfa9-908a-4ff2-a304-02b2b8e7b457 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:37.758923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-45adcfa9-908a-4ff2-a304-02b2b8e7b457 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:37.776916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45adcfa9-908a-4ff2-a304-02b2b8e7b457 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:37.777363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45adcfa9-908a-4ff2-a304-02b2b8e7b457 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:37.784222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45adcfa9-908a-4ff2-a304-02b2b8e7b457 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:37.784730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45adcfa9-908a-4ff2-a304-02b2b8e7b457 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:37.875185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cf423932-62e7-4e9e-bbfd-ea57de27bc6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:37.891740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cf423932-62e7-4e9e-bbfd-ea57de27bc6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1363 microversion: 2.1 time: 0.545988 Aug 01 15:34:37.906279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 36/73] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:37 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1363 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:37.911905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-f2990b28-c556-46cc-bc42-388748a9cb13 req-b1aca787-f21c-4081-82cc-920375f610b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df81c1c8-0ae0-44a5-8f89-b32d2396e056", "tag": "d51054b4-9bd5-4685-8e01-589ee8693546"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:37.923821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-f2990b28-c556-46cc-bc42-388748a9cb13 req-b1aca787-f21c-4081-82cc-920375f610b6 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:37.924569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-f2990b28-c556-46cc-bc42-388748a9cb13 req-b1aca787-f21c-4081-82cc-920375f610b6 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:37.940459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-f2990b28-c556-46cc-bc42-388748a9cb13 req-b1aca787-f21c-4081-82cc-920375f610b6 service nova] Creating event network-changed:d51054b4-9bd5-4685-8e01-589ee8693546 for instance df81c1c8-0ae0-44a5-8f89-b32d2396e056 on hv-cinder-84753 Aug 01 15:34:37.946099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-f2990b28-c556-46cc-bc42-388748a9cb13 req-b1aca787-f21c-4081-82cc-920375f610b6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038270 Aug 01 15:34:37.946901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 37/74] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:38.072439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-17c69c81-6b12-4ca5-b2bc-89643d7626a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:38.073681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-17c69c81-6b12-4ca5-b2bc-89643d7626a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:38.094873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17c69c81-6b12-4ca5-b2bc-89643d7626a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:38.095737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17c69c81-6b12-4ca5-b2bc-89643d7626a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:38.097589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17c69c81-6b12-4ca5-b2bc-89643d7626a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:38.098363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17c69c81-6b12-4ca5-b2bc-89643d7626a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:38.477534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-45adcfa9-908a-4ff2-a304-02b2b8e7b457 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:38.497958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-45adcfa9-908a-4ff2-a304-02b2b8e7b457 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:38.500517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-45adcfa9-908a-4ff2-a304-02b2b8e7b457 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:38.502602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-45adcfa9-908a-4ff2-a304-02b2b8e7b457 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.782384 Aug 01 15:34:38.522089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 38/75] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:38.674739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-82a112af-f7da-4fef-be64-3ddff5da8ba6 req-a7891091-dee0-4d3c-9bcb-e2039f96f601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c377fe1d-1c49-46de-87e3-4a70f1253e63", "name": "network-vif-plugged", "status": "completed", "tag": "77c1695c-6c2d-450f-9b6b-5a55c9a1bf2f"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:38.711441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-82a112af-f7da-4fef-be64-3ddff5da8ba6 req-a7891091-dee0-4d3c-9bcb-e2039f96f601 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:38.723968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-82a112af-f7da-4fef-be64-3ddff5da8ba6 req-a7891091-dee0-4d3c-9bcb-e2039f96f601 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:38.754677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-82a112af-f7da-4fef-be64-3ddff5da8ba6 req-a7891091-dee0-4d3c-9bcb-e2039f96f601 service nova] Creating event network-vif-plugged:77c1695c-6c2d-450f-9b6b-5a55c9a1bf2f for instance c377fe1d-1c49-46de-87e3-4a70f1253e63 on hv-cinder-84753 Aug 01 15:34:38.768584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-82a112af-f7da-4fef-be64-3ddff5da8ba6 req-a7891091-dee0-4d3c-9bcb-e2039f96f601 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244582 Aug 01 15:34:38.774111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 39/76] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:38.789714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-548f6fd0-e49e-493c-8526-70b1151bbc31 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:38.796246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-548f6fd0-e49e-493c-8526-70b1151bbc31 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:38.806075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-17c69c81-6b12-4ca5-b2bc-89643d7626a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:38.817323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-17c69c81-6b12-4ca5-b2bc-89643d7626a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1367 microversion: 2.1 time: 0.751919 Aug 01 15:34:38.828333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-548f6fd0-e49e-493c-8526-70b1151bbc31 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:38.828995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-548f6fd0-e49e-493c-8526-70b1151bbc31 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:38.830687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-548f6fd0-e49e-493c-8526-70b1151bbc31 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:38.831540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-548f6fd0-e49e-493c-8526-70b1151bbc31 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:38.841059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 38/77] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:38 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1367 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:38.853698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-381b5b36-30cb-4f50-9630-e01b4427acad req-a7147c16-3c3a-49b8-8447-21ee0dcb557b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df", "tag": "ce819b69-03c1-4584-9ef2-0228b13d3351"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:38.874294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-381b5b36-30cb-4f50-9630-e01b4427acad req-a7147c16-3c3a-49b8-8447-21ee0dcb557b service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:38.875344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-381b5b36-30cb-4f50-9630-e01b4427acad req-a7147c16-3c3a-49b8-8447-21ee0dcb557b service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:38.914850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-381b5b36-30cb-4f50-9630-e01b4427acad req-a7147c16-3c3a-49b8-8447-21ee0dcb557b service nova] Creating event network-changed:ce819b69-03c1-4584-9ef2-0228b13d3351 for instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df on hv-cinder-84753 Aug 01 15:34:38.923745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-381b5b36-30cb-4f50-9630-e01b4427acad req-a7147c16-3c3a-49b8-8447-21ee0dcb557b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080514 Aug 01 15:34:38.924941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 39/78] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:38.930915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fc1c1d6d-e337-424d-9be3-3002371f5517 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:38.931770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fc1c1d6d-e337-424d-9be3-3002371f5517 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:38.940319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc1c1d6d-e337-424d-9be3-3002371f5517 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:38.941122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc1c1d6d-e337-424d-9be3-3002371f5517 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:38.942135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc1c1d6d-e337-424d-9be3-3002371f5517 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:38.942759 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc1c1d6d-e337-424d-9be3-3002371f5517 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:39.195353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-548f6fd0-e49e-493c-8526-70b1151bbc31 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:39.208103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-548f6fd0-e49e-493c-8526-70b1151bbc31 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 0.423892 Aug 01 15:34:39.220252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 40/79] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:38 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:39.222841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fc1c1d6d-e337-424d-9be3-3002371f5517 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:39.227210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-51dbafa7-4787-45ad-b207-f0b8fa25dda5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:39.228123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-51dbafa7-4787-45ad-b207-f0b8fa25dda5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:39.229663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fc1c1d6d-e337-424d-9be3-3002371f5517 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.303289 Aug 01 15:34:39.230842 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 40/80] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:38 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:39.240200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-51dbafa7-4787-45ad-b207-f0b8fa25dda5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:39.241588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-51dbafa7-4787-45ad-b207-f0b8fa25dda5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:39.243309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-51dbafa7-4787-45ad-b207-f0b8fa25dda5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:39.244294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-51dbafa7-4787-45ad-b207-f0b8fa25dda5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:39.400665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-51dbafa7-4787-45ad-b207-f0b8fa25dda5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:39.408511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-51dbafa7-4787-45ad-b207-f0b8fa25dda5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1363 microversion: 2.1 time: 0.186955 Aug 01 15:34:39.409195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 41/81] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:39 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:39.525857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-da0a9a0d-d4f1-4a30-b1cc-906f4c63e7ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:39.527161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-da0a9a0d-d4f1-4a30-b1cc-906f4c63e7ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:39.534075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da0a9a0d-d4f1-4a30-b1cc-906f4c63e7ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:39.534588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da0a9a0d-d4f1-4a30-b1cc-906f4c63e7ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:39.535455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da0a9a0d-d4f1-4a30-b1cc-906f4c63e7ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:39.535962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da0a9a0d-d4f1-4a30-b1cc-906f4c63e7ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:39.720071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-da0a9a0d-d4f1-4a30-b1cc-906f4c63e7ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:39.729830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-da0a9a0d-d4f1-4a30-b1cc-906f4c63e7ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:39.731685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-da0a9a0d-d4f1-4a30-b1cc-906f4c63e7ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:39.734407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-da0a9a0d-d4f1-4a30-b1cc-906f4c63e7ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.213346 Aug 01 15:34:39.735737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 41/82] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:39.848955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2cd38cfd-632d-480e-aa7e-f0a8d449c9c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:39.850384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2cd38cfd-632d-480e-aa7e-f0a8d449c9c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:39.868183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2cd38cfd-632d-480e-aa7e-f0a8d449c9c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:39.869118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2cd38cfd-632d-480e-aa7e-f0a8d449c9c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:39.870331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2cd38cfd-632d-480e-aa7e-f0a8d449c9c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:39.871048 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2cd38cfd-632d-480e-aa7e-f0a8d449c9c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:40.037108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=10 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:40.233630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-07f12541-ad82-4a6d-b8dc-3d54dcbddce4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:40.235534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-07f12541-ad82-4a6d-b8dc-3d54dcbddce4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:40.260855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07f12541-ad82-4a6d-b8dc-3d54dcbddce4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:40.261802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07f12541-ad82-4a6d-b8dc-3d54dcbddce4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:40.263683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07f12541-ad82-4a6d-b8dc-3d54dcbddce4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:40.264679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07f12541-ad82-4a6d-b8dc-3d54dcbddce4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:40.448342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2cd38cfd-632d-480e-aa7e-f0a8d449c9c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:40.470214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2cd38cfd-632d-480e-aa7e-f0a8d449c9c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1367 microversion: 2.1 time: 0.629982 Aug 01 15:34:40.471217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 42/83] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:39 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1367 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:40.476106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2e29f0a3-cc1d-493d-afa5-5940875fe798 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:40.477104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2e29f0a3-cc1d-493d-afa5-5940875fe798 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:40.491967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e29f0a3-cc1d-493d-afa5-5940875fe798 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:40.493371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e29f0a3-cc1d-493d-afa5-5940875fe798 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:40.495795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e29f0a3-cc1d-493d-afa5-5940875fe798 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:40.497032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e29f0a3-cc1d-493d-afa5-5940875fe798 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:40.672456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-07f12541-ad82-4a6d-b8dc-3d54dcbddce4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:40.681097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-07f12541-ad82-4a6d-b8dc-3d54dcbddce4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 0.453674 Aug 01 15:34:40.701860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 42/84] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:40 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:40.707767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-12a7d970-3a42-47ba-8e38-e58e0be61daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:40.708396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-12a7d970-3a42-47ba-8e38-e58e0be61daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:40.715402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-12a7d970-3a42-47ba-8e38-e58e0be61daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:40.716264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-12a7d970-3a42-47ba-8e38-e58e0be61daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:40.717118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-12a7d970-3a42-47ba-8e38-e58e0be61daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:40.717492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-12a7d970-3a42-47ba-8e38-e58e0be61daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:40.886260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2e29f0a3-cc1d-493d-afa5-5940875fe798 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:40.903363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2e29f0a3-cc1d-493d-afa5-5940875fe798 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.430368 Aug 01 15:34:40.905320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 43/85] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:40 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:40.919189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5e741c3b-9243-435c-ab3f-65ff9b2c5f11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:40.921532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5e741c3b-9243-435c-ab3f-65ff9b2c5f11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:40.928232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e741c3b-9243-435c-ab3f-65ff9b2c5f11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:40.928690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e741c3b-9243-435c-ab3f-65ff9b2c5f11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:40.929547 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e741c3b-9243-435c-ab3f-65ff9b2c5f11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:40.929950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e741c3b-9243-435c-ab3f-65ff9b2c5f11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:40.973279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-12a7d970-3a42-47ba-8e38-e58e0be61daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:40.986351 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-12a7d970-3a42-47ba-8e38-e58e0be61daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1363 microversion: 2.1 time: 0.282706 Aug 01 15:34:40.986946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 43/86] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:40 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:40.991951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-2cff3611-81a6-4b12-b466-08da492c0817 req-6c95c09c-3803-4f2b-83b2-af46eda48389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae", "name": "network-vif-plugged", "status": "completed", "tag": "cde27741-df9b-464c-a305-158d6606aed8"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:41.028925 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-2cff3611-81a6-4b12-b466-08da492c0817 req-6c95c09c-3803-4f2b-83b2-af46eda48389 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:41.029834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-2cff3611-81a6-4b12-b466-08da492c0817 req-6c95c09c-3803-4f2b-83b2-af46eda48389 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:41.048713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-2cff3611-81a6-4b12-b466-08da492c0817 req-6c95c09c-3803-4f2b-83b2-af46eda48389 service nova] Creating event network-vif-plugged:cde27741-df9b-464c-a305-158d6606aed8 for instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae on hv-cinder-84753 Aug 01 15:34:41.054889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-2cff3611-81a6-4b12-b466-08da492c0817 req-6c95c09c-3803-4f2b-83b2-af46eda48389 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066605 Aug 01 15:34:41.055942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 44/87] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:41.121050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=8 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:41.150722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5e741c3b-9243-435c-ab3f-65ff9b2c5f11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:41.173707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5e741c3b-9243-435c-ab3f-65ff9b2c5f11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:41.177240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5e741c3b-9243-435c-ab3f-65ff9b2c5f11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:41.178806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5e741c3b-9243-435c-ab3f-65ff9b2c5f11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.270972 Aug 01 15:34:41.179628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 44/88] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:41.495015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-81c932b2-b206-4962-834b-125efe0bd44f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:41.496381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-81c932b2-b206-4962-834b-125efe0bd44f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:41.519111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81c932b2-b206-4962-834b-125efe0bd44f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:41.521482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81c932b2-b206-4962-834b-125efe0bd44f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:41.523093 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81c932b2-b206-4962-834b-125efe0bd44f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:41.527327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81c932b2-b206-4962-834b-125efe0bd44f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:41.710966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cc904404-07e3-425f-9bbe-4fc240d64e36 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:41.711891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cc904404-07e3-425f-9bbe-4fc240d64e36 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:41.733424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc904404-07e3-425f-9bbe-4fc240d64e36 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:41.734854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc904404-07e3-425f-9bbe-4fc240d64e36 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:41.737120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc904404-07e3-425f-9bbe-4fc240d64e36 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:41.760676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc904404-07e3-425f-9bbe-4fc240d64e36 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:41.926289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-81c932b2-b206-4962-834b-125efe0bd44f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:41.937184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-81c932b2-b206-4962-834b-125efe0bd44f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1367 microversion: 2.1 time: 0.449017 Aug 01 15:34:41.939646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 45/89] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:41.944840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bd14cc3f-d551-4aed-b4c0-7f16a313569e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:41.954742 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bd14cc3f-d551-4aed-b4c0-7f16a313569e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:41.963262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd14cc3f-d551-4aed-b4c0-7f16a313569e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:41.964172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd14cc3f-d551-4aed-b4c0-7f16a313569e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:41.965116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd14cc3f-d551-4aed-b4c0-7f16a313569e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:41.965566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd14cc3f-d551-4aed-b4c0-7f16a313569e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:42.136420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cc904404-07e3-425f-9bbe-4fc240d64e36 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:42.149554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cc904404-07e3-425f-9bbe-4fc240d64e36 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 0.442282 Aug 01 15:34:42.151549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 45/90] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:41 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:42.162974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2132da0f-8196-4492-9ee7-3119cb751e4c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:42.165914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2132da0f-8196-4492-9ee7-3119cb751e4c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:42.182014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2132da0f-8196-4492-9ee7-3119cb751e4c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:42.182501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2132da0f-8196-4492-9ee7-3119cb751e4c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:42.183323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2132da0f-8196-4492-9ee7-3119cb751e4c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:42.186319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2132da0f-8196-4492-9ee7-3119cb751e4c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:42.361568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bd14cc3f-d551-4aed-b4c0-7f16a313569e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:42.391003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bd14cc3f-d551-4aed-b4c0-7f16a313569e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.449752 Aug 01 15:34:42.408770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 46/91] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:41 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:42.418271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0b98cf34-8986-4a21-add7-aa583bc87023 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:42.419397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0b98cf34-8986-4a21-add7-aa583bc87023 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:42.437368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b98cf34-8986-4a21-add7-aa583bc87023 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:42.441614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b98cf34-8986-4a21-add7-aa583bc87023 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:42.442541 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b98cf34-8986-4a21-add7-aa583bc87023 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:42.443638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b98cf34-8986-4a21-add7-aa583bc87023 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:42.494801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2132da0f-8196-4492-9ee7-3119cb751e4c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:42.507687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2132da0f-8196-4492-9ee7-3119cb751e4c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1363 microversion: 2.1 time: 0.354320 Aug 01 15:34:42.510323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 46/92] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:42 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:42.698296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0b98cf34-8986-4a21-add7-aa583bc87023 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:42.749403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0b98cf34-8986-4a21-add7-aa583bc87023 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:42.756891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0b98cf34-8986-4a21-add7-aa583bc87023 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:42.761760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0b98cf34-8986-4a21-add7-aa583bc87023 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.361900 Aug 01 15:34:42.763453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 47/93] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:42 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:42.974433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-84525f76-eb77-4078-b445-fb6d7f2240b2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:42.974433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-84525f76-eb77-4078-b445-fb6d7f2240b2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:42.982991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84525f76-eb77-4078-b445-fb6d7f2240b2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:42.983782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84525f76-eb77-4078-b445-fb6d7f2240b2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:42.984754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84525f76-eb77-4078-b445-fb6d7f2240b2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:42.985192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84525f76-eb77-4078-b445-fb6d7f2240b2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:43.086614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-05f73f73-9a17-46ff-8c42-a8bc32b741ae req-fbe23d7a-3a31-419e-9abd-aae0ec243cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98608629-6a0a-496b-9d09-cdb8a2e5118e", "name": "network-vif-plugged", "status": "completed", "tag": "dbd0f21d-36cc-4868-9cff-11f0389cbba7"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:43.111033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-05f73f73-9a17-46ff-8c42-a8bc32b741ae req-fbe23d7a-3a31-419e-9abd-aae0ec243cae service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:43.113274 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-05f73f73-9a17-46ff-8c42-a8bc32b741ae req-fbe23d7a-3a31-419e-9abd-aae0ec243cae service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:43.144815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-05f73f73-9a17-46ff-8c42-a8bc32b741ae req-fbe23d7a-3a31-419e-9abd-aae0ec243cae service nova] Creating event network-vif-plugged:dbd0f21d-36cc-4868-9cff-11f0389cbba7 for instance 98608629-6a0a-496b-9d09-cdb8a2e5118e on hv-cinder-84753 Aug 01 15:34:43.153215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-05f73f73-9a17-46ff-8c42-a8bc32b741ae req-fbe23d7a-3a31-419e-9abd-aae0ec243cae service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079065 Aug 01 15:34:43.162109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 48/94] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:34:43.172995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2ca44e4c-bff4-40d5-8bbd-08a396de471d tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:43.173702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2ca44e4c-bff4-40d5-8bbd-08a396de471d tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:43.194984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2ca44e4c-bff4-40d5-8bbd-08a396de471d tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:43.195327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2ca44e4c-bff4-40d5-8bbd-08a396de471d tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:43.196101 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2ca44e4c-bff4-40d5-8bbd-08a396de471d tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:43.197420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2ca44e4c-bff4-40d5-8bbd-08a396de471d tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:43.389687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-84525f76-eb77-4078-b445-fb6d7f2240b2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:43.392966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:43.403894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-84525f76-eb77-4078-b445-fb6d7f2240b2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1367 microversion: 2.1 time: 0.435929 Aug 01 15:34:43.405239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 47/95] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:42 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:43.424465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c4a579ec-93fa-4086-94ce-d41447a63d2d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:43.425337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c4a579ec-93fa-4086-94ce-d41447a63d2d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:43.435881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4a579ec-93fa-4086-94ce-d41447a63d2d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:43.438616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4a579ec-93fa-4086-94ce-d41447a63d2d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:43.444755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4a579ec-93fa-4086-94ce-d41447a63d2d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:43.445514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4a579ec-93fa-4086-94ce-d41447a63d2d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:43.495506 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2ca44e4c-bff4-40d5-8bbd-08a396de471d tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:43.507513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2ca44e4c-bff4-40d5-8bbd-08a396de471d tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 0.338980 Aug 01 15:34:43.523434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 49/96] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:43 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:34:43.544056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-540262f2-78c7-431f-85e2-23f555b617bd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:43.545141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-540262f2-78c7-431f-85e2-23f555b617bd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:43.557541 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-540262f2-78c7-431f-85e2-23f555b617bd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:43.558705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-540262f2-78c7-431f-85e2-23f555b617bd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:43.559708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-540262f2-78c7-431f-85e2-23f555b617bd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:43.561047 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-540262f2-78c7-431f-85e2-23f555b617bd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:43.790674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c4a579ec-93fa-4086-94ce-d41447a63d2d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:43.813650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c4a579ec-93fa-4086-94ce-d41447a63d2d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.393540 Aug 01 15:34:43.818252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 48/97] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:43 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:34:43.837973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-937ef17e-3283-4c8d-8bda-f29900113c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:43.839665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-937ef17e-3283-4c8d-8bda-f29900113c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:43.865757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-937ef17e-3283-4c8d-8bda-f29900113c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:43.867902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-937ef17e-3283-4c8d-8bda-f29900113c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:43.870701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-937ef17e-3283-4c8d-8bda-f29900113c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:43.874518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-937ef17e-3283-4c8d-8bda-f29900113c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:44.644126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-540262f2-78c7-431f-85e2-23f555b617bd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:44.653144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-540262f2-78c7-431f-85e2-23f555b617bd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1550 microversion: 2.1 time: 1.117388 Aug 01 15:34:44.655032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 50/98] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:43 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1550 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:44.660201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-652bc0da-b0cf-4185-b2e8-9dc90ef64f4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:44.661502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-652bc0da-b0cf-4185-b2e8-9dc90ef64f4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:44.668224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-652bc0da-b0cf-4185-b2e8-9dc90ef64f4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:44.668782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-652bc0da-b0cf-4185-b2e8-9dc90ef64f4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:44.669754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-652bc0da-b0cf-4185-b2e8-9dc90ef64f4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:44.670372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-652bc0da-b0cf-4185-b2e8-9dc90ef64f4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:44.743437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-937ef17e-3283-4c8d-8bda-f29900113c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:44.761409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-937ef17e-3283-4c8d-8bda-f29900113c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:44.764594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-937ef17e-3283-4c8d-8bda-f29900113c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:44.765943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-937ef17e-3283-4c8d-8bda-f29900113c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.946110 Aug 01 15:34:44.766393 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 49/99] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:44.771586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2908de2b-f2af-4f3e-a0d5-bbf6e327d90a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:44.772418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2908de2b-f2af-4f3e-a0d5-bbf6e327d90a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:44.780508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2908de2b-f2af-4f3e-a0d5-bbf6e327d90a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:44.781204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2908de2b-f2af-4f3e-a0d5-bbf6e327d90a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:44.782252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2908de2b-f2af-4f3e-a0d5-bbf6e327d90a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:44.782848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2908de2b-f2af-4f3e-a0d5-bbf6e327d90a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:45.061655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-652bc0da-b0cf-4185-b2e8-9dc90ef64f4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:45.069458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2908de2b-f2af-4f3e-a0d5-bbf6e327d90a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:45.078901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2908de2b-f2af-4f3e-a0d5-bbf6e327d90a tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1315 microversion: 2.1 time: 0.311258 Aug 01 15:34:45.079486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 50/100] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:44 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:45.082851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-652bc0da-b0cf-4185-b2e8-9dc90ef64f4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1367 microversion: 2.1 time: 0.426752 Aug 01 15:34:45.083430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 51/101] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:44 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:45.089966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6d5da266-def3-419d-92d1-ee04b3d9d00e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:45.090818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6d5da266-def3-419d-92d1-ee04b3d9d00e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:45.098005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bea1468b-a30a-4f02-a086-538db61c31f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:45.098749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bea1468b-a30a-4f02-a086-538db61c31f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:45.099291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d5da266-def3-419d-92d1-ee04b3d9d00e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:45.100044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d5da266-def3-419d-92d1-ee04b3d9d00e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:45.101327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d5da266-def3-419d-92d1-ee04b3d9d00e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:45.102097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d5da266-def3-419d-92d1-ee04b3d9d00e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:45.105077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bea1468b-a30a-4f02-a086-538db61c31f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:45.105591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bea1468b-a30a-4f02-a086-538db61c31f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:45.106655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bea1468b-a30a-4f02-a086-538db61c31f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:45.107319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bea1468b-a30a-4f02-a086-538db61c31f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:45.288572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bea1468b-a30a-4f02-a086-538db61c31f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203521 Aug 01 15:34:45.289643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 51/102] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 1 15:34:45 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:45.335002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6d5da266-def3-419d-92d1-ee04b3d9d00e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:45.347266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6d5da266-def3-419d-92d1-ee04b3d9d00e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.261013 Aug 01 15:34:45.348135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 52/103] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:45 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:45.793420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4210f716-5134-4614-8307-577d93724470 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:45.795228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4210f716-5134-4614-8307-577d93724470 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:45.806481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4210f716-5134-4614-8307-577d93724470 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:45.814448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4210f716-5134-4614-8307-577d93724470 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:45.815585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4210f716-5134-4614-8307-577d93724470 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:45.819382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4210f716-5134-4614-8307-577d93724470 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:45.997440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-e599c478-e068-4dd4-86dd-6912e1bc2f4d req-f012b887-5ed8-4409-b8f9-1c650d66b7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2122c9a8-db75-40b5-bbbe-9c83c983d961", "name": "network-vif-plugged", "status": "completed", "tag": "419fa20b-5321-45c3-bf43-01c4530aa3fc"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:46.016743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-e599c478-e068-4dd4-86dd-6912e1bc2f4d req-f012b887-5ed8-4409-b8f9-1c650d66b7fc service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:46.017312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-e599c478-e068-4dd4-86dd-6912e1bc2f4d req-f012b887-5ed8-4409-b8f9-1c650d66b7fc service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:46.034128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-e599c478-e068-4dd4-86dd-6912e1bc2f4d req-f012b887-5ed8-4409-b8f9-1c650d66b7fc service nova] Creating event network-vif-plugged:419fa20b-5321-45c3-bf43-01c4530aa3fc for instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 on hv-cinder-84753 Aug 01 15:34:46.041160 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-e599c478-e068-4dd4-86dd-6912e1bc2f4d req-f012b887-5ed8-4409-b8f9-1c650d66b7fc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047446 Aug 01 15:34:46.042878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 53/104] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:34:46.111993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1869062f-0e0b-4a64-9b7e-867bc2d2114c tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:46.115593 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1869062f-0e0b-4a64-9b7e-867bc2d2114c tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:46.130798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1869062f-0e0b-4a64-9b7e-867bc2d2114c tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:46.135375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1869062f-0e0b-4a64-9b7e-867bc2d2114c tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:46.136586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1869062f-0e0b-4a64-9b7e-867bc2d2114c tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:46.138164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1869062f-0e0b-4a64-9b7e-867bc2d2114c tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:46.422631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=2 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:46.491584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4210f716-5134-4614-8307-577d93724470 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:46.507243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4210f716-5134-4614-8307-577d93724470 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:46.517840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4210f716-5134-4614-8307-577d93724470 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:46.519376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4210f716-5134-4614-8307-577d93724470 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.731041 Aug 01 15:34:46.534946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 52/105] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:46.543448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e8e76ac6-ecc2-4df1-a9bf-7e821a8322cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:46.544455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e8e76ac6-ecc2-4df1-a9bf-7e821a8322cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:46.551539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8e76ac6-ecc2-4df1-a9bf-7e821a8322cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:46.552362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8e76ac6-ecc2-4df1-a9bf-7e821a8322cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:46.553458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8e76ac6-ecc2-4df1-a9bf-7e821a8322cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:46.554147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8e76ac6-ecc2-4df1-a9bf-7e821a8322cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:46.608680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1869062f-0e0b-4a64-9b7e-867bc2d2114c tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:46.618667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1869062f-0e0b-4a64-9b7e-867bc2d2114c tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1502 microversion: 2.1 time: 0.520304 Aug 01 15:34:46.619584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 54/106] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:46 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1502 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:46.625536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2b2cd11f-4725-4e58-8716-e9d292a294f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:46.626387 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2b2cd11f-4725-4e58-8716-e9d292a294f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:46.636280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b2cd11f-4725-4e58-8716-e9d292a294f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:46.637079 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b2cd11f-4725-4e58-8716-e9d292a294f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:46.638372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b2cd11f-4725-4e58-8716-e9d292a294f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:46.638844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b2cd11f-4725-4e58-8716-e9d292a294f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:46.643790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:46.944990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e8e76ac6-ecc2-4df1-a9bf-7e821a8322cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:46.955839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e8e76ac6-ecc2-4df1-a9bf-7e821a8322cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1367 microversion: 2.1 time: 0.419383 Aug 01 15:34:46.956442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 53/107] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:46 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:47.269538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2b2cd11f-4725-4e58-8716-e9d292a294f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:47.308008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2b2cd11f-4725-4e58-8716-e9d292a294f2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.686910 Aug 01 15:34:47.320823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 55/108] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:46 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:47.485631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-a60a3a33-b347-4e74-861c-008fe28a39a5 req-614c0858-d4b1-4e95-a3aa-789e00da1474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c377fe1d-1c49-46de-87e3-4a70f1253e63", "tag": "77c1695c-6c2d-450f-9b6b-5a55c9a1bf2f"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:47.506199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-a60a3a33-b347-4e74-861c-008fe28a39a5 req-614c0858-d4b1-4e95-a3aa-789e00da1474 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:47.506841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-a60a3a33-b347-4e74-861c-008fe28a39a5 req-614c0858-d4b1-4e95-a3aa-789e00da1474 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:47.543340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-a60a3a33-b347-4e74-861c-008fe28a39a5 req-614c0858-d4b1-4e95-a3aa-789e00da1474 service nova] Creating event network-changed:77c1695c-6c2d-450f-9b6b-5a55c9a1bf2f for instance c377fe1d-1c49-46de-87e3-4a70f1253e63 on hv-cinder-84753 Aug 01 15:34:47.550898 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bdf0c2e5-88eb-4558-8fc7-6c1db7150f2d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:47.551684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bdf0c2e5-88eb-4558-8fc7-6c1db7150f2d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:47.557387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-a60a3a33-b347-4e74-861c-008fe28a39a5 req-614c0858-d4b1-4e95-a3aa-789e00da1474 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076048 Aug 01 15:34:47.558409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 54/109] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:47.588026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bdf0c2e5-88eb-4558-8fc7-6c1db7150f2d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:47.590930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bdf0c2e5-88eb-4558-8fc7-6c1db7150f2d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:47.593498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bdf0c2e5-88eb-4558-8fc7-6c1db7150f2d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:47.595355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bdf0c2e5-88eb-4558-8fc7-6c1db7150f2d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:47.941184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bdf0c2e5-88eb-4558-8fc7-6c1db7150f2d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:47.953511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bdf0c2e5-88eb-4558-8fc7-6c1db7150f2d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:47.956182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bdf0c2e5-88eb-4558-8fc7-6c1db7150f2d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:47.957521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bdf0c2e5-88eb-4558-8fc7-6c1db7150f2d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.414955 Aug 01 15:34:47.972671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 56/110] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:34:47.979604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-779b240c-2a4c-4d7a-b7af-92a1e6eb9982 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:47.980603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-779b240c-2a4c-4d7a-b7af-92a1e6eb9982 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:47.992693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-779b240c-2a4c-4d7a-b7af-92a1e6eb9982 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:47.993519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-779b240c-2a4c-4d7a-b7af-92a1e6eb9982 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:47.994663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-779b240c-2a4c-4d7a-b7af-92a1e6eb9982 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:47.995420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-779b240c-2a4c-4d7a-b7af-92a1e6eb9982 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:48.072845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-5be82ef0-4bd2-4690-ad41-d40f158e3605 req-70c33659-e015-44b3-81c9-b6033442806e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df", "name": "network-vif-plugged", "status": "completed", "tag": "ce819b69-03c1-4584-9ef2-0228b13d3351"}, {"server_uuid": "df81c1c8-0ae0-44a5-8f89-b32d2396e056", "name": "network-vif-plugged", "status": "completed", "tag": "d51054b4-9bd5-4685-8e01-589ee8693546"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:48.123877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-5be82ef0-4bd2-4690-ad41-d40f158e3605 req-70c33659-e015-44b3-81c9-b6033442806e service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:48.126454 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-5be82ef0-4bd2-4690-ad41-d40f158e3605 req-70c33659-e015-44b3-81c9-b6033442806e service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:48.173821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-5be82ef0-4bd2-4690-ad41-d40f158e3605 req-70c33659-e015-44b3-81c9-b6033442806e service nova] Creating event network-vif-plugged:ce819b69-03c1-4584-9ef2-0228b13d3351 for instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df on hv-cinder-84753 Aug 01 15:34:48.176330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-5be82ef0-4bd2-4690-ad41-d40f158e3605 req-70c33659-e015-44b3-81c9-b6033442806e service nova] Creating event network-vif-plugged:d51054b4-9bd5-4685-8e01-589ee8693546 for instance df81c1c8-0ae0-44a5-8f89-b32d2396e056 on hv-cinder-84753 Aug 01 15:34:48.194791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-5be82ef0-4bd2-4690-ad41-d40f158e3605 req-70c33659-e015-44b3-81c9-b6033442806e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125248 Aug 01 15:34:48.197041 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 57/111] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:34:48.257229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-779b240c-2a4c-4d7a-b7af-92a1e6eb9982 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:48.273678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-779b240c-2a4c-4d7a-b7af-92a1e6eb9982 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1367 microversion: 2.1 time: 0.299505 Aug 01 15:34:48.274680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 55/112] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:47 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:48.331190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-21699f5f-aff6-4d3b-a457-4adfa3890b7a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:48.332054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-21699f5f-aff6-4d3b-a457-4adfa3890b7a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:48.347516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21699f5f-aff6-4d3b-a457-4adfa3890b7a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:48.347516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21699f5f-aff6-4d3b-a457-4adfa3890b7a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:48.347516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21699f5f-aff6-4d3b-a457-4adfa3890b7a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:48.347516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21699f5f-aff6-4d3b-a457-4adfa3890b7a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:48.591099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-70481b91-c5e4-447f-ab48-b1bc03e3e2ca tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7996cca1-5703-4fd1-8a7c-4922db99120f"}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:48.595433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-70481b91-c5e4-447f-ab48-b1bc03e3e2ca tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:48.602570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70481b91-c5e4-447f-ab48-b1bc03e3e2ca tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:48.603064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70481b91-c5e4-447f-ab48-b1bc03e3e2ca tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:48.603857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70481b91-c5e4-447f-ab48-b1bc03e3e2ca tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:48.604292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70481b91-c5e4-447f-ab48-b1bc03e3e2ca tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:48.727874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-21699f5f-aff6-4d3b-a457-4adfa3890b7a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:48.741565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-21699f5f-aff6-4d3b-a457-4adfa3890b7a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.414165 Aug 01 15:34:48.742652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 58/113] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:48 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:48.988268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8e116a33-79c5-4079-8df1-49d57fe11f90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:48.989040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8e116a33-79c5-4079-8df1-49d57fe11f90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:48.997247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e116a33-79c5-4079-8df1-49d57fe11f90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:48.998996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e116a33-79c5-4079-8df1-49d57fe11f90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:48.999900 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e116a33-79c5-4079-8df1-49d57fe11f90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:49.000488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e116a33-79c5-4079-8df1-49d57fe11f90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:49.393653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8e116a33-79c5-4079-8df1-49d57fe11f90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:49.408816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8e116a33-79c5-4079-8df1-49d57fe11f90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:49.412260 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8e116a33-79c5-4079-8df1-49d57fe11f90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:49.413717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8e116a33-79c5-4079-8df1-49d57fe11f90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.432431 Aug 01 15:34:49.414475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 59/114] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:34:49.420564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c84de17b-0436-493f-8fe8-6bc4c6190969 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:49.421186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c84de17b-0436-493f-8fe8-6bc4c6190969 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:49.436368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c84de17b-0436-493f-8fe8-6bc4c6190969 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:49.436841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c84de17b-0436-493f-8fe8-6bc4c6190969 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:49.437829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c84de17b-0436-493f-8fe8-6bc4c6190969 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:49.438321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c84de17b-0436-493f-8fe8-6bc4c6190969 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:49.745009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-70481b91-c5e4-447f-ab48-b1bc03e3e2ca tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "POST /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.160431 Aug 01 15:34:49.753635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 56/115] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 1 15:34:48 2022] POST /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae/os-volume_attachments => generated 194 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:34:49.777875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-626327b2-0e9e-42da-b7c7-9568f6d5d2bd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:49.779702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-626327b2-0e9e-42da-b7c7-9568f6d5d2bd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:49.793088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-626327b2-0e9e-42da-b7c7-9568f6d5d2bd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:49.793761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-626327b2-0e9e-42da-b7c7-9568f6d5d2bd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:49.794635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-626327b2-0e9e-42da-b7c7-9568f6d5d2bd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:49.795173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-626327b2-0e9e-42da-b7c7-9568f6d5d2bd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:49.957907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c84de17b-0436-493f-8fe8-6bc4c6190969 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:49.968442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c84de17b-0436-493f-8fe8-6bc4c6190969 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1557 microversion: 2.1 time: 0.552722 Aug 01 15:34:49.969025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 60/116] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1557 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:49.992081 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-03afdf2f-245b-483a-88ff-ce67e9c5ff85 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:49.992837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-03afdf2f-245b-483a-88ff-ce67e9c5ff85 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:50.001842 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03afdf2f-245b-483a-88ff-ce67e9c5ff85 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:50.002592 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03afdf2f-245b-483a-88ff-ce67e9c5ff85 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:50.003726 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03afdf2f-245b-483a-88ff-ce67e9c5ff85 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:50.004306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03afdf2f-245b-483a-88ff-ce67e9c5ff85 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:50.058007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-626327b2-0e9e-42da-b7c7-9568f6d5d2bd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:50.066829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-626327b2-0e9e-42da-b7c7-9568f6d5d2bd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.304023 Aug 01 15:34:50.069491 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 57/117] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:49 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:50.222272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-03afdf2f-245b-483a-88ff-ce67e9c5ff85 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.234734 Aug 01 15:34:50.223522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 61/118] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 1 15:34:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-interface => generated 284 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:34:50.436809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7586e4c8-f55a-4433-96bf-425574f40c09 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:50.437340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7586e4c8-f55a-4433-96bf-425574f40c09 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:50.443881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7586e4c8-f55a-4433-96bf-425574f40c09 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:50.444324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7586e4c8-f55a-4433-96bf-425574f40c09 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:50.449309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7586e4c8-f55a-4433-96bf-425574f40c09 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:50.449309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7586e4c8-f55a-4433-96bf-425574f40c09 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:50.627796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7586e4c8-f55a-4433-96bf-425574f40c09 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:50.637795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7586e4c8-f55a-4433-96bf-425574f40c09 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:50.640036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7586e4c8-f55a-4433-96bf-425574f40c09 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:50.641483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7586e4c8-f55a-4433-96bf-425574f40c09 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.208634 Aug 01 15:34:50.646140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 58/119] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:51.108617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-189093c2-b7eb-469b-93aa-a04317bc058a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:51.110083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-189093c2-b7eb-469b-93aa-a04317bc058a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:51.119071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-189093c2-b7eb-469b-93aa-a04317bc058a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:51.119750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-189093c2-b7eb-469b-93aa-a04317bc058a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:51.122391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-189093c2-b7eb-469b-93aa-a04317bc058a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:51.123610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-189093c2-b7eb-469b-93aa-a04317bc058a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:51.407344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-189093c2-b7eb-469b-93aa-a04317bc058a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:51.416080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-189093c2-b7eb-469b-93aa-a04317bc058a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.311573 Aug 01 15:34:51.417037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 62/120] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:51 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:51.672296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d35c810e-6277-4555-9e2a-76e6498edba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:51.672909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d35c810e-6277-4555-9e2a-76e6498edba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:51.681176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d35c810e-6277-4555-9e2a-76e6498edba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:51.681808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d35c810e-6277-4555-9e2a-76e6498edba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:51.682853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d35c810e-6277-4555-9e2a-76e6498edba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:51.683449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d35c810e-6277-4555-9e2a-76e6498edba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:51.763698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-5c9c231d-8cd3-4770-b9b6-e9c9a756b173 req-bf733dba-6068-4336-ab4a-94a0c3d5f79b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2122c9a8-db75-40b5-bbbe-9c83c983d961", "tag": "419fa20b-5321-45c3-bf43-01c4530aa3fc"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:51.780235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-5c9c231d-8cd3-4770-b9b6-e9c9a756b173 req-bf733dba-6068-4336-ab4a-94a0c3d5f79b service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:51.780993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-5c9c231d-8cd3-4770-b9b6-e9c9a756b173 req-bf733dba-6068-4336-ab4a-94a0c3d5f79b service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:51.800695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-5c9c231d-8cd3-4770-b9b6-e9c9a756b173 req-bf733dba-6068-4336-ab4a-94a0c3d5f79b service nova] Creating event network-changed:419fa20b-5321-45c3-bf43-01c4530aa3fc for instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 on hv-cinder-84753 Aug 01 15:34:51.814322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-5c9c231d-8cd3-4770-b9b6-e9c9a756b173 req-bf733dba-6068-4336-ab4a-94a0c3d5f79b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051479 Aug 01 15:34:51.815715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 63/121] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:51.905162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d35c810e-6277-4555-9e2a-76e6498edba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:51.936694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d35c810e-6277-4555-9e2a-76e6498edba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:51.942633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d35c810e-6277-4555-9e2a-76e6498edba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:51.946915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d35c810e-6277-4555-9e2a-76e6498edba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.277617 Aug 01 15:34:51.967557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 59/122] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:52.438818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-03726445-375f-4c21-85ee-46603dc9f7ff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:52.441007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-03726445-375f-4c21-85ee-46603dc9f7ff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:52.453850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03726445-375f-4c21-85ee-46603dc9f7ff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:52.454429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03726445-375f-4c21-85ee-46603dc9f7ff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:52.456384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03726445-375f-4c21-85ee-46603dc9f7ff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:52.456384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03726445-375f-4c21-85ee-46603dc9f7ff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:52.610104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-03726445-375f-4c21-85ee-46603dc9f7ff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:52.619292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-03726445-375f-4c21-85ee-46603dc9f7ff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.184836 Aug 01 15:34:52.619966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 64/123] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:52 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:52.976428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8b287d41-cd86-451f-bd02-e19ffe295cec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:52.976966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8b287d41-cd86-451f-bd02-e19ffe295cec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:52.981423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:52.994778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b287d41-cd86-451f-bd02-e19ffe295cec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:52.995233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b287d41-cd86-451f-bd02-e19ffe295cec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:52.996272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b287d41-cd86-451f-bd02-e19ffe295cec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:52.996840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b287d41-cd86-451f-bd02-e19ffe295cec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:53.447780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8b287d41-cd86-451f-bd02-e19ffe295cec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:53.465124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8b287d41-cd86-451f-bd02-e19ffe295cec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:53.466908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8b287d41-cd86-451f-bd02-e19ffe295cec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:53.468334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8b287d41-cd86-451f-bd02-e19ffe295cec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.498051 Aug 01 15:34:53.469423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 60/124] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:34:53.642705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-325d86ae-1856-4d01-96b6-9ac821135cb3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:53.643394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-325d86ae-1856-4d01-96b6-9ac821135cb3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:53.657433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-325d86ae-1856-4d01-96b6-9ac821135cb3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:53.658182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-325d86ae-1856-4d01-96b6-9ac821135cb3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:53.665098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-325d86ae-1856-4d01-96b6-9ac821135cb3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:53.665098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-325d86ae-1856-4d01-96b6-9ac821135cb3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:53.852651 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-325d86ae-1856-4d01-96b6-9ac821135cb3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:53.862448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-325d86ae-1856-4d01-96b6-9ac821135cb3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.225534 Aug 01 15:34:53.863031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 65/125] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:53 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:54.494063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2bfb1dc3-b694-4fbb-a946-8b9a0e5197ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:54.495245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2bfb1dc3-b694-4fbb-a946-8b9a0e5197ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:54.502719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bfb1dc3-b694-4fbb-a946-8b9a0e5197ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:54.503735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bfb1dc3-b694-4fbb-a946-8b9a0e5197ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:54.512179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bfb1dc3-b694-4fbb-a946-8b9a0e5197ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:54.513373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bfb1dc3-b694-4fbb-a946-8b9a0e5197ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:54.896012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c879c777-c95c-4b16-af17-538b7de01e02 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:54.897447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c879c777-c95c-4b16-af17-538b7de01e02 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:54.934119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c879c777-c95c-4b16-af17-538b7de01e02 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:54.935374 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c879c777-c95c-4b16-af17-538b7de01e02 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:54.963413 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c879c777-c95c-4b16-af17-538b7de01e02 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:54.964938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c879c777-c95c-4b16-af17-538b7de01e02 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:54.989092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2bfb1dc3-b694-4fbb-a946-8b9a0e5197ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:55.015853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2bfb1dc3-b694-4fbb-a946-8b9a0e5197ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:55.021362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2bfb1dc3-b694-4fbb-a946-8b9a0e5197ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:55.024937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2bfb1dc3-b694-4fbb-a946-8b9a0e5197ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1407 microversion: 2.20 time: 0.533943 Aug 01 15:34:55.027776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 61/126] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1407 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:55.315855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c879c777-c95c-4b16-af17-538b7de01e02 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:55.330096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c879c777-c95c-4b16-af17-538b7de01e02 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1321 microversion: 2.1 time: 0.448145 Aug 01 15:34:55.331284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 66/127] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:54 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:56.080239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-32a82402-3416-4965-9876-9da8490a05de tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:56.080834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-32a82402-3416-4965-9876-9da8490a05de tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:56.094219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32a82402-3416-4965-9876-9da8490a05de tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:56.094219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32a82402-3416-4965-9876-9da8490a05de tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:56.094219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32a82402-3416-4965-9876-9da8490a05de tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:56.094219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32a82402-3416-4965-9876-9da8490a05de tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:56.268910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-32a82402-3416-4965-9876-9da8490a05de tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:56.278150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-32a82402-3416-4965-9876-9da8490a05de tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:56.279886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-32a82402-3416-4965-9876-9da8490a05de tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:56.281167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-32a82402-3416-4965-9876-9da8490a05de tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1599 microversion: 2.20 time: 0.212739 Aug 01 15:34:56.298235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 62/128] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:34:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1599 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:34:56.306647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ee55be16-c07b-4e42-bfec-e3292c7db3cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:56.307473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ee55be16-c07b-4e42-bfec-e3292c7db3cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:56.314773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ee55be16-c07b-4e42-bfec-e3292c7db3cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:56.316291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ee55be16-c07b-4e42-bfec-e3292c7db3cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:56.317719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ee55be16-c07b-4e42-bfec-e3292c7db3cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:56.318155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ee55be16-c07b-4e42-bfec-e3292c7db3cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:56.353462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-351bc575-08ee-450a-b5db-2e876dd07676 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:56.354250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-351bc575-08ee-450a-b5db-2e876dd07676 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:56.360875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-351bc575-08ee-450a-b5db-2e876dd07676 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:56.361646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-351bc575-08ee-450a-b5db-2e876dd07676 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:56.362805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-351bc575-08ee-450a-b5db-2e876dd07676 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:56.363766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-351bc575-08ee-450a-b5db-2e876dd07676 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:56.416104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ee55be16-c07b-4e42-bfec-e3292c7db3cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.114709 Aug 01 15:34:56.416707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 67/129] 10.222.0.83 () {60 vars in 1316 bytes} [Mon Aug 1 15:34:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:34:56.932713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-351bc575-08ee-450a-b5db-2e876dd07676 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:56.942175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-351bc575-08ee-450a-b5db-2e876dd07676 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1516 microversion: 2.1 time: 0.592906 Aug 01 15:34:56.943064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 63/130] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:56 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1516 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:34:56.967159 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c2d7572c-72f9-4373-af92-8df4ba2f559b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:56.969570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c2d7572c-72f9-4373-af92-8df4ba2f559b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:56.977325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2d7572c-72f9-4373-af92-8df4ba2f559b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:56.977958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2d7572c-72f9-4373-af92-8df4ba2f559b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:56.978768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2d7572c-72f9-4373-af92-8df4ba2f559b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:56.979198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2d7572c-72f9-4373-af92-8df4ba2f559b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:57.006345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-c2d7572c-72f9-4373-af92-8df4ba2f559b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lazy-loading 'flavor' on Instance uuid df81c1c8-0ae0-44a5-8f89-b32d2396e056 {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:34:57.212164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c2d7572c-72f9-4373-af92-8df4ba2f559b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "POST /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056/action" status: 200 len: 32 microversion: 2.1 time: 0.249795 Aug 01 15:34:57.220467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 68/131] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 1 15:34:56 2022] POST /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 15:34:57.225530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9891764a-6167-4670-8dc4-9464284b3bd7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:57.226420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9891764a-6167-4670-8dc4-9464284b3bd7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:57.236090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9891764a-6167-4670-8dc4-9464284b3bd7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:57.238417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9891764a-6167-4670-8dc4-9464284b3bd7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:57.239564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9891764a-6167-4670-8dc4-9464284b3bd7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:57.240422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9891764a-6167-4670-8dc4-9464284b3bd7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:57.245494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:57.864591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1532646566", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "networks": [{"uuid": "7849e2a3-fcaa-49de-9f64-6e6d8840c666"}]}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:57.947462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.network.neutron [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] validate_networks() for [('7849e2a3-fcaa-49de-9f64-6e6d8840c666', None, None, None, None, None)] {{(pid=124527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:34:58.166809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9891764a-6167-4670-8dc4-9464284b3bd7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:58.183576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9891764a-6167-4670-8dc4-9464284b3bd7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.961789 Aug 01 15:34:58.194493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 64/132] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:57 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:34:59.191539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Flavor limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:34:59.192767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Image limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:34:59.193255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Flavor pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:34:59.193665 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Image pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:34:59.194449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:34:59.198412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=90 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:59.208239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:59.209511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:59.210715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:59.211392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:59.213499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eb78262c-49ee-48b0-8fd1-ffa16af0b1f3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:59.214963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eb78262c-49ee-48b0-8fd1-ffa16af0b1f3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:59.228626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb78262c-49ee-48b0-8fd1-ffa16af0b1f3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:59.231896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb78262c-49ee-48b0-8fd1-ffa16af0b1f3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:59.232303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Getting quotas for project 8454f4c13e654ee58e6ff6265b7b85f9. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:34:59.233816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb78262c-49ee-48b0-8fd1-ffa16af0b1f3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:59.234643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb78262c-49ee-48b0-8fd1-ffa16af0b1f3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:59.239650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Getting quotas for user c6591fd1ff63406c86b847870570e56c and project 8454f4c13e654ee58e6ff6265b7b85f9. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:34:59.258834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Going to run 1 instances... {{(pid=124527) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:34:59.261368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:34:59.358241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-efd88ddf-dab5-4331-8a80-7ae220c6d196 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.497508 Aug 01 15:34:59.360173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 69/133] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:34:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 15:34:59.373535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e20b38b7-3d79-4fd8-991a-6a9058b002a5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:59.375157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e20b38b7-3d79-4fd8-991a-6a9058b002a5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:59.567811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e20b38b7-3d79-4fd8-991a-6a9058b002a5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:59.594847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e20b38b7-3d79-4fd8-991a-6a9058b002a5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1214 microversion: 2.1 time: 0.220360 Aug 01 15:34:59.596684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 70/134] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:59 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1214 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:34:59.934692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-1bdb5325-b35a-4846-ab5b-c6f78228d8bb req-2a66ec5c-1826-4047-8175-0ee243b09b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df", "tag": "ce819b69-03c1-4584-9ef2-0228b13d3351"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:59.954954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-1bdb5325-b35a-4846-ab5b-c6f78228d8bb req-2a66ec5c-1826-4047-8175-0ee243b09b3c service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:59.956774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-1bdb5325-b35a-4846-ab5b-c6f78228d8bb req-2a66ec5c-1826-4047-8175-0ee243b09b3c service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:59.979997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-1bdb5325-b35a-4846-ab5b-c6f78228d8bb req-2a66ec5c-1826-4047-8175-0ee243b09b3c service nova] Creating event network-changed:ce819b69-03c1-4584-9ef2-0228b13d3351 for instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df on hv-cinder-84753 Aug 01 15:35:00.002724 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-1bdb5325-b35a-4846-ab5b-c6f78228d8bb req-2a66ec5c-1826-4047-8175-0ee243b09b3c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072202 Aug 01 15:35:00.004307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eb78262c-49ee-48b0-8fd1-ffa16af0b1f3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:00.008873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 71/135] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:35:00.016766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eb78262c-49ee-48b0-8fd1-ffa16af0b1f3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.812381 Aug 01 15:35:00.017524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 65/136] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:59 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:00.617597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-da8f378d-d73b-4f6b-85b3-1f593ce05d3e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:00.619139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-da8f378d-d73b-4f6b-85b3-1f593ce05d3e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:00.629848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da8f378d-d73b-4f6b-85b3-1f593ce05d3e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:00.630338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da8f378d-d73b-4f6b-85b3-1f593ce05d3e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:00.631195 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da8f378d-d73b-4f6b-85b3-1f593ce05d3e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:00.632235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da8f378d-d73b-4f6b-85b3-1f593ce05d3e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:00.715788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-da8f378d-d73b-4f6b-85b3-1f593ce05d3e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:00.724389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-da8f378d-d73b-4f6b-85b3-1f593ce05d3e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1266 microversion: 2.1 time: 0.111279 Aug 01 15:35:00.724967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 72/137] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:00 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:01.067229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b9410bbd-a44b-4564-b12e-2d087e6ef520 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:01.071921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b9410bbd-a44b-4564-b12e-2d087e6ef520 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:01.088308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b9410bbd-a44b-4564-b12e-2d087e6ef520 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:01.089107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b9410bbd-a44b-4564-b12e-2d087e6ef520 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:01.091780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b9410bbd-a44b-4564-b12e-2d087e6ef520 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:01.092443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b9410bbd-a44b-4564-b12e-2d087e6ef520 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:01.461067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b9410bbd-a44b-4564-b12e-2d087e6ef520 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:01.469191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b9410bbd-a44b-4564-b12e-2d087e6ef520 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.417092 Aug 01 15:35:01.469917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 66/138] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:01 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:01.749728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-04ef3713-e275-4210-9bea-7540de75752b tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:01.751146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-04ef3713-e275-4210-9bea-7540de75752b tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:01.762855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04ef3713-e275-4210-9bea-7540de75752b tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:01.763568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04ef3713-e275-4210-9bea-7540de75752b tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:01.764822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04ef3713-e275-4210-9bea-7540de75752b tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:01.765412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04ef3713-e275-4210-9bea-7540de75752b tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:01.841257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-04ef3713-e275-4210-9bea-7540de75752b tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:01.850033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-04ef3713-e275-4210-9bea-7540de75752b tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1272 microversion: 2.1 time: 0.107717 Aug 01 15:35:01.850654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 73/139] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:01 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:02.494882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2fe70b6c-3d7c-4ec0-aef6-ee029dcd45e8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:02.495695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2fe70b6c-3d7c-4ec0-aef6-ee029dcd45e8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:02.504565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2fe70b6c-3d7c-4ec0-aef6-ee029dcd45e8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:02.505106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2fe70b6c-3d7c-4ec0-aef6-ee029dcd45e8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:02.506006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2fe70b6c-3d7c-4ec0-aef6-ee029dcd45e8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:02.506440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2fe70b6c-3d7c-4ec0-aef6-ee029dcd45e8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:02.656372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2fe70b6c-3d7c-4ec0-aef6-ee029dcd45e8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:02.664607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2fe70b6c-3d7c-4ec0-aef6-ee029dcd45e8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.175057 Aug 01 15:35:02.665516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 67/140] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:02 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:02.872536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ac7dd2fa-03c5-44da-9a43-c76a09e677f1 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:02.873165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ac7dd2fa-03c5-44da-9a43-c76a09e677f1 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:02.879453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac7dd2fa-03c5-44da-9a43-c76a09e677f1 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:02.879902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac7dd2fa-03c5-44da-9a43-c76a09e677f1 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:02.881467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac7dd2fa-03c5-44da-9a43-c76a09e677f1 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:02.881467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac7dd2fa-03c5-44da-9a43-c76a09e677f1 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:02.885593 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:03.022265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ac7dd2fa-03c5-44da-9a43-c76a09e677f1 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:03.030259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ac7dd2fa-03c5-44da-9a43-c76a09e677f1 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1314 microversion: 2.1 time: 0.161740 Aug 01 15:35:03.030848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 74/141] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:02 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:03.687008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8423ad64-1b85-4f0e-a2e7-020a577d8e4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:03.687617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8423ad64-1b85-4f0e-a2e7-020a577d8e4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:03.694284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8423ad64-1b85-4f0e-a2e7-020a577d8e4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:03.694914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8423ad64-1b85-4f0e-a2e7-020a577d8e4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:03.695699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8423ad64-1b85-4f0e-a2e7-020a577d8e4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:03.696266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8423ad64-1b85-4f0e-a2e7-020a577d8e4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:03.888954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8423ad64-1b85-4f0e-a2e7-020a577d8e4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:03.899912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8423ad64-1b85-4f0e-a2e7-020a577d8e4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.217186 Aug 01 15:35:03.900654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 68/142] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:03 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:04.053712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bed2a8d0-fd5b-45bd-b7ae-edeba1fb4ce5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:04.054530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bed2a8d0-fd5b-45bd-b7ae-edeba1fb4ce5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:04.064277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bed2a8d0-fd5b-45bd-b7ae-edeba1fb4ce5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:04.066354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bed2a8d0-fd5b-45bd-b7ae-edeba1fb4ce5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:04.068743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bed2a8d0-fd5b-45bd-b7ae-edeba1fb4ce5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:04.069224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bed2a8d0-fd5b-45bd-b7ae-edeba1fb4ce5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:04.293768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bed2a8d0-fd5b-45bd-b7ae-edeba1fb4ce5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:04.302177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bed2a8d0-fd5b-45bd-b7ae-edeba1fb4ce5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1314 microversion: 2.1 time: 0.254500 Aug 01 15:35:04.303092 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 75/143] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:04 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:04.564024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-6cebf3b2-5a94-4cf3-82cc-e1b221012437 req-3d5d6cea-0c21-4530-a025-d4cfc05f77ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2afa471-7b66-4e1b-b701-67be7188cdf1", "tag": "dd8da22e-4350-417f-b45c-f4571d92dfd8"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:04.574029 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-6cebf3b2-5a94-4cf3-82cc-e1b221012437 req-3d5d6cea-0c21-4530-a025-d4cfc05f77ab service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:04.574486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-6cebf3b2-5a94-4cf3-82cc-e1b221012437 req-3d5d6cea-0c21-4530-a025-d4cfc05f77ab service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:04.588505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-6cebf3b2-5a94-4cf3-82cc-e1b221012437 req-3d5d6cea-0c21-4530-a025-d4cfc05f77ab service nova] Creating event network-changed:dd8da22e-4350-417f-b45c-f4571d92dfd8 for instance c2afa471-7b66-4e1b-b701-67be7188cdf1 on hv-cinder-84753 Aug 01 15:35:04.594557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-6cebf3b2-5a94-4cf3-82cc-e1b221012437 req-3d5d6cea-0c21-4530-a025-d4cfc05f77ab service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035268 Aug 01 15:35:04.595153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 69/144] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:35:04.922985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-69c5a40d-d069-41ef-9f53-a2e83d9efeff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:04.923693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-69c5a40d-d069-41ef-9f53-a2e83d9efeff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:04.931039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-69c5a40d-d069-41ef-9f53-a2e83d9efeff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:04.931740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-69c5a40d-d069-41ef-9f53-a2e83d9efeff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:04.932596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-69c5a40d-d069-41ef-9f53-a2e83d9efeff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:04.933155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-69c5a40d-d069-41ef-9f53-a2e83d9efeff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:05.110912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-69c5a40d-d069-41ef-9f53-a2e83d9efeff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:05.118555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-69c5a40d-d069-41ef-9f53-a2e83d9efeff tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.199934 Aug 01 15:35:05.119134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 76/145] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:04 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:05.268573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f5bab9ec-c550-4482-8fda-499f2bd91045 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:05.269193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f5bab9ec-c550-4482-8fda-499f2bd91045 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:05.275812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f5bab9ec-c550-4482-8fda-499f2bd91045 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:05.276264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f5bab9ec-c550-4482-8fda-499f2bd91045 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:05.277033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f5bab9ec-c550-4482-8fda-499f2bd91045 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:05.277471 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f5bab9ec-c550-4482-8fda-499f2bd91045 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:05.304133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f5bab9ec-c550-4482-8fda-499f2bd91045 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:35:05.325655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-13b6d6fe-e607-4540-b31f-7d1895c41300 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:05.326303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-13b6d6fe-e607-4540-b31f-7d1895c41300 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:05.333319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13b6d6fe-e607-4540-b31f-7d1895c41300 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:05.333782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13b6d6fe-e607-4540-b31f-7d1895c41300 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:05.334938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13b6d6fe-e607-4540-b31f-7d1895c41300 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:05.335369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13b6d6fe-e607-4540-b31f-7d1895c41300 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:05.411211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f5bab9ec-c550-4482-8fda-499f2bd91045 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 204 len: 0 microversion: 2.1 time: 0.147361 Aug 01 15:35:05.411894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 70/146] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 15:35:05 2022] DELETE /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:05.424120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5b68bbdf-9099-42e0-9517-1d7e269ccd63 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:05.424854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5b68bbdf-9099-42e0-9517-1d7e269ccd63 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:05.434837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b68bbdf-9099-42e0-9517-1d7e269ccd63 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:05.435050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b68bbdf-9099-42e0-9517-1d7e269ccd63 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:05.436151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b68bbdf-9099-42e0-9517-1d7e269ccd63 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:05.436616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b68bbdf-9099-42e0-9517-1d7e269ccd63 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:05.527887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-13b6d6fe-e607-4540-b31f-7d1895c41300 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:05.539165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-13b6d6fe-e607-4540-b31f-7d1895c41300 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1314 microversion: 2.1 time: 0.218660 Aug 01 15:35:05.539867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 77/147] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:05 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:05.597236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5b68bbdf-9099-42e0-9517-1d7e269ccd63 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:05.606055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5b68bbdf-9099-42e0-9517-1d7e269ccd63 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1554 microversion: 2.1 time: 0.187860 Aug 01 15:35:05.606646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 71/148] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:05 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:06.142606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e35506bb-64d3-4c82-b18e-bc074e2561f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:06.143240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e35506bb-64d3-4c82-b18e-bc074e2561f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:06.152831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e35506bb-64d3-4c82-b18e-bc074e2561f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:06.153655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e35506bb-64d3-4c82-b18e-bc074e2561f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:06.154245 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e35506bb-64d3-4c82-b18e-bc074e2561f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:06.154891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e35506bb-64d3-4c82-b18e-bc074e2561f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:06.301724 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e35506bb-64d3-4c82-b18e-bc074e2561f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:06.310426 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e35506bb-64d3-4c82-b18e-bc074e2561f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.172276 Aug 01 15:35:06.310994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 78/149] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:06 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:06.564886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d56aee16-9972-44c5-b691-3a95e9d0aab8 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:06.566097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d56aee16-9972-44c5-b691-3a95e9d0aab8 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:06.574792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d56aee16-9972-44c5-b691-3a95e9d0aab8 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:06.576054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d56aee16-9972-44c5-b691-3a95e9d0aab8 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:06.576990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d56aee16-9972-44c5-b691-3a95e9d0aab8 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:06.577642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d56aee16-9972-44c5-b691-3a95e9d0aab8 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:06.629472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c1a9bf7f-e93b-4183-aa65-c281694404ec tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:06.630143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c1a9bf7f-e93b-4183-aa65-c281694404ec tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:06.645706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1a9bf7f-e93b-4183-aa65-c281694404ec tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:06.646324 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1a9bf7f-e93b-4183-aa65-c281694404ec tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:06.647185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1a9bf7f-e93b-4183-aa65-c281694404ec tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:06.647798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1a9bf7f-e93b-4183-aa65-c281694404ec tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:06.772555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d56aee16-9972-44c5-b691-3a95e9d0aab8 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:06.782991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d56aee16-9972-44c5-b691-3a95e9d0aab8 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1314 microversion: 2.1 time: 0.225855 Aug 01 15:35:06.783576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 72/150] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:06 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:06.843656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c1a9bf7f-e93b-4183-aa65-c281694404ec tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:06.852964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c1a9bf7f-e93b-4183-aa65-c281694404ec tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1554 microversion: 2.1 time: 0.227506 Aug 01 15:35:06.853533 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 79/151] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:06 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:07.332920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d72bdcf7-d2f1-4614-b561-475892dd0a19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:07.333531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d72bdcf7-d2f1-4614-b561-475892dd0a19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:07.343277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d72bdcf7-d2f1-4614-b561-475892dd0a19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:07.343883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d72bdcf7-d2f1-4614-b561-475892dd0a19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:07.344763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d72bdcf7-d2f1-4614-b561-475892dd0a19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:07.345103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d72bdcf7-d2f1-4614-b561-475892dd0a19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:07.541987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d72bdcf7-d2f1-4614-b561-475892dd0a19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:07.552231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d72bdcf7-d2f1-4614-b561-475892dd0a19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.223787 Aug 01 15:35:07.553194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 73/152] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:07 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:07.814633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7124c670-d786-429c-8075-b9443777a99a tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:07.816035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7124c670-d786-429c-8075-b9443777a99a tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:07.822382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7124c670-d786-429c-8075-b9443777a99a tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:07.822829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7124c670-d786-429c-8075-b9443777a99a tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:07.823607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7124c670-d786-429c-8075-b9443777a99a tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:07.824042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7124c670-d786-429c-8075-b9443777a99a tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:07.874063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2bcc21f7-7971-451e-a2ac-ba0fe05d9dc4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:07.874688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2bcc21f7-7971-451e-a2ac-ba0fe05d9dc4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:07.881571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bcc21f7-7971-451e-a2ac-ba0fe05d9dc4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:07.882054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bcc21f7-7971-451e-a2ac-ba0fe05d9dc4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:07.882864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bcc21f7-7971-451e-a2ac-ba0fe05d9dc4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:07.883505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bcc21f7-7971-451e-a2ac-ba0fe05d9dc4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:08.028128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7124c670-d786-429c-8075-b9443777a99a tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:08.039576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7124c670-d786-429c-8075-b9443777a99a tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1314 microversion: 2.1 time: 0.229024 Aug 01 15:35:08.040165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 80/153] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:07 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:08.081426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2bcc21f7-7971-451e-a2ac-ba0fe05d9dc4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:08.090869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2bcc21f7-7971-451e-a2ac-ba0fe05d9dc4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1554 microversion: 2.1 time: 0.220622 Aug 01 15:35:08.092010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 74/154] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:07 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1554 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:08.573969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0929fe43-aff3-4a96-94e4-07c531710dd8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:08.574585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0929fe43-aff3-4a96-94e4-07c531710dd8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:08.581180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0929fe43-aff3-4a96-94e4-07c531710dd8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:08.581637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0929fe43-aff3-4a96-94e4-07c531710dd8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:08.582436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0929fe43-aff3-4a96-94e4-07c531710dd8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:08.582868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0929fe43-aff3-4a96-94e4-07c531710dd8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:08.726473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0929fe43-aff3-4a96-94e4-07c531710dd8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:08.735923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0929fe43-aff3-4a96-94e4-07c531710dd8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.165756 Aug 01 15:35:08.736534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 81/155] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:08 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:09.071230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ce65f4c5-2077-4ecd-9e01-af191bf4bb43 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:09.072452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ce65f4c5-2077-4ecd-9e01-af191bf4bb43 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:09.080112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce65f4c5-2077-4ecd-9e01-af191bf4bb43 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:09.080555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce65f4c5-2077-4ecd-9e01-af191bf4bb43 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:09.081371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce65f4c5-2077-4ecd-9e01-af191bf4bb43 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:09.081799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce65f4c5-2077-4ecd-9e01-af191bf4bb43 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:09.114691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-001c2a7c-bcab-4bfd-9609-688db5c7d899 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:09.115304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-001c2a7c-bcab-4bfd-9609-688db5c7d899 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:09.121878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-001c2a7c-bcab-4bfd-9609-688db5c7d899 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:09.123136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-001c2a7c-bcab-4bfd-9609-688db5c7d899 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:09.123925 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-001c2a7c-bcab-4bfd-9609-688db5c7d899 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:09.124531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-001c2a7c-bcab-4bfd-9609-688db5c7d899 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:09.222930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=2 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:09.401070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ce65f4c5-2077-4ecd-9e01-af191bf4bb43 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:09.410055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ce65f4c5-2077-4ecd-9e01-af191bf4bb43 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1314 microversion: 2.1 time: 0.342800 Aug 01 15:35:09.417938 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 75/156] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:09 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:09.420472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-001c2a7c-bcab-4bfd-9609-688db5c7d899 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:09.430244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-001c2a7c-bcab-4bfd-9609-688db5c7d899 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1554 microversion: 2.1 time: 0.319572 Aug 01 15:35:09.430936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 82/157] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:09 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1554 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:09.757277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-44062ce1-1616-4897-9517-d8ab36dc451f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:09.758041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-44062ce1-1616-4897-9517-d8ab36dc451f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:09.766161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-44062ce1-1616-4897-9517-d8ab36dc451f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:09.766573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-44062ce1-1616-4897-9517-d8ab36dc451f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:09.767344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-44062ce1-1616-4897-9517-d8ab36dc451f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:09.767771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-44062ce1-1616-4897-9517-d8ab36dc451f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:10.230873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-44062ce1-1616-4897-9517-d8ab36dc451f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:10.239330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-44062ce1-1616-4897-9517-d8ab36dc451f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.486390 Aug 01 15:35:10.239921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 76/158] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:09 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:10.431375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-61869385-9a00-45c8-b076-40a795330213 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:10.432088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-61869385-9a00-45c8-b076-40a795330213 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:10.433852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=8 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:10.443244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-61869385-9a00-45c8-b076-40a795330213 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:10.443694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-61869385-9a00-45c8-b076-40a795330213 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:10.444479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-61869385-9a00-45c8-b076-40a795330213 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:10.444902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-61869385-9a00-45c8-b076-40a795330213 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:10.453522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cce89afb-ff18-4b80-b22b-a5234089b5d6 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:10.454154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cce89afb-ff18-4b80-b22b-a5234089b5d6 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:10.460511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cce89afb-ff18-4b80-b22b-a5234089b5d6 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:10.460962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cce89afb-ff18-4b80-b22b-a5234089b5d6 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:10.461740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cce89afb-ff18-4b80-b22b-a5234089b5d6 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:10.462232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cce89afb-ff18-4b80-b22b-a5234089b5d6 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:10.825228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-61869385-9a00-45c8-b076-40a795330213 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:10.837062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-61869385-9a00-45c8-b076-40a795330213 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1314 microversion: 2.1 time: 0.409385 Aug 01 15:35:10.837650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 83/159] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:10 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:10.893521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cce89afb-ff18-4b80-b22b-a5234089b5d6 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:10.902479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cce89afb-ff18-4b80-b22b-a5234089b5d6 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1554 microversion: 2.1 time: 0.453311 Aug 01 15:35:10.903399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 77/160] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:10 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1554 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:11.131259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-19a78fed-11f3-4f33-bc62-1b383ad8f78c req-c9a837cd-08ad-4406-a82e-529a09044a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae", "name": "network-vif-deleted", "tag": "cde27741-df9b-464c-a305-158d6606aed8"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:11.144027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-19a78fed-11f3-4f33-bc62-1b383ad8f78c req-c9a837cd-08ad-4406-a82e-529a09044a7f service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:11.144476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-19a78fed-11f3-4f33-bc62-1b383ad8f78c req-c9a837cd-08ad-4406-a82e-529a09044a7f service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:11.161219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-19a78fed-11f3-4f33-bc62-1b383ad8f78c req-c9a837cd-08ad-4406-a82e-529a09044a7f service nova] Creating event network-vif-deleted:cde27741-df9b-464c-a305-158d6606aed8 for instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae on hv-cinder-84753 Aug 01 15:35:11.167920 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-19a78fed-11f3-4f33-bc62-1b383ad8f78c req-c9a837cd-08ad-4406-a82e-529a09044a7f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045665 Aug 01 15:35:11.170043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 84/161] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:35:11.262297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-22660c73-2ba4-49ff-9f68-6f8804bf6e76 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:11.262957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-22660c73-2ba4-49ff-9f68-6f8804bf6e76 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:11.272078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-22660c73-2ba4-49ff-9f68-6f8804bf6e76 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:11.272555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-22660c73-2ba4-49ff-9f68-6f8804bf6e76 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:11.273340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-22660c73-2ba4-49ff-9f68-6f8804bf6e76 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:11.273781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-22660c73-2ba4-49ff-9f68-6f8804bf6e76 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:11.415292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-22660c73-2ba4-49ff-9f68-6f8804bf6e76 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:11.423968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-22660c73-2ba4-49ff-9f68-6f8804bf6e76 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.165440 Aug 01 15:35:11.424546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 78/162] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:11 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:11.862055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4fce9fac-9447-44d8-815a-535d47f64dbf tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:11.865086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4fce9fac-9447-44d8-815a-535d47f64dbf tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:11.875876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4fce9fac-9447-44d8-815a-535d47f64dbf tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:11.876982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4fce9fac-9447-44d8-815a-535d47f64dbf tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:11.878376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4fce9fac-9447-44d8-815a-535d47f64dbf tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:11.878969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4fce9fac-9447-44d8-815a-535d47f64dbf tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:11.924647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-999dfaed-8a9e-4b66-8a34-3dbf6433d536 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:11.925488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-999dfaed-8a9e-4b66-8a34-3dbf6433d536 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:11.935936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-999dfaed-8a9e-4b66-8a34-3dbf6433d536 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:11.936627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-999dfaed-8a9e-4b66-8a34-3dbf6433d536 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:11.937585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-999dfaed-8a9e-4b66-8a34-3dbf6433d536 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:11.938209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-999dfaed-8a9e-4b66-8a34-3dbf6433d536 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:11.977857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-999dfaed-8a9e-4b66-8a34-3dbf6433d536 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:11.978289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-999dfaed-8a9e-4b66-8a34-3dbf6433d536 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:11.978941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.objects.instance [None req-999dfaed-8a9e-4b66-8a34-3dbf6433d536 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lazy-loading 'fault' on Instance uuid c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae {{(pid=124526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:35:11.981107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:12.066181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-999dfaed-8a9e-4b66-8a34-3dbf6433d536 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d9c30b18a4150aa0bc7a1705551d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db84eff445df4738a5fccb348fe9afeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:12.082817 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-999dfaed-8a9e-4b66-8a34-3dbf6433d536 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 200 len: 1351 microversion: 2.1 time: 0.161897 Aug 01 15:35:12.083749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 79/163] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:11 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 1351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:12.089155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-cb64b299-ab25-4ed2-bbe4-2aa585aa354b req-83e18087-ae30-4c75-91c4-5345eda5fc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2afa471-7b66-4e1b-b701-67be7188cdf1", "name": "network-vif-plugged", "status": "completed", "tag": "dd8da22e-4350-417f-b45c-f4571d92dfd8"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:12.097217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4fce9fac-9447-44d8-815a-535d47f64dbf tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:12.100719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-cb64b299-ab25-4ed2-bbe4-2aa585aa354b req-83e18087-ae30-4c75-91c4-5345eda5fc4f service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:12.101338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-cb64b299-ab25-4ed2-bbe4-2aa585aa354b req-83e18087-ae30-4c75-91c4-5345eda5fc4f service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:12.116185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-cb64b299-ab25-4ed2-bbe4-2aa585aa354b req-83e18087-ae30-4c75-91c4-5345eda5fc4f service nova] Creating event network-vif-plugged:dd8da22e-4350-417f-b45c-f4571d92dfd8 for instance c2afa471-7b66-4e1b-b701-67be7188cdf1 on hv-cinder-84753 Aug 01 15:35:12.117081 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4fce9fac-9447-44d8-815a-535d47f64dbf tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1314 microversion: 2.1 time: 0.262722 Aug 01 15:35:12.120267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 85/164] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:11 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:12.133000 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-cb64b299-ab25-4ed2-bbe4-2aa585aa354b req-83e18087-ae30-4c75-91c4-5345eda5fc4f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047750 Aug 01 15:35:12.134136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 80/165] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:35:12.444633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8655604f-8fdf-4c51-9a7a-a3b87269ce56 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:12.445562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8655604f-8fdf-4c51-9a7a-a3b87269ce56 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:12.451857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8655604f-8fdf-4c51-9a7a-a3b87269ce56 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:12.452309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8655604f-8fdf-4c51-9a7a-a3b87269ce56 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:12.453084 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8655604f-8fdf-4c51-9a7a-a3b87269ce56 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:12.453524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8655604f-8fdf-4c51-9a7a-a3b87269ce56 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:12.596688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8655604f-8fdf-4c51-9a7a-a3b87269ce56 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:12.604526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8655604f-8fdf-4c51-9a7a-a3b87269ce56 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.163664 Aug 01 15:35:12.605091 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 86/166] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:12 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:13.104987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f07f6fc4-dcef-433d-89d4-f67c8c7206bc tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:13.105677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f07f6fc4-dcef-433d-89d4-f67c8c7206bc tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:13.112722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f07f6fc4-dcef-433d-89d4-f67c8c7206bc tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:13.113191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f07f6fc4-dcef-433d-89d4-f67c8c7206bc tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:13.113977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f07f6fc4-dcef-433d-89d4-f67c8c7206bc tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:13.114457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f07f6fc4-dcef-433d-89d4-f67c8c7206bc tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:13.128830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-f07f6fc4-dcef-433d-89d4-f67c8c7206bc tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] HTTP exception thrown: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f07f6fc4-dcef-433d-89d4-f67c8c7206bc tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Request method failure captured: Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae HTTP/1.1 Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_JoTLKXZERQBhivjHEOVPcdz2I7S9_eaQ-OUqL3PC_Drl7EvZf3M_dKn3cbfVKUeYCcA0ObxUXYgbBDJ_p81-FThUj52a7SECxyex8jBrfPJ-uq2ecEOkeyxJeB8Ce6qFAHZkaMLhE5iHun3YHD1Gn_TIwbnFg47xKlTK_KxnQmOcQ Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: db84eff445df4738a5fccb348fe9afeb Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-DeleteServersTestJSON-1362476416 Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 15:35:13.133459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 15:35:13.135054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/db84eff445df4738a5fccb348fe9afeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/db84eff445df4738a5fccb348fe9afeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_db84eff445df4738a5fccb348fe9afeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/db84eff445df4738a5fccb348fe9afeb"}]}] Aug 01 15:35:13.135054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-DeleteServersTestJSON-1362476416 Aug 01 15:35:13.135054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: db84eff445df4738a5fccb348fe9afeb Aug 01 15:35:13.135054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-DeleteServersTestJSON-1362476416 Aug 01 15:35:13.135054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-DeleteServersTestJSON-1362476416-project Aug 01 15:35:13.135054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 15:35:13.135054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 15:35:13.135054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: c07d9c30b18a4150aa0bc7a1705551d7 Aug 01 15:35:13.135054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-DeleteServersTestJSON-1362476416-project Aug 01 15:35:13.135054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 15:35:13.135054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:13.135054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': 'c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae'} Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:13.135841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:13.137098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:13.138320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f07f6fc4-dcef-433d-89d4-f67c8c7206bc tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Returning 404 to user: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:13.138320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f07f6fc4-dcef-433d-89d4-f67c8c7206bc tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 404 len: 111 microversion: 2.1 time: 0.034621 Aug 01 15:35:13.138320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 81/167] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:13 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:35:13.143640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2b4b742d-ca71-4faa-873c-0bc6ead1e604 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:13.144273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2b4b742d-ca71-4faa-873c-0bc6ead1e604 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:13.150453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b4b742d-ca71-4faa-873c-0bc6ead1e604 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:13.150906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b4b742d-ca71-4faa-873c-0bc6ead1e604 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:13.151673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b4b742d-ca71-4faa-873c-0bc6ead1e604 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:13.152106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b4b742d-ca71-4faa-873c-0bc6ead1e604 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:13.250322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c5d3b10b-f563-4fd3-92fc-3b544811f880 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:13.253510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c5d3b10b-f563-4fd3-92fc-3b544811f880 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:13.261501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5d3b10b-f563-4fd3-92fc-3b544811f880 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:13.261971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5d3b10b-f563-4fd3-92fc-3b544811f880 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:13.263330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5d3b10b-f563-4fd3-92fc-3b544811f880 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:13.264163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5d3b10b-f563-4fd3-92fc-3b544811f880 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:13.280176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-c5d3b10b-f563-4fd3-92fc-3b544811f880 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] HTTP exception thrown: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c5d3b10b-f563-4fd3-92fc-3b544811f880 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Request method failure captured: Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae/os-volume_attachments HTTP/1.1 Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_JoTLKXZERQBhivjHEOVPcdz2I7S9_eaQ-OUqL3PC_Drl7EvZf3M_dKn3cbfVKUeYCcA0ObxUXYgbBDJ_p81-FThUj52a7SECxyex8jBrfPJ-uq2ecEOkeyxJeB8Ce6qFAHZkaMLhE5iHun3YHD1Gn_TIwbnFg47xKlTK_KxnQmOcQ Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: db84eff445df4738a5fccb348fe9afeb Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-DeleteServersTestJSON-1362476416 Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 15:35:13.282112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 15:35:13.283294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/db84eff445df4738a5fccb348fe9afeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/db84eff445df4738a5fccb348fe9afeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_db84eff445df4738a5fccb348fe9afeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/db84eff445df4738a5fccb348fe9afeb"}]}] Aug 01 15:35:13.283294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-DeleteServersTestJSON-1362476416 Aug 01 15:35:13.283294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: db84eff445df4738a5fccb348fe9afeb Aug 01 15:35:13.283294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-DeleteServersTestJSON-1362476416 Aug 01 15:35:13.283294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-DeleteServersTestJSON-1362476416-project Aug 01 15:35:13.283294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 15:35:13.283294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 15:35:13.283294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: c07d9c30b18a4150aa0bc7a1705551d7 Aug 01 15:35:13.283294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-DeleteServersTestJSON-1362476416-project Aug 01 15:35:13.283294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 15:35:13.283294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:13.283294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'server_id': 'c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae'} Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:13.283993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:13.285055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:13.286351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c5d3b10b-f563-4fd3-92fc-3b544811f880 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Returning 404 to user: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:13.286351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c5d3b10b-f563-4fd3-92fc-3b544811f880 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037639 Aug 01 15:35:13.286351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 82/168] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:35:13 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:35:13.302783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2b4b742d-ca71-4faa-873c-0bc6ead1e604 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:13.310533 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2b4b742d-ca71-4faa-873c-0bc6ead1e604 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1314 microversion: 2.1 time: 0.170709 Aug 01 15:35:13.311100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 87/169] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:13 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:13.629212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1e6a5eb9-1631-467c-ad0f-413fb9f790c8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:13.630230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1e6a5eb9-1631-467c-ad0f-413fb9f790c8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:13.637549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e6a5eb9-1631-467c-ad0f-413fb9f790c8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:13.638859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e6a5eb9-1631-467c-ad0f-413fb9f790c8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:13.639726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e6a5eb9-1631-467c-ad0f-413fb9f790c8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:13.640328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e6a5eb9-1631-467c-ad0f-413fb9f790c8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:13.771785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1e6a5eb9-1631-467c-ad0f-413fb9f790c8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:13.779767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1e6a5eb9-1631-467c-ad0f-413fb9f790c8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.154498 Aug 01 15:35:13.780341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 83/170] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:13 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:14.330974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f246b88a-5b1b-4c48-8446-01d4248a99eb tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:14.331652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f246b88a-5b1b-4c48-8446-01d4248a99eb tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:14.337906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f246b88a-5b1b-4c48-8446-01d4248a99eb tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:14.338390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f246b88a-5b1b-4c48-8446-01d4248a99eb tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:14.339309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f246b88a-5b1b-4c48-8446-01d4248a99eb tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:14.339977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f246b88a-5b1b-4c48-8446-01d4248a99eb tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:14.482532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f246b88a-5b1b-4c48-8446-01d4248a99eb tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:14.490126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f246b88a-5b1b-4c48-8446-01d4248a99eb tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1314 microversion: 2.1 time: 0.163097 Aug 01 15:35:14.490686 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 88/171] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:14 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:14.521448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ea1c6d45-e9a2-4d8d-bed1-5392f11ab9b4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:14.521966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ea1c6d45-e9a2-4d8d-bed1-5392f11ab9b4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:14.529809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea1c6d45-e9a2-4d8d-bed1-5392f11ab9b4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:14.530300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea1c6d45-e9a2-4d8d-bed1-5392f11ab9b4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:14.531084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea1c6d45-e9a2-4d8d-bed1-5392f11ab9b4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:14.531522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea1c6d45-e9a2-4d8d-bed1-5392f11ab9b4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:14.545282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-ea1c6d45-e9a2-4d8d-bed1-5392f11ab9b4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] HTTP exception thrown: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ea1c6d45-e9a2-4d8d-bed1-5392f11ab9b4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Request method failure captured: Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: DELETE /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae HTTP/1.1 Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_JoTLKXZERQBhivjHEOVPcdz2I7S9_eaQ-OUqL3PC_Drl7EvZf3M_dKn3cbfVKUeYCcA0ObxUXYgbBDJ_p81-FThUj52a7SECxyex8jBrfPJ-uq2ecEOkeyxJeB8Ce6qFAHZkaMLhE5iHun3YHD1Gn_TIwbnFg47xKlTK_KxnQmOcQ Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: db84eff445df4738a5fccb348fe9afeb Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-DeleteServersTestJSON-1362476416 Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 15:35:14.546842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 15:35:14.548239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/db84eff445df4738a5fccb348fe9afeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/db84eff445df4738a5fccb348fe9afeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_db84eff445df4738a5fccb348fe9afeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/db84eff445df4738a5fccb348fe9afeb"}]}] Aug 01 15:35:14.548239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-DeleteServersTestJSON-1362476416 Aug 01 15:35:14.548239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: db84eff445df4738a5fccb348fe9afeb Aug 01 15:35:14.548239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-DeleteServersTestJSON-1362476416 Aug 01 15:35:14.548239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-DeleteServersTestJSON-1362476416-project Aug 01 15:35:14.548239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 15:35:14.548239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 15:35:14.548239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: c07d9c30b18a4150aa0bc7a1705551d7 Aug 01 15:35:14.548239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-DeleteServersTestJSON-1362476416-project Aug 01 15:35:14.548239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 15:35:14.548239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:14.548239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': 'c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae'} Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:14.549127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:14.550442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:14.551974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ea1c6d45-e9a2-4d8d-bed1-5392f11ab9b4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Returning 404 to user: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:14.551974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ea1c6d45-e9a2-4d8d-bed1-5392f11ab9b4 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 404 len: 111 microversion: 2.1 time: 0.030553 Aug 01 15:35:14.551974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 84/172] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 15:35:14 2022] DELETE /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:35:14.556664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8fb7ebd2-a4b2-4aa9-a1ef-9e7c3bb7d388 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:14.557279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8fb7ebd2-a4b2-4aa9-a1ef-9e7c3bb7d388 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] [instance: c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:14.563365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8fb7ebd2-a4b2-4aa9-a1ef-9e7c3bb7d388 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:14.563838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8fb7ebd2-a4b2-4aa9-a1ef-9e7c3bb7d388 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:14.564604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8fb7ebd2-a4b2-4aa9-a1ef-9e7c3bb7d388 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:14.565035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8fb7ebd2-a4b2-4aa9-a1ef-9e7c3bb7d388 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:14.578962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-8fb7ebd2-a4b2-4aa9-a1ef-9e7c3bb7d388 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] HTTP exception thrown: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8fb7ebd2-a4b2-4aa9-a1ef-9e7c3bb7d388 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Request method failure captured: Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae HTTP/1.1 Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_JoTLKXZERQBhivjHEOVPcdz2I7S9_eaQ-OUqL3PC_Drl7EvZf3M_dKn3cbfVKUeYCcA0ObxUXYgbBDJ_p81-FThUj52a7SECxyex8jBrfPJ-uq2ecEOkeyxJeB8Ce6qFAHZkaMLhE5iHun3YHD1Gn_TIwbnFg47xKlTK_KxnQmOcQ Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: db84eff445df4738a5fccb348fe9afeb Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-DeleteServersTestJSON-1362476416 Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:35:14.583647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:35:14.585420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/db84eff445df4738a5fccb348fe9afeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/db84eff445df4738a5fccb348fe9afeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_db84eff445df4738a5fccb348fe9afeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/db84eff445df4738a5fccb348fe9afeb"}]}] Aug 01 15:35:14.585420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-DeleteServersTestJSON-1362476416 Aug 01 15:35:14.585420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: db84eff445df4738a5fccb348fe9afeb Aug 01 15:35:14.585420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-DeleteServersTestJSON-1362476416 Aug 01 15:35:14.585420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-DeleteServersTestJSON-1362476416-project Aug 01 15:35:14.585420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:35:14.585420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:35:14.585420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: c07d9c30b18a4150aa0bc7a1705551d7 Aug 01 15:35:14.585420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-DeleteServersTestJSON-1362476416-project Aug 01 15:35:14.585420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 15:35:14.585420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:14.585420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': 'c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae'} Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:14.586293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. Aug 01 15:35:14.587624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:14.588798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8fb7ebd2-a4b2-4aa9-a1ef-9e7c3bb7d388 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] Returning 404 to user: Instance c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:14.588798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8fb7ebd2-a4b2-4aa9-a1ef-9e7c3bb7d388 tempest-DeleteServersTestJSON-1362476416 tempest-DeleteServersTestJSON-1362476416-project] 10.222.0.83 "GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae" status: 404 len: 111 microversion: 2.1 time: 0.032193 Aug 01 15:35:14.588798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 89/173] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:14 2022] GET /compute/v2.1/servers/c6ae3008-4b0a-4eca-b07f-5cfbc81b54ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:35:14.800865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b528c018-c861-40bc-8008-f39c29be4c7f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:14.801476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b528c018-c861-40bc-8008-f39c29be4c7f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:14.808255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b528c018-c861-40bc-8008-f39c29be4c7f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:14.808700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b528c018-c861-40bc-8008-f39c29be4c7f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:14.809446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b528c018-c861-40bc-8008-f39c29be4c7f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:14.810018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b528c018-c861-40bc-8008-f39c29be4c7f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:15.086205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b528c018-c861-40bc-8008-f39c29be4c7f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:15.093747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b528c018-c861-40bc-8008-f39c29be4c7f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.296904 Aug 01 15:35:15.094327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 85/174] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:14 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:15.511135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-186b6597-10ed-4017-bf6c-2d857b4ec08c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:15.512058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-186b6597-10ed-4017-bf6c-2d857b4ec08c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:15.520556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-186b6597-10ed-4017-bf6c-2d857b4ec08c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:15.521015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-186b6597-10ed-4017-bf6c-2d857b4ec08c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:15.521826 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-186b6597-10ed-4017-bf6c-2d857b4ec08c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:15.522424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-186b6597-10ed-4017-bf6c-2d857b4ec08c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:15.895277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-186b6597-10ed-4017-bf6c-2d857b4ec08c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:15.904858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-186b6597-10ed-4017-bf6c-2d857b4ec08c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1499 microversion: 2.1 time: 0.397928 Aug 01 15:35:15.905449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 90/175] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:15 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1499 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:16.114762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ffcdb1a8-8d63-44b9-ae81-7b2d95a66210 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:16.115361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ffcdb1a8-8d63-44b9-ae81-7b2d95a66210 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:16.123472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ffcdb1a8-8d63-44b9-ae81-7b2d95a66210 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:16.124199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ffcdb1a8-8d63-44b9-ae81-7b2d95a66210 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:16.125160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ffcdb1a8-8d63-44b9-ae81-7b2d95a66210 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:16.125995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ffcdb1a8-8d63-44b9-ae81-7b2d95a66210 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:16.389447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ffcdb1a8-8d63-44b9-ae81-7b2d95a66210 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:16.402378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ffcdb1a8-8d63-44b9-ae81-7b2d95a66210 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.291414 Aug 01 15:35:16.404010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 86/176] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:16 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:16.560751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-38839f35-525f-4400-9133-fdd3aea76c19 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:16.561409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-38839f35-525f-4400-9133-fdd3aea76c19 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:16.568663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-38839f35-525f-4400-9133-fdd3aea76c19 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:16.569110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-38839f35-525f-4400-9133-fdd3aea76c19 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:16.569904 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-38839f35-525f-4400-9133-fdd3aea76c19 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:16.570447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-38839f35-525f-4400-9133-fdd3aea76c19 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:16.599235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-38839f35-525f-4400-9133-fdd3aea76c19 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Going to try to terminate instance {{(pid=124527) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:35:16.615046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:16.698035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-38839f35-525f-4400-9133-fdd3aea76c19 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 204 len: 0 microversion: 2.1 time: 0.137703 Aug 01 15:35:16.700432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 91/177] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 15:35:16 2022] DELETE /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:16.710644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b8ef0ac9-48ef-44af-81a2-6b937fc2b5c0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:16.711269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b8ef0ac9-48ef-44af-81a2-6b937fc2b5c0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:16.722960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b8ef0ac9-48ef-44af-81a2-6b937fc2b5c0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:16.723420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b8ef0ac9-48ef-44af-81a2-6b937fc2b5c0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:16.724205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b8ef0ac9-48ef-44af-81a2-6b937fc2b5c0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:16.724639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b8ef0ac9-48ef-44af-81a2-6b937fc2b5c0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:16.880427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b8ef0ac9-48ef-44af-81a2-6b937fc2b5c0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:16.888932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b8ef0ac9-48ef-44af-81a2-6b937fc2b5c0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1505 microversion: 2.1 time: 0.183125 Aug 01 15:35:16.889670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 87/178] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:16 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:17.424986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5fdb95ac-0256-46ad-9de8-108693a3ae6f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:17.426016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5fdb95ac-0256-46ad-9de8-108693a3ae6f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:17.432239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5fdb95ac-0256-46ad-9de8-108693a3ae6f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:17.432542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5fdb95ac-0256-46ad-9de8-108693a3ae6f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:17.433735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5fdb95ac-0256-46ad-9de8-108693a3ae6f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:17.433929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5fdb95ac-0256-46ad-9de8-108693a3ae6f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:17.629976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5fdb95ac-0256-46ad-9de8-108693a3ae6f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:17.645772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5fdb95ac-0256-46ad-9de8-108693a3ae6f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.224819 Aug 01 15:35:17.647490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 92/179] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:17 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:17.910383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f8f26873-9bcd-4b4a-b3cd-95cee42ba1f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:17.910995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f8f26873-9bcd-4b4a-b3cd-95cee42ba1f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:17.918192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f8f26873-9bcd-4b4a-b3cd-95cee42ba1f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:17.918675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f8f26873-9bcd-4b4a-b3cd-95cee42ba1f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:17.920009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f8f26873-9bcd-4b4a-b3cd-95cee42ba1f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:17.920616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f8f26873-9bcd-4b4a-b3cd-95cee42ba1f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:18.166745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f8f26873-9bcd-4b4a-b3cd-95cee42ba1f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:18.178611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f8f26873-9bcd-4b4a-b3cd-95cee42ba1f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1505 microversion: 2.1 time: 0.271777 Aug 01 15:35:18.179202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 88/180] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:17 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:18.670101 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ef0fd6b9-c7d6-4a07-aaef-a39e7e3a3924 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:18.673104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ef0fd6b9-c7d6-4a07-aaef-a39e7e3a3924 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:18.689997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef0fd6b9-c7d6-4a07-aaef-a39e7e3a3924 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:18.690489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef0fd6b9-c7d6-4a07-aaef-a39e7e3a3924 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:18.691322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef0fd6b9-c7d6-4a07-aaef-a39e7e3a3924 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:18.691796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef0fd6b9-c7d6-4a07-aaef-a39e7e3a3924 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:18.874236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ef0fd6b9-c7d6-4a07-aaef-a39e7e3a3924 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:18.901756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ef0fd6b9-c7d6-4a07-aaef-a39e7e3a3924 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.224784 Aug 01 15:35:18.914299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 93/181] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:18 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:19.200910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a4a1d106-47d6-4ccc-bc75-a9994a0e8091 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:19.203075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a4a1d106-47d6-4ccc-bc75-a9994a0e8091 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:19.210371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4a1d106-47d6-4ccc-bc75-a9994a0e8091 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:19.211090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4a1d106-47d6-4ccc-bc75-a9994a0e8091 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:19.211933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4a1d106-47d6-4ccc-bc75-a9994a0e8091 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:19.212584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4a1d106-47d6-4ccc-bc75-a9994a0e8091 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:19.462105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a4a1d106-47d6-4ccc-bc75-a9994a0e8091 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:19.473743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a4a1d106-47d6-4ccc-bc75-a9994a0e8091 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1505 microversion: 2.1 time: 0.277195 Aug 01 15:35:19.479980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 89/182] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:19 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:19.785317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-0f645a2f-ff22-4edf-9826-dd2ddd72e7cb req-acbeafb2-571f-4fde-8789-3826adefb664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2afa471-7b66-4e1b-b701-67be7188cdf1", "name": "network-vif-deleted", "tag": "dd8da22e-4350-417f-b45c-f4571d92dfd8"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:19.801852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-0f645a2f-ff22-4edf-9826-dd2ddd72e7cb req-acbeafb2-571f-4fde-8789-3826adefb664 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:19.802754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-0f645a2f-ff22-4edf-9826-dd2ddd72e7cb req-acbeafb2-571f-4fde-8789-3826adefb664 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:19.820119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-0f645a2f-ff22-4edf-9826-dd2ddd72e7cb req-acbeafb2-571f-4fde-8789-3826adefb664 service nova] Creating event network-vif-deleted:dd8da22e-4350-417f-b45c-f4571d92dfd8 for instance c2afa471-7b66-4e1b-b701-67be7188cdf1 on hv-cinder-84753 Aug 01 15:35:19.826932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-0f645a2f-ff22-4edf-9826-dd2ddd72e7cb req-acbeafb2-571f-4fde-8789-3826adefb664 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046484 Aug 01 15:35:19.828122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 94/183] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:35:19.928342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c7573537-1363-49ae-9525-23895759ef05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:19.928966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c7573537-1363-49ae-9525-23895759ef05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:19.936168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c7573537-1363-49ae-9525-23895759ef05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:19.937519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c7573537-1363-49ae-9525-23895759ef05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:19.938561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c7573537-1363-49ae-9525-23895759ef05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:19.939150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c7573537-1363-49ae-9525-23895759ef05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:20.111910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c7573537-1363-49ae-9525-23895759ef05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:20.119826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c7573537-1363-49ae-9525-23895759ef05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.195815 Aug 01 15:35:20.120616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 90/184] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:19 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:20.505570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8034c655-0a0e-45c7-939b-cadcaa7f5773 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:20.506386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8034c655-0a0e-45c7-939b-cadcaa7f5773 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:20.515408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8034c655-0a0e-45c7-939b-cadcaa7f5773 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:20.515862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8034c655-0a0e-45c7-939b-cadcaa7f5773 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:20.516705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8034c655-0a0e-45c7-939b-cadcaa7f5773 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:20.517140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8034c655-0a0e-45c7-939b-cadcaa7f5773 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:20.561936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8034c655-0a0e-45c7-939b-cadcaa7f5773 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:20.562703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8034c655-0a0e-45c7-939b-cadcaa7f5773 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:20.563224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-8034c655-0a0e-45c7-939b-cadcaa7f5773 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lazy-loading 'fault' on Instance uuid c2afa471-7b66-4e1b-b701-67be7188cdf1 {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:35:20.629188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8034c655-0a0e-45c7-939b-cadcaa7f5773 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:20.636606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8034c655-0a0e-45c7-939b-cadcaa7f5773 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 200 len: 1304 microversion: 2.1 time: 0.136295 Aug 01 15:35:20.638636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 95/185] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:20 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:20.662522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e924a8e0-99cf-4fdb-a05f-7adfa050bf42 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Action: 'create', calling method: .version_select at 0x7feb16b3a4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1254352631", "metadata": {"Type": "work"}}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e924a8e0-99cf-4fdb-a05f-7adfa050bf42 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Request method failure captured: Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 122 Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_K4y7ZYpj8A8Ivs6hOkEb-mYKE4RMMAtbZcYv1W_bFkIhmIOy9Tfng7SqT5Z9atH_IbaVYGB-FGliN8EdDOumJv3v8tfTY0R95gD9Y8rrS7FFX29BcuKgpGbevkVfiHi30040feGdS1tTR2Mb5GP7J1TL1LtLd63vyktCCZrr7zRd0 Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 53f7598bdaaf4898acfa6988952d1b91 Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 15:35:20.674677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f7598bdaaf4898acfa6988952d1b91"}]}] Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 53f7598bdaaf4898acfa6988952d1b91 Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-VolumesNegativeTest-384970458-project Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: a1fe60c8967544c0b849ec9a89c9afbb Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-VolumesNegativeTest-384970458-project Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1254352631", "metadata": {"Type": "work"}}} Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: Aug 01 15:35:20.675945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1254352631', 'metadata': {'Type': 'work'}}}} Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise error Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:20.676694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 15:35:20.678585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 15:35:20.679843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 15:35:20.679843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.679843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e924a8e0-99cf-4fdb-a05f-7adfa050bf42 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:20.679843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e924a8e0-99cf-4fdb-a05f-7adfa050bf42 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.176501 Aug 01 15:35:20.682675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 91/186] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 1 15:35:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:35:20.688128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f17de78b-dc3a-4764-8751-5d80e8b08210 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Action: 'create', calling method: .version_select at 0x7feb1624e0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-424115355", "metadata": {"Type": "work"}}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f17de78b-dc3a-4764-8751-5d80e8b08210 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Request method failure captured: Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 119 Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_K4y7ZYpj8A8Ivs6hOkEb-mYKE4RMMAtbZcYv1W_bFkIhmIOy9Tfng7SqT5Z9atH_IbaVYGB-FGliN8EdDOumJv3v8tfTY0R95gD9Y8rrS7FFX29BcuKgpGbevkVfiHi30040feGdS1tTR2Mb5GP7J1TL1LtLd63vyktCCZrr7zRd0 Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 53f7598bdaaf4898acfa6988952d1b91 Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:35:20.693381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f7598bdaaf4898acfa6988952d1b91"}]}] Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 53f7598bdaaf4898acfa6988952d1b91 Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-VolumesNegativeTest-384970458-project Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: a1fe60c8967544c0b849ec9a89c9afbb Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-VolumesNegativeTest-384970458-project Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-424115355", "metadata": {"Type": "work"}}} Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: Aug 01 15:35:20.694705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-424115355', 'metadata': {'Type': 'work'}}}} Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise error Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi '0' Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:20.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 15:35:20.696935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 15:35:20.701291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 15:35:20.701291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.701291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f17de78b-dc3a-4764-8751-5d80e8b08210 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:20.701291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f17de78b-dc3a-4764-8751-5d80e8b08210 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010796 Aug 01 15:35:20.701291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 96/187] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 1 15:35:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 01 15:35:20.706639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-76afeafd-95be-4ee8-83d9-ffb1aa6df623 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Action: 'create', calling method: .version_select at 0x7feb169e8430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-93783684", "metadata": {"Type": "work"}}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-76afeafd-95be-4ee8-83d9-ffb1aa6df623 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Request method failure captured: Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 117 Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_K4y7ZYpj8A8Ivs6hOkEb-mYKE4RMMAtbZcYv1W_bFkIhmIOy9Tfng7SqT5Z9atH_IbaVYGB-FGliN8EdDOumJv3v8tfTY0R95gD9Y8rrS7FFX29BcuKgpGbevkVfiHi30040feGdS1tTR2Mb5GP7J1TL1LtLd63vyktCCZrr7zRd0 Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 53f7598bdaaf4898acfa6988952d1b91 Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 15:35:20.711648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f7598bdaaf4898acfa6988952d1b91"}]}] Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 53f7598bdaaf4898acfa6988952d1b91 Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-VolumesNegativeTest-384970458-project Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: a1fe60c8967544c0b849ec9a89c9afbb Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-VolumesNegativeTest-384970458-project Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-93783684", "metadata": {"Type": "work"}}} Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: Aug 01 15:35:20.712941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-93783684', 'metadata': {'Type': 'work'}}}} Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise error Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi '' Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:20.713700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 15:35:20.715201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 15:35:20.716872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 15:35:20.716872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.716872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-76afeafd-95be-4ee8-83d9-ffb1aa6df623 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:20.716872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-76afeafd-95be-4ee8-83d9-ffb1aa6df623 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010593 Aug 01 15:35:20.716872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 92/188] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 1 15:35:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:35:20.724369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-47251529-7806-4fb0-9a11-7fd0e5c217ef tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Calling method '.version_select at 0x7feb17f18040>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:20.756907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-47251529-7806-4fb0-9a11-7fd0e5c217ef tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] HTTP exception thrown: Volume tempest-invalid-1839591040 could not be found. Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-47251529-7806-4fb0-9a11-7fd0e5c217ef tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Request method failure captured: Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1839591040 HTTP/1.1 Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_K4y7ZYpj8A8Ivs6hOkEb-mYKE4RMMAtbZcYv1W_bFkIhmIOy9Tfng7SqT5Z9atH_IbaVYGB-FGliN8EdDOumJv3v8tfTY0R95gD9Y8rrS7FFX29BcuKgpGbevkVfiHi30040feGdS1tTR2Mb5GP7J1TL1LtLd63vyktCCZrr7zRd0 Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 53f7598bdaaf4898acfa6988952d1b91 Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:35:20.758943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f7598bdaaf4898acfa6988952d1b91"}]}] Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 53f7598bdaaf4898acfa6988952d1b91 Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-VolumesNegativeTest-384970458-project Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: a1fe60c8967544c0b849ec9a89c9afbb Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-VolumesNegativeTest-384970458-project Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Volume tempest-invalid-1839591040 could not be found. Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': 'tempest-invalid-1839591040'} Aug 01 15:35:20.760257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1839591040 could not be found. (HTTP 404) (Request-ID: req-cefdc055-eb0b-4925-a258-faba8176f2ba) Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.761945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:35:20.763631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1839591040 could not be found. Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:35:20.764647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1839591040 could not be found. Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1839591040 could not be found. Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-47251529-7806-4fb0-9a11-7fd0e5c217ef tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Returning 404 to user: Volume tempest-invalid-1839591040 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-47251529-7806-4fb0-9a11-7fd0e5c217ef tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1839591040" status: 404 len: 99 microversion: 2.1 time: 0.040799 Aug 01 15:35:20.765782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 97/189] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 1 15:35:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1839591040 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 01 15:35:20.771985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d78c3e90-9570-479b-95ec-6e42cd4ae231 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004021 Aug 01 15:35:20.772540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 93/190] 10.222.0.83 () {58 vars in 1140 bytes} [Mon Aug 1 15:35:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 15:35:20.783417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-524e2efb-cb21-43d5-b590-9e1358fabfd6 tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005503 Aug 01 15:35:20.784319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 98/191] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 1 15:35:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 15:35:20.794401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e2cf169f-a0f7-41ec-a62d-66203c40526f tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Calling method '.version_select at 0x7feb16b2a3a0>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:20.824619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-e2cf169f-a0f7-41ec-a62d-66203c40526f tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] HTTP exception thrown: Volume d22fb76b-f01d-492c-a20a-18acedebff29 could not be found. Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e2cf169f-a0f7-41ec-a62d-66203c40526f tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Request method failure captured: Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: DELETE /compute/v2.1/os-volumes/d22fb76b-f01d-492c-a20a-18acedebff29 HTTP/1.1 Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_K4y7ZYpj8A8Ivs6hOkEb-mYKE4RMMAtbZcYv1W_bFkIhmIOy9Tfng7SqT5Z9atH_IbaVYGB-FGliN8EdDOumJv3v8tfTY0R95gD9Y8rrS7FFX29BcuKgpGbevkVfiHi30040feGdS1tTR2Mb5GP7J1TL1LtLd63vyktCCZrr7zRd0 Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 53f7598bdaaf4898acfa6988952d1b91 Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 15:35:20.827457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f7598bdaaf4898acfa6988952d1b91"}]}] Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 53f7598bdaaf4898acfa6988952d1b91 Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-VolumesNegativeTest-384970458-project Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: a1fe60c8967544c0b849ec9a89c9afbb Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-VolumesNegativeTest-384970458-project Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Volume d22fb76b-f01d-492c-a20a-18acedebff29 could not be found. Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': 'd22fb76b-f01d-492c-a20a-18acedebff29'} Aug 01 15:35:20.828893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d22fb76b-f01d-492c-a20a-18acedebff29 could not be found. (HTTP 404) (Request-ID: req-588b4f5b-c2b1-406a-a5e1-669e5124be60) Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.829591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:35:20.830610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d22fb76b-f01d-492c-a20a-18acedebff29 could not be found. Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 15:35:20.831644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d22fb76b-f01d-492c-a20a-18acedebff29 could not be found. Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d22fb76b-f01d-492c-a20a-18acedebff29 could not be found. Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e2cf169f-a0f7-41ec-a62d-66203c40526f tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Returning 404 to user: Volume d22fb76b-f01d-492c-a20a-18acedebff29 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e2cf169f-a0f7-41ec-a62d-66203c40526f tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/d22fb76b-f01d-492c-a20a-18acedebff29" status: 404 len: 109 microversion: 2.1 time: 0.039498 Aug 01 15:35:20.832662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 94/192] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 1 15:35:20 2022] DELETE /compute/v2.1/os-volumes/d22fb76b-f01d-492c-a20a-18acedebff29 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:35:20.841948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-03764ccc-01e4-43b7-91ac-1b209684500f tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Calling method '.version_select at 0x7feb1624ee50>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:20.872664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-03764ccc-01e4-43b7-91ac-1b209684500f tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] HTTP exception thrown: Volume 438c5f06-01d9-4760-95c3-1af1a7f1222b could not be found. Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-03764ccc-01e4-43b7-91ac-1b209684500f tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Request method failure captured: Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/os-volumes/438c5f06-01d9-4760-95c3-1af1a7f1222b HTTP/1.1 Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_K4y7ZYpj8A8Ivs6hOkEb-mYKE4RMMAtbZcYv1W_bFkIhmIOy9Tfng7SqT5Z9atH_IbaVYGB-FGliN8EdDOumJv3v8tfTY0R95gD9Y8rrS7FFX29BcuKgpGbevkVfiHi30040feGdS1tTR2Mb5GP7J1TL1LtLd63vyktCCZrr7zRd0 Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 53f7598bdaaf4898acfa6988952d1b91 Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:35:20.875142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_53f7598bdaaf4898acfa6988952d1b91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f7598bdaaf4898acfa6988952d1b91"}]}] Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 53f7598bdaaf4898acfa6988952d1b91 Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-VolumesNegativeTest-384970458 Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-VolumesNegativeTest-384970458-project Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: a1fe60c8967544c0b849ec9a89c9afbb Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-VolumesNegativeTest-384970458-project Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Volume 438c5f06-01d9-4760-95c3-1af1a7f1222b could not be found. Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '438c5f06-01d9-4760-95c3-1af1a7f1222b'} Aug 01 15:35:20.876521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 438c5f06-01d9-4760-95c3-1af1a7f1222b could not be found. (HTTP 404) (Request-ID: req-5f5a0e7d-2775-43db-95b7-bc0adab33453) Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.877270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:35:20.878357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 438c5f06-01d9-4760-95c3-1af1a7f1222b could not be found. Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:35:20.879884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 438c5f06-01d9-4760-95c3-1af1a7f1222b could not be found. Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 438c5f06-01d9-4760-95c3-1af1a7f1222b could not be found. Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-03764ccc-01e4-43b7-91ac-1b209684500f tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] Returning 404 to user: Volume 438c5f06-01d9-4760-95c3-1af1a7f1222b could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-03764ccc-01e4-43b7-91ac-1b209684500f tempest-VolumesNegativeTest-384970458 tempest-VolumesNegativeTest-384970458-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/438c5f06-01d9-4760-95c3-1af1a7f1222b" status: 404 len: 109 microversion: 2.1 time: 0.039667 Aug 01 15:35:20.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 99/193] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 15:35:20 2022] GET /compute/v2.1/os-volumes/438c5f06-01d9-4760-95c3-1af1a7f1222b => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:35:21.143023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a4510698-b6cf-498b-a097-881ffccd657c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:21.144084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a4510698-b6cf-498b-a097-881ffccd657c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:21.151606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4510698-b6cf-498b-a097-881ffccd657c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:21.152395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4510698-b6cf-498b-a097-881ffccd657c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:21.154102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4510698-b6cf-498b-a097-881ffccd657c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:21.154759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4510698-b6cf-498b-a097-881ffccd657c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:21.320090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a4510698-b6cf-498b-a097-881ffccd657c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:21.328699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a4510698-b6cf-498b-a097-881ffccd657c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.189356 Aug 01 15:35:21.329275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 95/194] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:21 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:21.666855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-22611121-cdd0-40c1-a857-cb4183514cf6 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:21.668793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-22611121-cdd0-40c1-a857-cb4183514cf6 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: c2afa471-7b66-4e1b-b701-67be7188cdf1] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:21.680688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22611121-cdd0-40c1-a857-cb4183514cf6 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:21.681673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22611121-cdd0-40c1-a857-cb4183514cf6 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:21.682740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22611121-cdd0-40c1-a857-cb4183514cf6 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:21.683425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22611121-cdd0-40c1-a857-cb4183514cf6 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:21.702444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-22611121-cdd0-40c1-a857-cb4183514cf6 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] HTTP exception thrown: Instance c2afa471-7b66-4e1b-b701-67be7188cdf1 could not be found. Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-22611121-cdd0-40c1-a857-cb4183514cf6 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Request method failure captured: Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 HTTP/1.1 Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_KfSWm1qskC1ua_elmSM-cVxKFvo52sRhAHEsPQ6X3jUnz9-tfpp9UCqMk-N7NUOMwabkUmy9KAo89fW1p0BgoEv7xkegQpXY3DTF6bXes8hfN2b9ZTM45h2IKEfWARNqRvUMrRYce0lqge4_m5p-l-m_3f11ViwMTPNjeg5dd4b58 Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 8454f4c13e654ee58e6ff6265b7b85f9 Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-VolumesActionsTest-2000577182 Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:35:21.704182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:35:21.705380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8454f4c13e654ee58e6ff6265b7b85f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8454f4c13e654ee58e6ff6265b7b85f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8454f4c13e654ee58e6ff6265b7b85f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8454f4c13e654ee58e6ff6265b7b85f9"}]}] Aug 01 15:35:21.705380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-VolumesActionsTest-2000577182 Aug 01 15:35:21.705380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 8454f4c13e654ee58e6ff6265b7b85f9 Aug 01 15:35:21.705380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-VolumesActionsTest-2000577182 Aug 01 15:35:21.705380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-VolumesActionsTest-2000577182-project Aug 01 15:35:21.705380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:35:21.705380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:35:21.705380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: c6591fd1ff63406c86b847870570e56c Aug 01 15:35:21.705380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-VolumesActionsTest-2000577182-project Aug 01 15:35:21.705380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 15:35:21.705380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance c2afa471-7b66-4e1b-b701-67be7188cdf1 could not be found. Aug 01 15:35:21.705380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': 'c2afa471-7b66-4e1b-b701-67be7188cdf1'} Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2afa471-7b66-4e1b-b701-67be7188cdf1 could not be found. Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:21.706298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2afa471-7b66-4e1b-b701-67be7188cdf1 could not be found. Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2afa471-7b66-4e1b-b701-67be7188cdf1 could not be found. Aug 01 15:35:21.708152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:21.709103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-22611121-cdd0-40c1-a857-cb4183514cf6 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Returning 404 to user: Instance c2afa471-7b66-4e1b-b701-67be7188cdf1 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:21.709103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-22611121-cdd0-40c1-a857-cb4183514cf6 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1" status: 404 len: 111 microversion: 2.1 time: 0.046679 Aug 01 15:35:21.709103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 100/195] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:21 2022] GET /compute/v2.1/servers/c2afa471-7b66-4e1b-b701-67be7188cdf1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:35:21.846097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1714934293", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "networks": [{"uuid": "7849e2a3-fcaa-49de-9f64-6e6d8840c666"}]}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:21.906516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.network.neutron [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] validate_networks() for [('7849e2a3-fcaa-49de-9f64-6e6d8840c666', None, None, None, None, None)] {{(pid=124526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:35:22.304093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Flavor limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:35:22.304514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Image limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:35:22.304986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Flavor pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:35:22.305396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Image pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:35:22.305808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:35:22.316456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:22.316981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:22.317810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:22.318289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:22.336426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Getting quotas for project 8454f4c13e654ee58e6ff6265b7b85f9. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:35:22.340581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Getting quotas for user c6591fd1ff63406c86b847870570e56c and project 8454f4c13e654ee58e6ff6265b7b85f9. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:35:22.352036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b17681a7-9fda-4608-b8be-6ab18c7928e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:22.352810 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b17681a7-9fda-4608-b8be-6ab18c7928e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:22.353131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Going to run 1 instances... {{(pid=124526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:35:22.355576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:35:22.360182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b17681a7-9fda-4608-b8be-6ab18c7928e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:22.360715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b17681a7-9fda-4608-b8be-6ab18c7928e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:22.361745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b17681a7-9fda-4608-b8be-6ab18c7928e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:22.362448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b17681a7-9fda-4608-b8be-6ab18c7928e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:22.406533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7f112ef0-883b-4d4a-ac07-faee35436203 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566160 Aug 01 15:35:22.407660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 96/196] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:35:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 15:35:22.420971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6831407a-5a38-411f-87d0-62f6299501d5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:22.421606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6831407a-5a38-411f-87d0-62f6299501d5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:22.503798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6831407a-5a38-411f-87d0-62f6299501d5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:22.514381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6831407a-5a38-411f-87d0-62f6299501d5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1214 microversion: 2.1 time: 0.097008 Aug 01 15:35:22.515075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 97/197] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:22 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:22.577641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b17681a7-9fda-4608-b8be-6ab18c7928e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:22.588285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b17681a7-9fda-4608-b8be-6ab18c7928e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.240892 Aug 01 15:35:22.589034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 101/198] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:22 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:22.909854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-519871027", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "networks": [{"uuid": "fab1f7ba-00f0-40a4-91ee-a38e8bcf4d1b"}]}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:22.966535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.network.neutron [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] validate_networks() for [('fab1f7ba-00f0-40a4-91ee-a38e8bcf4d1b', None, None, None, None, None)] {{(pid=124526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:35:23.424947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Flavor limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:35:23.425545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Image limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:35:23.426121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Flavor pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:35:23.426465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Image pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:35:23.426873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:35:23.428971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:23.438909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:23.439344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:23.440298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:23.440771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:23.459950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Getting quotas for project 38f80d210cce4a41af527ac134deba93. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:35:23.464767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Getting quotas for user 77cb30fae1184064a8c4f822d4d31096 and project 38f80d210cce4a41af527ac134deba93. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:35:23.478604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Going to run 1 instances... {{(pid=124526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:35:23.480713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:35:23.530333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-640178f9-f19f-4e3a-819b-65a09fa11e52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622561 Aug 01 15:35:23.531525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 98/199] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:35:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:35:23.536350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cb03bd1f-6ecb-47ed-9e16-ab3f4f3a560c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:23.537487 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cb03bd1f-6ecb-47ed-9e16-ab3f4f3a560c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:23.544349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb03bd1f-6ecb-47ed-9e16-ab3f4f3a560c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:23.544933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb03bd1f-6ecb-47ed-9e16-ab3f4f3a560c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:23.545942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb03bd1f-6ecb-47ed-9e16-ab3f4f3a560c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:23.546496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb03bd1f-6ecb-47ed-9e16-ab3f4f3a560c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:23.547619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bcff25c4-63b0-473a-920c-855d635e63e0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:23.548241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bcff25c4-63b0-473a-920c-855d635e63e0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:23.619219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bcff25c4-63b0-473a-920c-855d635e63e0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:23.629653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bcff25c4-63b0-473a-920c-855d635e63e0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1218 microversion: 2.1 time: 0.091139 Aug 01 15:35:23.644109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 99/200] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:23 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:23.644109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-23f8b6a4-0639-4e59-ada7-e1ead3d7acd0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:23.644109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-23f8b6a4-0639-4e59-ada7-e1ead3d7acd0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:23.646797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cb03bd1f-6ecb-47ed-9e16-ab3f4f3a560c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:23.658303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23f8b6a4-0639-4e59-ada7-e1ead3d7acd0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:23.658927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23f8b6a4-0639-4e59-ada7-e1ead3d7acd0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:23.659821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23f8b6a4-0639-4e59-ada7-e1ead3d7acd0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:23.660392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23f8b6a4-0639-4e59-ada7-e1ead3d7acd0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:23.661624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cb03bd1f-6ecb-47ed-9e16-ab3f4f3a560c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1266 microversion: 2.1 time: 0.126113 Aug 01 15:35:23.662272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 102/201] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:23 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:23.949506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-23f8b6a4-0639-4e59-ada7-e1ead3d7acd0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:23.958310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-23f8b6a4-0639-4e59-ada7-e1ead3d7acd0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.326309 Aug 01 15:35:23.958885 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 100/202] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:23 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:24.654524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c32f9baa-5979-4e22-8370-84f705b3b172 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:24.655110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c32f9baa-5979-4e22-8370-84f705b3b172 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:24.661147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c32f9baa-5979-4e22-8370-84f705b3b172 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:24.661594 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c32f9baa-5979-4e22-8370-84f705b3b172 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:24.662385 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c32f9baa-5979-4e22-8370-84f705b3b172 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:24.662917 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c32f9baa-5979-4e22-8370-84f705b3b172 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:24.682864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-612b758c-3db0-4f3f-afff-a98a8ca0ceb3 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:24.683478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-612b758c-3db0-4f3f-afff-a98a8ca0ceb3 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:24.689996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-612b758c-3db0-4f3f-afff-a98a8ca0ceb3 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:24.690444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-612b758c-3db0-4f3f-afff-a98a8ca0ceb3 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:24.691206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-612b758c-3db0-4f3f-afff-a98a8ca0ceb3 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:24.691641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-612b758c-3db0-4f3f-afff-a98a8ca0ceb3 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:24.728431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c32f9baa-5979-4e22-8370-84f705b3b172 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:24.736113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c32f9baa-5979-4e22-8370-84f705b3b172 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1222 microversion: 2.1 time: 0.085360 Aug 01 15:35:24.736584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 103/203] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:24 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:24.765346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-612b758c-3db0-4f3f-afff-a98a8ca0ceb3 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:24.772958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-612b758c-3db0-4f3f-afff-a98a8ca0ceb3 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1272 microversion: 2.1 time: 0.093898 Aug 01 15:35:24.773522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 101/204] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:24 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:24.980488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d932e3ca-a78c-4e2d-a112-2c6274c585e2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:24.981064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d932e3ca-a78c-4e2d-a112-2c6274c585e2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:24.987899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d932e3ca-a78c-4e2d-a112-2c6274c585e2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:24.988358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d932e3ca-a78c-4e2d-a112-2c6274c585e2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:24.989134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d932e3ca-a78c-4e2d-a112-2c6274c585e2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:24.989571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d932e3ca-a78c-4e2d-a112-2c6274c585e2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:25.118455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d932e3ca-a78c-4e2d-a112-2c6274c585e2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:25.125797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d932e3ca-a78c-4e2d-a112-2c6274c585e2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.149240 Aug 01 15:35:25.126373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 104/205] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:24 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:25.757955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bf96e890-7dfb-46dc-868d-e11073df9d48 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:25.758669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bf96e890-7dfb-46dc-868d-e11073df9d48 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:25.765686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf96e890-7dfb-46dc-868d-e11073df9d48 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:25.766178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf96e890-7dfb-46dc-868d-e11073df9d48 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:25.766952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf96e890-7dfb-46dc-868d-e11073df9d48 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:25.767395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf96e890-7dfb-46dc-868d-e11073df9d48 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:25.793673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8778db14-dd66-40e5-9f92-041467f7ec5e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:25.794820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8778db14-dd66-40e5-9f92-041467f7ec5e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:25.800915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8778db14-dd66-40e5-9f92-041467f7ec5e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:25.801355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8778db14-dd66-40e5-9f92-041467f7ec5e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:25.802268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8778db14-dd66-40e5-9f92-041467f7ec5e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:25.802699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8778db14-dd66-40e5-9f92-041467f7ec5e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:25.828661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bf96e890-7dfb-46dc-868d-e11073df9d48 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:25.836363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bf96e890-7dfb-46dc-868d-e11073df9d48 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1222 microversion: 2.1 time: 0.083658 Aug 01 15:35:25.836946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 102/206] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:25 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:25.867266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8778db14-dd66-40e5-9f92-041467f7ec5e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:25.875436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8778db14-dd66-40e5-9f92-041467f7ec5e tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1272 microversion: 2.1 time: 0.085623 Aug 01 15:35:25.875997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 105/207] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:25 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:26.146217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0414873e-f861-4e27-932f-a0f707ccc875 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:26.146879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0414873e-f861-4e27-932f-a0f707ccc875 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:26.153046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0414873e-f861-4e27-932f-a0f707ccc875 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:26.153526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0414873e-f861-4e27-932f-a0f707ccc875 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:26.154396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0414873e-f861-4e27-932f-a0f707ccc875 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:26.154916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0414873e-f861-4e27-932f-a0f707ccc875 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:26.529778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0414873e-f861-4e27-932f-a0f707ccc875 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:26.537773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0414873e-f861-4e27-932f-a0f707ccc875 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.395553 Aug 01 15:35:26.538382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 103/208] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:26 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:26.857584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-67ee4871-808d-4313-93ed-a2ea00f211ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:26.858180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-67ee4871-808d-4313-93ed-a2ea00f211ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:26.864848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67ee4871-808d-4313-93ed-a2ea00f211ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:26.865539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67ee4871-808d-4313-93ed-a2ea00f211ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:26.866542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67ee4871-808d-4313-93ed-a2ea00f211ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:26.867269 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67ee4871-808d-4313-93ed-a2ea00f211ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:26.895835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f1caa78f-af2a-4b58-8cda-d2cc7782b836 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:26.896465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f1caa78f-af2a-4b58-8cda-d2cc7782b836 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:26.905771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1caa78f-af2a-4b58-8cda-d2cc7782b836 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:26.906256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1caa78f-af2a-4b58-8cda-d2cc7782b836 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:26.907077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1caa78f-af2a-4b58-8cda-d2cc7782b836 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:26.907514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1caa78f-af2a-4b58-8cda-d2cc7782b836 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:27.006121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-67ee4871-808d-4313-93ed-a2ea00f211ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:27.015014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-67ee4871-808d-4313-93ed-a2ea00f211ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1222 microversion: 2.1 time: 0.161721 Aug 01 15:35:27.015206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f1caa78f-af2a-4b58-8cda-d2cc7782b836 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:27.015743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 106/209] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:26 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1222 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:27.022956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f1caa78f-af2a-4b58-8cda-d2cc7782b836 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1272 microversion: 2.1 time: 0.131616 Aug 01 15:35:27.023569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 104/210] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:26 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1272 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:27.561067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-de1f1fc1-7625-4125-9da9-f9b6c3931edb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:27.562161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-de1f1fc1-7625-4125-9da9-f9b6c3931edb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:27.569551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-de1f1fc1-7625-4125-9da9-f9b6c3931edb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:27.570039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-de1f1fc1-7625-4125-9da9-f9b6c3931edb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:27.570945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-de1f1fc1-7625-4125-9da9-f9b6c3931edb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:27.571581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-de1f1fc1-7625-4125-9da9-f9b6c3931edb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:27.963015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-de1f1fc1-7625-4125-9da9-f9b6c3931edb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:27.971946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-de1f1fc1-7625-4125-9da9-f9b6c3931edb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.416639 Aug 01 15:35:27.972541 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 107/211] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:27 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:28.042082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a93d4e34-2ade-4b6f-a1d0-2d01d59bfdb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:28.043050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a93d4e34-2ade-4b6f-a1d0-2d01d59bfdb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:28.054179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-79a93f7f-e09a-43d8-b45b-a02fd39c7c17 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:28.054179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-79a93f7f-e09a-43d8-b45b-a02fd39c7c17 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:28.054462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a93d4e34-2ade-4b6f-a1d0-2d01d59bfdb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:28.054462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a93d4e34-2ade-4b6f-a1d0-2d01d59bfdb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:28.054462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a93d4e34-2ade-4b6f-a1d0-2d01d59bfdb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:28.055129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a93d4e34-2ade-4b6f-a1d0-2d01d59bfdb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:28.066034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79a93f7f-e09a-43d8-b45b-a02fd39c7c17 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:28.066034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79a93f7f-e09a-43d8-b45b-a02fd39c7c17 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:28.066034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79a93f7f-e09a-43d8-b45b-a02fd39c7c17 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:28.066034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79a93f7f-e09a-43d8-b45b-a02fd39c7c17 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:28.175196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a93d4e34-2ade-4b6f-a1d0-2d01d59bfdb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:28.187641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a93d4e34-2ade-4b6f-a1d0-2d01d59bfdb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1276 microversion: 2.1 time: 0.151371 Aug 01 15:35:28.188457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 105/212] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:28 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:28.404182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-79a93f7f-e09a-43d8-b45b-a02fd39c7c17 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:28.416663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-79a93f7f-e09a-43d8-b45b-a02fd39c7c17 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1314 microversion: 2.1 time: 0.375812 Aug 01 15:35:28.430312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 108/213] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:28 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:28.865636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-3800f46c-f983-444a-8638-c8ba76f196ef req-cffc0c1f-272e-4e1f-96fa-a3095a04a2dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea0d11f-5554-415b-9456-b178b159d97d", "tag": "ae4a7bba-58ff-4f00-bf70-317560da461d"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:28.876416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-3800f46c-f983-444a-8638-c8ba76f196ef req-cffc0c1f-272e-4e1f-96fa-a3095a04a2dd service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:28.876850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-3800f46c-f983-444a-8638-c8ba76f196ef req-cffc0c1f-272e-4e1f-96fa-a3095a04a2dd service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:28.881329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:28.889846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-3800f46c-f983-444a-8638-c8ba76f196ef req-cffc0c1f-272e-4e1f-96fa-a3095a04a2dd service nova] Creating event network-changed:ae4a7bba-58ff-4f00-bf70-317560da461d for instance 5ea0d11f-5554-415b-9456-b178b159d97d on hv-cinder-84753 Aug 01 15:35:28.896125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-3800f46c-f983-444a-8638-c8ba76f196ef req-cffc0c1f-272e-4e1f-96fa-a3095a04a2dd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034191 Aug 01 15:35:28.897590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 106/214] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:35:28.994309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fa59b229-98db-4550-af1b-c97a409bfa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:28.995205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fa59b229-98db-4550-af1b-c97a409bfa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:29.003580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa59b229-98db-4550-af1b-c97a409bfa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:29.004214 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa59b229-98db-4550-af1b-c97a409bfa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:29.005475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa59b229-98db-4550-af1b-c97a409bfa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:29.006399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa59b229-98db-4550-af1b-c97a409bfa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:29.210991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-72e7e860-1e34-4006-9f4a-a32962efb038 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:29.211715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-72e7e860-1e34-4006-9f4a-a32962efb038 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:29.219890 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72e7e860-1e34-4006-9f4a-a32962efb038 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:29.220386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72e7e860-1e34-4006-9f4a-a32962efb038 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:29.221412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72e7e860-1e34-4006-9f4a-a32962efb038 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:29.221850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72e7e860-1e34-4006-9f4a-a32962efb038 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:29.402507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fa59b229-98db-4550-af1b-c97a409bfa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:29.411710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fa59b229-98db-4550-af1b-c97a409bfa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.422175 Aug 01 15:35:29.412143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 109/215] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:28 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:29.450999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d80761a3-2003-4f52-a3a3-cb2527044693 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:29.452245 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d80761a3-2003-4f52-a3a3-cb2527044693 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:29.455694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:29.465577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d80761a3-2003-4f52-a3a3-cb2527044693 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:29.467181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d80761a3-2003-4f52-a3a3-cb2527044693 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:29.467431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d80761a3-2003-4f52-a3a3-cb2527044693 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:29.467866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d80761a3-2003-4f52-a3a3-cb2527044693 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:29.604021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-72e7e860-1e34-4006-9f4a-a32962efb038 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:29.614359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-72e7e860-1e34-4006-9f4a-a32962efb038 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1318 microversion: 2.1 time: 0.409223 Aug 01 15:35:29.615576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 107/216] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:29 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:29.807458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d80761a3-2003-4f52-a3a3-cb2527044693 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:29.815337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d80761a3-2003-4f52-a3a3-cb2527044693 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1314 microversion: 2.1 time: 0.372080 Aug 01 15:35:29.816280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 110/217] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:29 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:30.432946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-80a415c5-5f30-4c75-97a2-fd7c8743bf00 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:30.433596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-80a415c5-5f30-4c75-97a2-fd7c8743bf00 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:30.440999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-80a415c5-5f30-4c75-97a2-fd7c8743bf00 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:30.441443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-80a415c5-5f30-4c75-97a2-fd7c8743bf00 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:30.442351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-80a415c5-5f30-4c75-97a2-fd7c8743bf00 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:30.442780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-80a415c5-5f30-4c75-97a2-fd7c8743bf00 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:30.636534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-72b471b1-c56f-4375-b578-8534d77c7d6a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:30.637136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-72b471b1-c56f-4375-b578-8534d77c7d6a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:30.643760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72b471b1-c56f-4375-b578-8534d77c7d6a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:30.644206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72b471b1-c56f-4375-b578-8534d77c7d6a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:30.645061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72b471b1-c56f-4375-b578-8534d77c7d6a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:30.645501 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72b471b1-c56f-4375-b578-8534d77c7d6a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:30.824019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-80a415c5-5f30-4c75-97a2-fd7c8743bf00 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:30.834515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-80a415c5-5f30-4c75-97a2-fd7c8743bf00 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.405418 Aug 01 15:35:30.835185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 108/218] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:30 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:30.841072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4a0ff4b7-3f82-43fa-bda5-fd193f0f511c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:30.841707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4a0ff4b7-3f82-43fa-bda5-fd193f0f511c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:30.853537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a0ff4b7-3f82-43fa-bda5-fd193f0f511c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:30.853983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a0ff4b7-3f82-43fa-bda5-fd193f0f511c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:30.854824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a0ff4b7-3f82-43fa-bda5-fd193f0f511c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:30.855263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a0ff4b7-3f82-43fa-bda5-fd193f0f511c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:30.939667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-72b471b1-c56f-4375-b578-8534d77c7d6a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:30.948555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-72b471b1-c56f-4375-b578-8534d77c7d6a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1318 microversion: 2.1 time: 0.315866 Aug 01 15:35:30.949538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 111/219] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:30 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:31.023820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-ab65e715-2bf7-4e3b-a01b-49b2ef5b5fed req-28f20fb4-ae88-4c24-ba34-c2a9fe4e728c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fac32bea-aa1d-4abf-bd69-332c15fa2ebf", "tag": "12cd816a-227b-4146-9dfb-1360caef9173"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:31.034312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-ab65e715-2bf7-4e3b-a01b-49b2ef5b5fed req-28f20fb4-ae88-4c24-ba34-c2a9fe4e728c service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:31.034816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-ab65e715-2bf7-4e3b-a01b-49b2ef5b5fed req-28f20fb4-ae88-4c24-ba34-c2a9fe4e728c service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:31.038904 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:31.047555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-ab65e715-2bf7-4e3b-a01b-49b2ef5b5fed req-28f20fb4-ae88-4c24-ba34-c2a9fe4e728c service nova] Creating event network-changed:12cd816a-227b-4146-9dfb-1360caef9173 for instance fac32bea-aa1d-4abf-bd69-332c15fa2ebf on hv-cinder-84753 Aug 01 15:35:31.053358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-ab65e715-2bf7-4e3b-a01b-49b2ef5b5fed req-28f20fb4-ae88-4c24-ba34-c2a9fe4e728c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033511 Aug 01 15:35:31.054585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 112/220] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:35:31.087824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4a0ff4b7-3f82-43fa-bda5-fd193f0f511c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:31.097061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4a0ff4b7-3f82-43fa-bda5-fd193f0f511c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1314 microversion: 2.1 time: 0.260489 Aug 01 15:35:31.097649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 109/221] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:30 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:31.857994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-630bb00f-965c-4902-86fa-c3240091296c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:31.858721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-630bb00f-965c-4902-86fa-c3240091296c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:31.866453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-630bb00f-965c-4902-86fa-c3240091296c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:31.866911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-630bb00f-965c-4902-86fa-c3240091296c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:31.867686 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-630bb00f-965c-4902-86fa-c3240091296c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:31.868170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-630bb00f-965c-4902-86fa-c3240091296c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:31.976941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1c5614fe-c9cc-4f5c-888f-6148af6103d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:31.977776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1c5614fe-c9cc-4f5c-888f-6148af6103d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:31.988702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c5614fe-c9cc-4f5c-888f-6148af6103d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:31.989279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c5614fe-c9cc-4f5c-888f-6148af6103d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:31.990132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c5614fe-c9cc-4f5c-888f-6148af6103d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:31.990583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c5614fe-c9cc-4f5c-888f-6148af6103d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:32.033195 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-630bb00f-965c-4902-86fa-c3240091296c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:32.046312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-630bb00f-965c-4902-86fa-c3240091296c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.192944 Aug 01 15:35:32.048244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 113/222] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:31 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:32.117578 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c0c1d8f0-50f3-4368-a631-feb9f88196ac tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:32.118364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c0c1d8f0-50f3-4368-a631-feb9f88196ac tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:32.126485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0c1d8f0-50f3-4368-a631-feb9f88196ac tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:32.126965 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0c1d8f0-50f3-4368-a631-feb9f88196ac tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:32.128150 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0c1d8f0-50f3-4368-a631-feb9f88196ac tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:32.129123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0c1d8f0-50f3-4368-a631-feb9f88196ac tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:32.144843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1c5614fe-c9cc-4f5c-888f-6148af6103d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:32.158689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1c5614fe-c9cc-4f5c-888f-6148af6103d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1318 microversion: 2.1 time: 0.188726 Aug 01 15:35:32.161937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 110/223] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:31 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:32.274387 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c0c1d8f0-50f3-4368-a631-feb9f88196ac tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:32.284988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c0c1d8f0-50f3-4368-a631-feb9f88196ac tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1314 microversion: 2.1 time: 0.171556 Aug 01 15:35:32.285582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 114/224] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:32 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:33.072879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b2faec92-63b3-4df4-a16c-bd755d79712b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:33.072879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b2faec92-63b3-4df4-a16c-bd755d79712b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:33.078832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2faec92-63b3-4df4-a16c-bd755d79712b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:33.079341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2faec92-63b3-4df4-a16c-bd755d79712b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:33.080055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2faec92-63b3-4df4-a16c-bd755d79712b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:33.080768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2faec92-63b3-4df4-a16c-bd755d79712b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:33.180417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7ba16647-85c0-4dd1-a1e8-acee4f02f10a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:33.181025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7ba16647-85c0-4dd1-a1e8-acee4f02f10a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:33.187806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ba16647-85c0-4dd1-a1e8-acee4f02f10a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:33.188247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ba16647-85c0-4dd1-a1e8-acee4f02f10a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:33.189002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ba16647-85c0-4dd1-a1e8-acee4f02f10a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:33.189428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ba16647-85c0-4dd1-a1e8-acee4f02f10a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:33.225847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b2faec92-63b3-4df4-a16c-bd755d79712b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:33.234200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b2faec92-63b3-4df4-a16c-bd755d79712b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.169719 Aug 01 15:35:33.234780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 111/225] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:33 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:33.306222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-530958f7-87c8-476e-9381-cc124cc0a575 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:33.306838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-530958f7-87c8-476e-9381-cc124cc0a575 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:33.313817 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-530958f7-87c8-476e-9381-cc124cc0a575 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:33.313951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-530958f7-87c8-476e-9381-cc124cc0a575 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:33.314670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-530958f7-87c8-476e-9381-cc124cc0a575 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:33.315083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-530958f7-87c8-476e-9381-cc124cc0a575 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:33.327942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7ba16647-85c0-4dd1-a1e8-acee4f02f10a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:33.335681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7ba16647-85c0-4dd1-a1e8-acee4f02f10a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1318 microversion: 2.1 time: 0.158807 Aug 01 15:35:33.336398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 115/226] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:33 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:33.448920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=4 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:33.459780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-530958f7-87c8-476e-9381-cc124cc0a575 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:33.467575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-530958f7-87c8-476e-9381-cc124cc0a575 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1314 microversion: 2.1 time: 0.165278 Aug 01 15:35:33.468149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 112/227] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:33 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:34.255060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3a9e8402-3b62-4fbb-b352-453bb0e355ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:34.255675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3a9e8402-3b62-4fbb-b352-453bb0e355ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:34.261998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a9e8402-3b62-4fbb-b352-453bb0e355ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:34.262444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a9e8402-3b62-4fbb-b352-453bb0e355ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:34.263215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a9e8402-3b62-4fbb-b352-453bb0e355ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:34.263650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a9e8402-3b62-4fbb-b352-453bb0e355ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:34.356950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bb65c3b9-6a26-45c1-a8ff-3d03a8262e37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:34.357569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bb65c3b9-6a26-45c1-a8ff-3d03a8262e37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:34.359523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=16 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:34.365520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb65c3b9-6a26-45c1-a8ff-3d03a8262e37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:34.366016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb65c3b9-6a26-45c1-a8ff-3d03a8262e37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:34.367165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb65c3b9-6a26-45c1-a8ff-3d03a8262e37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:34.367165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb65c3b9-6a26-45c1-a8ff-3d03a8262e37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:34.421399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3a9e8402-3b62-4fbb-b352-453bb0e355ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:34.431230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3a9e8402-3b62-4fbb-b352-453bb0e355ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.179858 Aug 01 15:35:34.431730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 116/228] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:34 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:34.488691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c1979c92-0239-4cc7-9c4a-920db875c4f2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:34.489458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c1979c92-0239-4cc7-9c4a-920db875c4f2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:34.495692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1979c92-0239-4cc7-9c4a-920db875c4f2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:34.496142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1979c92-0239-4cc7-9c4a-920db875c4f2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:34.496957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1979c92-0239-4cc7-9c4a-920db875c4f2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:34.497388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1979c92-0239-4cc7-9c4a-920db875c4f2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:34.510924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bb65c3b9-6a26-45c1-a8ff-3d03a8262e37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:34.518627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bb65c3b9-6a26-45c1-a8ff-3d03a8262e37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1318 microversion: 2.1 time: 0.165998 Aug 01 15:35:34.519212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 113/229] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:34 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:34.633763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c1979c92-0239-4cc7-9c4a-920db875c4f2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:34.641373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c1979c92-0239-4cc7-9c4a-920db875c4f2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1314 microversion: 2.1 time: 0.156595 Aug 01 15:35:34.641965 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 117/230] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:34 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:35.452958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-13a4c4f8-22e4-4a56-a880-e66858f6f84b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:35.453605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-13a4c4f8-22e4-4a56-a880-e66858f6f84b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:35.463128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13a4c4f8-22e4-4a56-a880-e66858f6f84b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:35.463586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13a4c4f8-22e4-4a56-a880-e66858f6f84b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:35.466241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13a4c4f8-22e4-4a56-a880-e66858f6f84b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:35.466241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13a4c4f8-22e4-4a56-a880-e66858f6f84b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:35.543211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5a45f4ff-cec9-4a0e-93ef-4af7f0728e72 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:35.545251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5a45f4ff-cec9-4a0e-93ef-4af7f0728e72 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:35.554004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a45f4ff-cec9-4a0e-93ef-4af7f0728e72 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:35.554480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a45f4ff-cec9-4a0e-93ef-4af7f0728e72 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:35.555352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a45f4ff-cec9-4a0e-93ef-4af7f0728e72 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:35.555861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a45f4ff-cec9-4a0e-93ef-4af7f0728e72 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:35.676432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-13a4c4f8-22e4-4a56-a880-e66858f6f84b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:35.685418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-13a4c4f8-22e4-4a56-a880-e66858f6f84b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.236523 Aug 01 15:35:35.686022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 114/231] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:35 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:35.690502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-88032200-b5c7-4edd-a9e6-fb793e6d35b0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:35.691110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-88032200-b5c7-4edd-a9e6-fb793e6d35b0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:35.697499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-88032200-b5c7-4edd-a9e6-fb793e6d35b0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:35.698803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-88032200-b5c7-4edd-a9e6-fb793e6d35b0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:35.699763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-88032200-b5c7-4edd-a9e6-fb793e6d35b0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:35.700197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-88032200-b5c7-4edd-a9e6-fb793e6d35b0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:35.727933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5a45f4ff-cec9-4a0e-93ef-4af7f0728e72 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:35.735981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5a45f4ff-cec9-4a0e-93ef-4af7f0728e72 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1318 microversion: 2.1 time: 0.199815 Aug 01 15:35:35.736551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 118/232] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:35 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:35.831339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-88032200-b5c7-4edd-a9e6-fb793e6d35b0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:35.839336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-88032200-b5c7-4edd-a9e6-fb793e6d35b0 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1314 microversion: 2.1 time: 0.152281 Aug 01 15:35:35.840006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 115/233] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:35 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:36.697632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-8c7ca975-5096-4f32-8955-8e316ce94d20 req-a256b1ee-1063-410d-b64f-822ede9ebeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea0d11f-5554-415b-9456-b178b159d97d", "name": "network-vif-plugged", "status": "completed", "tag": "ae4a7bba-58ff-4f00-bf70-317560da461d"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:36.711292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-8c7ca975-5096-4f32-8955-8e316ce94d20 req-a256b1ee-1063-410d-b64f-822ede9ebeb1 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:36.711538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-da3205ef-3ddf-45f9-aade-89c9545a03f1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:36.712898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-da3205ef-3ddf-45f9-aade-89c9545a03f1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:36.713677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-8c7ca975-5096-4f32-8955-8e316ce94d20 req-a256b1ee-1063-410d-b64f-822ede9ebeb1 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:36.730773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da3205ef-3ddf-45f9-aade-89c9545a03f1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:36.730773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da3205ef-3ddf-45f9-aade-89c9545a03f1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:36.730773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da3205ef-3ddf-45f9-aade-89c9545a03f1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:36.730773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da3205ef-3ddf-45f9-aade-89c9545a03f1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:36.744340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-8c7ca975-5096-4f32-8955-8e316ce94d20 req-a256b1ee-1063-410d-b64f-822ede9ebeb1 service nova] Creating event network-vif-plugged:ae4a7bba-58ff-4f00-bf70-317560da461d for instance 5ea0d11f-5554-415b-9456-b178b159d97d on hv-cinder-84753 Aug 01 15:35:36.752078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-8c7ca975-5096-4f32-8955-8e316ce94d20 req-a256b1ee-1063-410d-b64f-822ede9ebeb1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058217 Aug 01 15:35:36.752996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 119/234] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:35:36.759935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-27fd6ee9-2454-4969-9128-45d7b453f348 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:36.761161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-27fd6ee9-2454-4969-9128-45d7b453f348 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:36.769850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27fd6ee9-2454-4969-9128-45d7b453f348 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:36.770569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27fd6ee9-2454-4969-9128-45d7b453f348 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:36.771668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27fd6ee9-2454-4969-9128-45d7b453f348 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:36.772266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27fd6ee9-2454-4969-9128-45d7b453f348 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:36.978110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-da3205ef-3ddf-45f9-aade-89c9545a03f1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:36.983304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-27fd6ee9-2454-4969-9128-45d7b453f348 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:36.995270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-27fd6ee9-2454-4969-9128-45d7b453f348 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1318 microversion: 2.1 time: 0.240043 Aug 01 15:35:36.996083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 120/235] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:36 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:37.002664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-da3205ef-3ddf-45f9-aade-89c9545a03f1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.298191 Aug 01 15:35:37.003419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-62f1de12-a014-4487-bad0-b4380ad84c82 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:37.004597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-62f1de12-a014-4487-bad0-b4380ad84c82 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:37.011586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62f1de12-a014-4487-bad0-b4380ad84c82 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:37.012471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62f1de12-a014-4487-bad0-b4380ad84c82 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:37.013771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62f1de12-a014-4487-bad0-b4380ad84c82 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:37.014598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 116/236] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:36 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:37.015085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62f1de12-a014-4487-bad0-b4380ad84c82 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:37.237273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-62f1de12-a014-4487-bad0-b4380ad84c82 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:37.245675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-62f1de12-a014-4487-bad0-b4380ad84c82 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1314 microversion: 2.1 time: 0.248359 Aug 01 15:35:37.246295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 121/237] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:36 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:38.017762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ad88ee20-c28d-4f29-8522-bd9d6f1f5dd4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:38.018329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ad88ee20-c28d-4f29-8522-bd9d6f1f5dd4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:38.025110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad88ee20-c28d-4f29-8522-bd9d6f1f5dd4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:38.025553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad88ee20-c28d-4f29-8522-bd9d6f1f5dd4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:38.025690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2dc6f2df-4148-496c-9f77-69be1b87c06c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:38.026262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2dc6f2df-4148-496c-9f77-69be1b87c06c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:38.026421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad88ee20-c28d-4f29-8522-bd9d6f1f5dd4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:38.026800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad88ee20-c28d-4f29-8522-bd9d6f1f5dd4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:38.035208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dc6f2df-4148-496c-9f77-69be1b87c06c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:38.035651 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dc6f2df-4148-496c-9f77-69be1b87c06c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:38.036425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dc6f2df-4148-496c-9f77-69be1b87c06c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:38.036856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dc6f2df-4148-496c-9f77-69be1b87c06c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:38.228954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ad88ee20-c28d-4f29-8522-bd9d6f1f5dd4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:38.238147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ad88ee20-c28d-4f29-8522-bd9d6f1f5dd4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1318 microversion: 2.1 time: 0.224161 Aug 01 15:35:38.238843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 117/238] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:38 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:38.244098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2dc6f2df-4148-496c-9f77-69be1b87c06c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:38.254287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2dc6f2df-4148-496c-9f77-69be1b87c06c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.232312 Aug 01 15:35:38.256292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 122/239] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:38 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:38.268871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1f1a6310-aa64-417f-af6a-5fb2a3ea4d89 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:38.269783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1f1a6310-aa64-417f-af6a-5fb2a3ea4d89 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:38.277304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f1a6310-aa64-417f-af6a-5fb2a3ea4d89 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:38.277769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f1a6310-aa64-417f-af6a-5fb2a3ea4d89 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:38.278656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f1a6310-aa64-417f-af6a-5fb2a3ea4d89 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:38.279291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f1a6310-aa64-417f-af6a-5fb2a3ea4d89 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:38.412490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1f1a6310-aa64-417f-af6a-5fb2a3ea4d89 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:38.420291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1f1a6310-aa64-417f-af6a-5fb2a3ea4d89 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1314 microversion: 2.1 time: 0.155746 Aug 01 15:35:38.420869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 118/240] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:38 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:39.260622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0b5f95d0-71d9-4535-a503-1739374daf5e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:39.261277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0b5f95d0-71d9-4535-a503-1739374daf5e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:39.267411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b5f95d0-71d9-4535-a503-1739374daf5e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:39.267856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b5f95d0-71d9-4535-a503-1739374daf5e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:39.268619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b5f95d0-71d9-4535-a503-1739374daf5e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:39.269152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b5f95d0-71d9-4535-a503-1739374daf5e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:39.276771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7219f3d4-72b3-4df4-a923-518bb27ddc14 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:39.277481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7219f3d4-72b3-4df4-a923-518bb27ddc14 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:39.284327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7219f3d4-72b3-4df4-a923-518bb27ddc14 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:39.284860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7219f3d4-72b3-4df4-a923-518bb27ddc14 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:39.285717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7219f3d4-72b3-4df4-a923-518bb27ddc14 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:39.286252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7219f3d4-72b3-4df4-a923-518bb27ddc14 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:39.481509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0b5f95d0-71d9-4535-a503-1739374daf5e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:39.489405 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0b5f95d0-71d9-4535-a503-1739374daf5e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1318 microversion: 2.1 time: 0.232610 Aug 01 15:35:39.490001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 123/241] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:39 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:39.494499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0624e7e1-5899-43ec-bb8d-63e0f5acf022 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:39.495104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0624e7e1-5899-43ec-bb8d-63e0f5acf022 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:39.501298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0624e7e1-5899-43ec-bb8d-63e0f5acf022 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:39.501730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0624e7e1-5899-43ec-bb8d-63e0f5acf022 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:39.502704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0624e7e1-5899-43ec-bb8d-63e0f5acf022 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:39.503119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0624e7e1-5899-43ec-bb8d-63e0f5acf022 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:39.503891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7219f3d4-72b3-4df4-a923-518bb27ddc14 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:39.511754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7219f3d4-72b3-4df4-a923-518bb27ddc14 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.239001 Aug 01 15:35:39.512825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 119/242] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:39 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:39.638172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0624e7e1-5899-43ec-bb8d-63e0f5acf022 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:39.649243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0624e7e1-5899-43ec-bb8d-63e0f5acf022 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1498 microversion: 2.1 time: 0.158153 Aug 01 15:35:39.649836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 124/243] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:39 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:40.217065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-83bf4b14-e340-4293-abfe-1f32a22a4ef5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:40.217558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-83bf4b14-e340-4293-abfe-1f32a22a4ef5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:40.223964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83bf4b14-e340-4293-abfe-1f32a22a4ef5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:40.224404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83bf4b14-e340-4293-abfe-1f32a22a4ef5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:40.225177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83bf4b14-e340-4293-abfe-1f32a22a4ef5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:40.225613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83bf4b14-e340-4293-abfe-1f32a22a4ef5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:40.251714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-83bf4b14-e340-4293-abfe-1f32a22a4ef5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:35:40.341199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-83bf4b14-e340-4293-abfe-1f32a22a4ef5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 204 len: 0 microversion: 2.1 time: 0.127113 Aug 01 15:35:40.344986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 120/244] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 15:35:40 2022] DELETE /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:35:40.355750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-64f021e0-6c1e-4378-92e5-b1e2a2a4362c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:40.357645 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-64f021e0-6c1e-4378-92e5-b1e2a2a4362c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:40.369041 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-64f021e0-6c1e-4378-92e5-b1e2a2a4362c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:40.369990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-64f021e0-6c1e-4378-92e5-b1e2a2a4362c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:40.371489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-64f021e0-6c1e-4378-92e5-b1e2a2a4362c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:40.372472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-64f021e0-6c1e-4378-92e5-b1e2a2a4362c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:40.510816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e53e834c-41b4-4380-b734-193abdf48987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:40.511534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e53e834c-41b4-4380-b734-193abdf48987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:40.518494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e53e834c-41b4-4380-b734-193abdf48987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:40.518976 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e53e834c-41b4-4380-b734-193abdf48987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:40.519726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e53e834c-41b4-4380-b734-193abdf48987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:40.530663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e53e834c-41b4-4380-b734-193abdf48987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:40.572520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-64f021e0-6c1e-4378-92e5-b1e2a2a4362c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:40.580766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-64f021e0-6c1e-4378-92e5-b1e2a2a4362c tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1504 microversion: 2.1 time: 0.233737 Aug 01 15:35:40.582069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 125/245] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:40 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:40.602353 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4372e7ce-5de4-4917-9ec6-387263100f60 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:40.610331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4372e7ce-5de4-4917-9ec6-387263100f60 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:40.617243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4372e7ce-5de4-4917-9ec6-387263100f60 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:40.624679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4372e7ce-5de4-4917-9ec6-387263100f60 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:40.625799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4372e7ce-5de4-4917-9ec6-387263100f60 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:40.626391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4372e7ce-5de4-4917-9ec6-387263100f60 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:40.811714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e53e834c-41b4-4380-b734-193abdf48987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:40.816260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:40.845173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e53e834c-41b4-4380-b734-193abdf48987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1318 microversion: 2.1 time: 0.335907 Aug 01 15:35:40.846082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 121/246] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:40 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:40.851579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-d6bddc34-3638-41c8-9f39-c9773920e710 req-f76932da-c0a1-4003-ad18-9a47848b204e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac32bea-aa1d-4abf-bd69-332c15fa2ebf", "name": "network-vif-plugged", "status": "completed", "tag": "12cd816a-227b-4146-9dfb-1360caef9173"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:40.862070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4372e7ce-5de4-4917-9ec6-387263100f60 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:40.868951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-d6bddc34-3638-41c8-9f39-c9773920e710 req-f76932da-c0a1-4003-ad18-9a47848b204e service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:40.869584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-d6bddc34-3638-41c8-9f39-c9773920e710 req-f76932da-c0a1-4003-ad18-9a47848b204e service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:40.876974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4372e7ce-5de4-4917-9ec6-387263100f60 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.290654 Aug 01 15:35:40.878474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 126/247] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:40 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:40.893173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-d6bddc34-3638-41c8-9f39-c9773920e710 req-f76932da-c0a1-4003-ad18-9a47848b204e service nova] Creating event network-vif-plugged:12cd816a-227b-4146-9dfb-1360caef9173 for instance fac32bea-aa1d-4abf-bd69-332c15fa2ebf on hv-cinder-84753 Aug 01 15:35:40.905369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-d6bddc34-3638-41c8-9f39-c9773920e710 req-f76932da-c0a1-4003-ad18-9a47848b204e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057680 Aug 01 15:35:40.906320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 122/248] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:35:41.608251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5cb9f373-cd15-485e-bf73-d74bebc62eaa tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:41.608878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5cb9f373-cd15-485e-bf73-d74bebc62eaa tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:41.615468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5cb9f373-cd15-485e-bf73-d74bebc62eaa tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:41.615928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5cb9f373-cd15-485e-bf73-d74bebc62eaa tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:41.616841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5cb9f373-cd15-485e-bf73-d74bebc62eaa tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:41.617207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5cb9f373-cd15-485e-bf73-d74bebc62eaa tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:41.772230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5cb9f373-cd15-485e-bf73-d74bebc62eaa tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:41.780750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5cb9f373-cd15-485e-bf73-d74bebc62eaa tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1504 microversion: 2.1 time: 0.178310 Aug 01 15:35:41.781609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 127/249] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:41 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:41.866651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9a78f966-7c96-4458-a17c-68dd8f2e683a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:41.867416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9a78f966-7c96-4458-a17c-68dd8f2e683a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:41.874549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a78f966-7c96-4458-a17c-68dd8f2e683a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:41.875049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a78f966-7c96-4458-a17c-68dd8f2e683a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:41.875785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a78f966-7c96-4458-a17c-68dd8f2e683a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:41.876219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a78f966-7c96-4458-a17c-68dd8f2e683a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:41.899575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8540131b-d198-4796-a660-b7a61fe9116f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:41.900189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8540131b-d198-4796-a660-b7a61fe9116f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:41.907127 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8540131b-d198-4796-a660-b7a61fe9116f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:41.907127 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8540131b-d198-4796-a660-b7a61fe9116f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:41.908383 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8540131b-d198-4796-a660-b7a61fe9116f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:41.908804 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8540131b-d198-4796-a660-b7a61fe9116f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:42.121232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9a78f966-7c96-4458-a17c-68dd8f2e683a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:42.124086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8540131b-d198-4796-a660-b7a61fe9116f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:42.130861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9a78f966-7c96-4458-a17c-68dd8f2e683a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1318 microversion: 2.1 time: 0.268945 Aug 01 15:35:42.131454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 123/250] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:41 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:42.142105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8540131b-d198-4796-a660-b7a61fe9116f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.236602 Aug 01 15:35:42.142105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 128/251] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:41 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:42.803767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b21ab365-8ca4-4207-b535-793042279cd5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:42.804789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b21ab365-8ca4-4207-b535-793042279cd5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:42.812929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b21ab365-8ca4-4207-b535-793042279cd5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:42.813760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b21ab365-8ca4-4207-b535-793042279cd5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:42.814636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b21ab365-8ca4-4207-b535-793042279cd5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:42.815143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b21ab365-8ca4-4207-b535-793042279cd5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:43.019203 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b21ab365-8ca4-4207-b535-793042279cd5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:43.028109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b21ab365-8ca4-4207-b535-793042279cd5 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1504 microversion: 2.1 time: 0.229256 Aug 01 15:35:43.045088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 129/252] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:42 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:43.153834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5baa8f20-c84b-4bf5-bb8d-a70856f02e41 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:43.154611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5baa8f20-c84b-4bf5-bb8d-a70856f02e41 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:43.154955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6e1768f4-8d53-46fd-93ff-cba9778f828c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:43.156126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6e1768f4-8d53-46fd-93ff-cba9778f828c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:43.163050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5baa8f20-c84b-4bf5-bb8d-a70856f02e41 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:43.163806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5baa8f20-c84b-4bf5-bb8d-a70856f02e41 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:43.164785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5baa8f20-c84b-4bf5-bb8d-a70856f02e41 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:43.165227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5baa8f20-c84b-4bf5-bb8d-a70856f02e41 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:43.166054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e1768f4-8d53-46fd-93ff-cba9778f828c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:43.166663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e1768f4-8d53-46fd-93ff-cba9778f828c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:43.167380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e1768f4-8d53-46fd-93ff-cba9778f828c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:43.167839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e1768f4-8d53-46fd-93ff-cba9778f828c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:43.170223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:43.437096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5baa8f20-c84b-4bf5-bb8d-a70856f02e41 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:43.442125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6e1768f4-8d53-46fd-93ff-cba9778f828c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:43.453997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6e1768f4-8d53-46fd-93ff-cba9778f828c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1318 microversion: 2.1 time: 0.304950 Aug 01 15:35:43.457197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5baa8f20-c84b-4bf5-bb8d-a70856f02e41 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.307487 Aug 01 15:35:43.458114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 130/253] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:43 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:43.477496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-8e7a2b3e-37ee-4493-b23b-2102812c9108 req-30f2b6d6-fe78-467c-92cd-3a41c91a21d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea0d11f-5554-415b-9456-b178b159d97d", "name": "network-vif-deleted", "tag": "ae4a7bba-58ff-4f00-bf70-317560da461d"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:43.490074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 124/254] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:43 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:43.496158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-8e7a2b3e-37ee-4493-b23b-2102812c9108 req-30f2b6d6-fe78-467c-92cd-3a41c91a21d9 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:43.496667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-8e7a2b3e-37ee-4493-b23b-2102812c9108 req-30f2b6d6-fe78-467c-92cd-3a41c91a21d9 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:43.509333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-8e7a2b3e-37ee-4493-b23b-2102812c9108 req-30f2b6d6-fe78-467c-92cd-3a41c91a21d9 service nova] Creating event network-vif-deleted:ae4a7bba-58ff-4f00-bf70-317560da461d for instance 5ea0d11f-5554-415b-9456-b178b159d97d on hv-cinder-84753 Aug 01 15:35:43.514461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-8e7a2b3e-37ee-4493-b23b-2102812c9108 req-30f2b6d6-fe78-467c-92cd-3a41c91a21d9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049204 Aug 01 15:35:43.515053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 131/255] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:35:44.049601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-645f66e4-3dd9-48f3-aafd-5538e0a80025 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:44.050437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-645f66e4-3dd9-48f3-aafd-5538e0a80025 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:44.069320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-645f66e4-3dd9-48f3-aafd-5538e0a80025 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:44.070277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-645f66e4-3dd9-48f3-aafd-5538e0a80025 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:44.071204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-645f66e4-3dd9-48f3-aafd-5538e0a80025 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:44.073747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-645f66e4-3dd9-48f3-aafd-5538e0a80025 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:44.130690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-645f66e4-3dd9-48f3-aafd-5538e0a80025 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:44.131304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-645f66e4-3dd9-48f3-aafd-5538e0a80025 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:44.131809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.objects.instance [None req-645f66e4-3dd9-48f3-aafd-5538e0a80025 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lazy-loading 'fault' on Instance uuid 5ea0d11f-5554-415b-9456-b178b159d97d {{(pid=124526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:35:44.279798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-645f66e4-3dd9-48f3-aafd-5538e0a80025 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:44.288331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-645f66e4-3dd9-48f3-aafd-5538e0a80025 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1304 microversion: 2.1 time: 0.242639 Aug 01 15:35:44.288930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 125/256] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:44 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1304 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:44.495412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fa3ba692-ad3e-428a-8ab4-65383b6b36bc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:44.496133 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fa3ba692-ad3e-428a-8ab4-65383b6b36bc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:44.498629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e379d2f4-556f-4f2c-a3d2-19eb71cab258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:44.499270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e379d2f4-556f-4f2c-a3d2-19eb71cab258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:44.503599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa3ba692-ad3e-428a-8ab4-65383b6b36bc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:44.504494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa3ba692-ad3e-428a-8ab4-65383b6b36bc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:44.505290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa3ba692-ad3e-428a-8ab4-65383b6b36bc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:44.505806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa3ba692-ad3e-428a-8ab4-65383b6b36bc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:44.507329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e379d2f4-556f-4f2c-a3d2-19eb71cab258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:44.507827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e379d2f4-556f-4f2c-a3d2-19eb71cab258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:44.508868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e379d2f4-556f-4f2c-a3d2-19eb71cab258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:44.509510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e379d2f4-556f-4f2c-a3d2-19eb71cab258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:44.719067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fa3ba692-ad3e-428a-8ab4-65383b6b36bc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:44.727685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fa3ba692-ad3e-428a-8ab4-65383b6b36bc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.237844 Aug 01 15:35:44.728472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 132/257] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:44 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:44.738301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e379d2f4-556f-4f2c-a3d2-19eb71cab258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:44.746108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e379d2f4-556f-4f2c-a3d2-19eb71cab258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1507 microversion: 2.1 time: 0.253315 Aug 01 15:35:44.747337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 126/258] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:44 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:45.311617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6bf7b440-391b-4782-ba2d-0a767a885e83 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:45.312859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6bf7b440-391b-4782-ba2d-0a767a885e83 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:45.330002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bf7b440-391b-4782-ba2d-0a767a885e83 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:45.331361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bf7b440-391b-4782-ba2d-0a767a885e83 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:45.332268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bf7b440-391b-4782-ba2d-0a767a885e83 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:45.332938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bf7b440-391b-4782-ba2d-0a767a885e83 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:45.533360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bf7b440-391b-4782-ba2d-0a767a885e83 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:45.534436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bf7b440-391b-4782-ba2d-0a767a885e83 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:45.534436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-6bf7b440-391b-4782-ba2d-0a767a885e83 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lazy-loading 'fault' on Instance uuid 5ea0d11f-5554-415b-9456-b178b159d97d {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:35:45.619653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6bf7b440-391b-4782-ba2d-0a767a885e83 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:45.642465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6bf7b440-391b-4782-ba2d-0a767a885e83 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1304 microversion: 2.1 time: 0.336243 Aug 01 15:35:45.643933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 133/259] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:45 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1304 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:45.757672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-13b6e60b-13d1-4f12-8d91-096d2da26fce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:45.760883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-13b6e60b-13d1-4f12-8d91-096d2da26fce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:45.781763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13b6e60b-13d1-4f12-8d91-096d2da26fce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:45.782612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13b6e60b-13d1-4f12-8d91-096d2da26fce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:45.784218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13b6e60b-13d1-4f12-8d91-096d2da26fce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:45.785011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13b6e60b-13d1-4f12-8d91-096d2da26fce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:45.968457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-13b6e60b-13d1-4f12-8d91-096d2da26fce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:45.976068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-13b6e60b-13d1-4f12-8d91-096d2da26fce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.227705 Aug 01 15:35:45.976809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 127/260] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:45 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:46.676034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b7a4b71d-62a5-47c8-80ac-881d0eae58f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:46.677189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b7a4b71d-62a5-47c8-80ac-881d0eae58f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:46.687114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7a4b71d-62a5-47c8-80ac-881d0eae58f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:46.687685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7a4b71d-62a5-47c8-80ac-881d0eae58f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:46.688513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7a4b71d-62a5-47c8-80ac-881d0eae58f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:46.689191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7a4b71d-62a5-47c8-80ac-881d0eae58f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:46.726669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7a4b71d-62a5-47c8-80ac-881d0eae58f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:46.727255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7a4b71d-62a5-47c8-80ac-881d0eae58f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:46.727837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-b7a4b71d-62a5-47c8-80ac-881d0eae58f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lazy-loading 'fault' on Instance uuid 5ea0d11f-5554-415b-9456-b178b159d97d {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:35:46.779519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b7a4b71d-62a5-47c8-80ac-881d0eae58f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6591fd1ff63406c86b847870570e56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8454f4c13e654ee58e6ff6265b7b85f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:46.789472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b7a4b71d-62a5-47c8-80ac-881d0eae58f7 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 200 len: 1304 microversion: 2.1 time: 0.117573 Aug 01 15:35:46.790280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 134/261] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:46 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:47.001156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dcbfd6b8-d559-463f-b44a-7ee06a8981fa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:47.002058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dcbfd6b8-d559-463f-b44a-7ee06a8981fa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:47.015896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcbfd6b8-d559-463f-b44a-7ee06a8981fa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:47.016600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcbfd6b8-d559-463f-b44a-7ee06a8981fa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:47.018743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcbfd6b8-d559-463f-b44a-7ee06a8981fa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:47.019201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcbfd6b8-d559-463f-b44a-7ee06a8981fa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:47.461574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dcbfd6b8-d559-463f-b44a-7ee06a8981fa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:47.473508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dcbfd6b8-d559-463f-b44a-7ee06a8981fa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.476927 Aug 01 15:35:47.474195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 128/262] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:46 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:47.812603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ce4b8f00-e991-4c40-93d0-f6f4193949d2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:47.816603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ce4b8f00-e991-4c40-93d0-f6f4193949d2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] [instance: 5ea0d11f-5554-415b-9456-b178b159d97d] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:47.827453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ce4b8f00-e991-4c40-93d0-f6f4193949d2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:47.829486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ce4b8f00-e991-4c40-93d0-f6f4193949d2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:47.831357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ce4b8f00-e991-4c40-93d0-f6f4193949d2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:47.832786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ce4b8f00-e991-4c40-93d0-f6f4193949d2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:47.864604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-ce4b8f00-e991-4c40-93d0-f6f4193949d2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] HTTP exception thrown: Instance 5ea0d11f-5554-415b-9456-b178b159d97d could not be found. Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ce4b8f00-e991-4c40-93d0-f6f4193949d2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Request method failure captured: Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d HTTP/1.1 Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_KfSWm1qskC1ua_elmSM-cVxKFvo52sRhAHEsPQ6X3jUnz9-tfpp9UCqMk-N7NUOMwabkUmy9KAo89fW1p0BgoEv7xkegQpXY3DTF6bXes8hfN2b9ZTM45h2IKEfWARNqRvUMrRYce0lqge4_m5p-l-m_3f11ViwMTPNjeg5dd4b58 Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 8454f4c13e654ee58e6ff6265b7b85f9 Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-VolumesActionsTest-2000577182 Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:35:47.866411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:35:47.868088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8454f4c13e654ee58e6ff6265b7b85f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8454f4c13e654ee58e6ff6265b7b85f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8454f4c13e654ee58e6ff6265b7b85f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8454f4c13e654ee58e6ff6265b7b85f9"}]}] Aug 01 15:35:47.868088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-VolumesActionsTest-2000577182 Aug 01 15:35:47.868088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 8454f4c13e654ee58e6ff6265b7b85f9 Aug 01 15:35:47.868088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-VolumesActionsTest-2000577182 Aug 01 15:35:47.868088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-VolumesActionsTest-2000577182-project Aug 01 15:35:47.868088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:35:47.868088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:35:47.868088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: c6591fd1ff63406c86b847870570e56c Aug 01 15:35:47.868088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-VolumesActionsTest-2000577182-project Aug 01 15:35:47.868088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 15:35:47.868088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance 5ea0d11f-5554-415b-9456-b178b159d97d could not be found. Aug 01 15:35:47.868088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '5ea0d11f-5554-415b-9456-b178b159d97d'} Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea0d11f-5554-415b-9456-b178b159d97d could not be found. Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:47.868927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea0d11f-5554-415b-9456-b178b159d97d could not be found. Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea0d11f-5554-415b-9456-b178b159d97d could not be found. Aug 01 15:35:47.870285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:35:47.871512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ce4b8f00-e991-4c40-93d0-f6f4193949d2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] Returning 404 to user: Instance 5ea0d11f-5554-415b-9456-b178b159d97d could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:47.871512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ce4b8f00-e991-4c40-93d0-f6f4193949d2 tempest-VolumesActionsTest-2000577182 tempest-VolumesActionsTest-2000577182-project] 10.222.0.83 "GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d" status: 404 len: 111 microversion: 2.1 time: 0.061145 Aug 01 15:35:47.871512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 135/263] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:47 2022] GET /compute/v2.1/servers/5ea0d11f-5554-415b-9456-b178b159d97d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:35:48.502602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-33174410-7695-4213-826c-0d30464dee42 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:48.503417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-33174410-7695-4213-826c-0d30464dee42 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:48.517008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33174410-7695-4213-826c-0d30464dee42 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:48.518595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33174410-7695-4213-826c-0d30464dee42 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:48.520436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33174410-7695-4213-826c-0d30464dee42 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:48.521274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33174410-7695-4213-826c-0d30464dee42 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:48.841030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-33174410-7695-4213-826c-0d30464dee42 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:48.848867 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-33174410-7695-4213-826c-0d30464dee42 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1522 microversion: 2.1 time: 0.356343 Aug 01 15:35:48.852416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 129/264] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:48 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:49.870392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b91da150-8c2b-425b-887a-39084b3ab77e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:49.871001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b91da150-8c2b-425b-887a-39084b3ab77e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:49.877271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b91da150-8c2b-425b-887a-39084b3ab77e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:49.877660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b91da150-8c2b-425b-887a-39084b3ab77e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:49.878449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b91da150-8c2b-425b-887a-39084b3ab77e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:49.878884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b91da150-8c2b-425b-887a-39084b3ab77e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:50.016318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b91da150-8c2b-425b-887a-39084b3ab77e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:50.024232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b91da150-8c2b-425b-887a-39084b3ab77e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1502 microversion: 2.1 time: 0.157865 Aug 01 15:35:50.024788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 136/265] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:49 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:50.045008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1d04e6ce-0530-4c40-ba2e-38e784d93826 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:50.045612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1d04e6ce-0530-4c40-ba2e-38e784d93826 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:50.051730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1d04e6ce-0530-4c40-ba2e-38e784d93826 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:50.052170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1d04e6ce-0530-4c40-ba2e-38e784d93826 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:50.052934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1d04e6ce-0530-4c40-ba2e-38e784d93826 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:50.053364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1d04e6ce-0530-4c40-ba2e-38e784d93826 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:50.187247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1d04e6ce-0530-4c40-ba2e-38e784d93826 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:50.194859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1d04e6ce-0530-4c40-ba2e-38e784d93826 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1516 microversion: 2.1 time: 0.153760 Aug 01 15:35:50.195429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 130/266] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:50 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:53.686492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bf4ed6e9-af08-4f98-af16-b166f20c595e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:53.688469 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bf4ed6e9-af08-4f98-af16-b166f20c595e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:53.697160 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf4ed6e9-af08-4f98-af16-b166f20c595e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:53.697584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf4ed6e9-af08-4f98-af16-b166f20c595e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:53.698389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf4ed6e9-af08-4f98-af16-b166f20c595e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:53.698831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf4ed6e9-af08-4f98-af16-b166f20c595e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:53.725154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-bf4ed6e9-af08-4f98-af16-b166f20c595e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lazy-loading 'flavor' on Instance uuid 98608629-6a0a-496b-9d09-cdb8a2e5118e {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:35:53.859635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bf4ed6e9-af08-4f98-af16-b166f20c595e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "POST /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e/action" status: 200 len: 32 microversion: 2.1 time: 0.178292 Aug 01 15:35:53.860706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 137/267] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 1 15:35:53 2022] POST /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:35:53.870457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-73ffdbee-d19e-445b-a8b7-e80e8cbd9d8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:53.872354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-73ffdbee-d19e-445b-a8b7-e80e8cbd9d8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:53.877068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:35:53.892831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73ffdbee-d19e-445b-a8b7-e80e8cbd9d8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:53.897463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73ffdbee-d19e-445b-a8b7-e80e8cbd9d8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:53.898776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73ffdbee-d19e-445b-a8b7-e80e8cbd9d8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:53.899577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73ffdbee-d19e-445b-a8b7-e80e8cbd9d8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:54.150286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-73ffdbee-d19e-445b-a8b7-e80e8cbd9d8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:54.159367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-73ffdbee-d19e-445b-a8b7-e80e8cbd9d8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.293257 Aug 01 15:35:54.160181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 131/268] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:53 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:54.831669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-73f00b6f-b5fa-4af6-aa54-efcbdd3539ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:54.833800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-73f00b6f-b5fa-4af6-aa54-efcbdd3539ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:54.854059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73f00b6f-b5fa-4af6-aa54-efcbdd3539ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:54.862465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73f00b6f-b5fa-4af6-aa54-efcbdd3539ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:54.863544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73f00b6f-b5fa-4af6-aa54-efcbdd3539ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:54.863992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73f00b6f-b5fa-4af6-aa54-efcbdd3539ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:54.897867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-73f00b6f-b5fa-4af6-aa54-efcbdd3539ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/ips" status: 200 len: 146 microversion: 2.1 time: 0.088906 Aug 01 15:35:54.898535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 138/269] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 1 15:35:54 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/ips => generated 146 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:35:55.181158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0efa973a-e223-4679-abbc-afe884944508 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:55.181780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0efa973a-e223-4679-abbc-afe884944508 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:55.189239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0efa973a-e223-4679-abbc-afe884944508 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:55.189682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0efa973a-e223-4679-abbc-afe884944508 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:55.190540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0efa973a-e223-4679-abbc-afe884944508 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:55.191607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0efa973a-e223-4679-abbc-afe884944508 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:55.348600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0efa973a-e223-4679-abbc-afe884944508 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:55.357089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0efa973a-e223-4679-abbc-afe884944508 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.180425 Aug 01 15:35:55.370738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 132/270] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:55 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:56.381025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b7afa5e7-fb05-40d2-b846-092b878c9e65 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:56.382023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b7afa5e7-fb05-40d2-b846-092b878c9e65 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:56.388260 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7afa5e7-fb05-40d2-b846-092b878c9e65 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:56.388880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7afa5e7-fb05-40d2-b846-092b878c9e65 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:56.389730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7afa5e7-fb05-40d2-b846-092b878c9e65 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:56.390325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7afa5e7-fb05-40d2-b846-092b878c9e65 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:56.555878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b7afa5e7-fb05-40d2-b846-092b878c9e65 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:56.563940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b7afa5e7-fb05-40d2-b846-092b878c9e65 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.186908 Aug 01 15:35:56.564829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 139/271] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:56 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:57.600216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f9dfdb03-7c4a-45f3-bdde-5ae4b181eb2b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:57.601916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f9dfdb03-7c4a-45f3-bdde-5ae4b181eb2b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:57.612665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9dfdb03-7c4a-45f3-bdde-5ae4b181eb2b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:57.613803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9dfdb03-7c4a-45f3-bdde-5ae4b181eb2b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:57.615094 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9dfdb03-7c4a-45f3-bdde-5ae4b181eb2b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:57.615932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9dfdb03-7c4a-45f3-bdde-5ae4b181eb2b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:57.808420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f9dfdb03-7c4a-45f3-bdde-5ae4b181eb2b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:57.818153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f9dfdb03-7c4a-45f3-bdde-5ae4b181eb2b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.231415 Aug 01 15:35:57.819601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 133/272] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:57 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:58.843858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0d24efed-2947-418d-a590-fddbc885691d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:58.845342 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0d24efed-2947-418d-a590-fddbc885691d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:58.851926 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d24efed-2947-418d-a590-fddbc885691d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:58.852605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d24efed-2947-418d-a590-fddbc885691d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:58.853436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d24efed-2947-418d-a590-fddbc885691d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:58.853917 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d24efed-2947-418d-a590-fddbc885691d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:59.149835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0d24efed-2947-418d-a590-fddbc885691d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:59.176330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0d24efed-2947-418d-a590-fddbc885691d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.336744 Aug 01 15:35:59.179383 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 140/273] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:58 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:35:59.839236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5b322312-a7f3-4c43-a930-8d38e5f62fad tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc44b8e2-1395-40e5-8b00-562391bb4313"}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:59.845474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5b322312-a7f3-4c43-a930-8d38e5f62fad tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:59.871213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b322312-a7f3-4c43-a930-8d38e5f62fad tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:59.875425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b322312-a7f3-4c43-a930-8d38e5f62fad tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:59.876420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b322312-a7f3-4c43-a930-8d38e5f62fad tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:59.877594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b322312-a7f3-4c43-a930-8d38e5f62fad tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:00.207580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bf8d5f36-192b-429d-9446-f11f4b1f3c97 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:00.208902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bf8d5f36-192b-429d-9446-f11f4b1f3c97 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:00.228736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=66 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:00.240294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf8d5f36-192b-429d-9446-f11f4b1f3c97 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:00.244365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf8d5f36-192b-429d-9446-f11f4b1f3c97 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:00.248962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf8d5f36-192b-429d-9446-f11f4b1f3c97 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:00.250784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf8d5f36-192b-429d-9446-f11f4b1f3c97 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:00.546771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5b322312-a7f3-4c43-a930-8d38e5f62fad tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "POST /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721615 Aug 01 15:36:00.549105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 134/274] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 1 15:35:59 2022] POST /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 194 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:36:00.697446 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bf8d5f36-192b-429d-9446-f11f4b1f3c97 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:00.720894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bf8d5f36-192b-429d-9446-f11f4b1f3c97 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.517444 Aug 01 15:36:00.724085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 141/275] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:00 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:00.970780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1d220198-bd62-45a6-83bc-9bd988a0565c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:00.972953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1d220198-bd62-45a6-83bc-9bd988a0565c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:00.999771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1d220198-bd62-45a6-83bc-9bd988a0565c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:01.000328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1d220198-bd62-45a6-83bc-9bd988a0565c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:01.004003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1d220198-bd62-45a6-83bc-9bd988a0565c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:01.006579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1d220198-bd62-45a6-83bc-9bd988a0565c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:01.071499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1d220198-bd62-45a6-83bc-9bd988a0565c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/ips" status: 200 len: 150 microversion: 2.1 time: 0.107226 Aug 01 15:36:01.078882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 135/276] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 1 15:36:00 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/ips => generated 150 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:36:01.757491 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8364edd9-e597-48fe-a2de-66f8d4df5315 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:01.759484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8364edd9-e597-48fe-a2de-66f8d4df5315 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:01.778909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8364edd9-e597-48fe-a2de-66f8d4df5315 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:01.779700 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8364edd9-e597-48fe-a2de-66f8d4df5315 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:01.781322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8364edd9-e597-48fe-a2de-66f8d4df5315 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:01.782005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8364edd9-e597-48fe-a2de-66f8d4df5315 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:02.448231 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8364edd9-e597-48fe-a2de-66f8d4df5315 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:02.470687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8364edd9-e597-48fe-a2de-66f8d4df5315 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.728416 Aug 01 15:36:02.472094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 142/277] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:01 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:02.975553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-92c9e7ee-c2e4-4d80-b0eb-ad1020ea6c13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3a8e36e-425b-4e66-aa20-f5f4927c91e4"}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:02.987066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-92c9e7ee-c2e4-4d80-b0eb-ad1020ea6c13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:02.987066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92c9e7ee-c2e4-4d80-b0eb-ad1020ea6c13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:02.987066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92c9e7ee-c2e4-4d80-b0eb-ad1020ea6c13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:02.989504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92c9e7ee-c2e4-4d80-b0eb-ad1020ea6c13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:02.990943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92c9e7ee-c2e4-4d80-b0eb-ad1020ea6c13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:03.500214 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e1704d83-b547-4c37-bdac-1bc4f64305fd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:03.502849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e1704d83-b547-4c37-bdac-1bc4f64305fd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:03.516610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e1704d83-b547-4c37-bdac-1bc4f64305fd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:03.523053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e1704d83-b547-4c37-bdac-1bc4f64305fd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:03.523945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e1704d83-b547-4c37-bdac-1bc4f64305fd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:03.524393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e1704d83-b547-4c37-bdac-1bc4f64305fd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:03.608558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:03.761580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-92c9e7ee-c2e4-4d80-b0eb-ad1020ea6c13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "POST /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784171 Aug 01 15:36:03.767880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 136/278] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 1 15:36:02 2022] POST /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 194 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:36:04.000634 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e1704d83-b547-4c37-bdac-1bc4f64305fd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:04.015246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e1704d83-b547-4c37-bdac-1bc4f64305fd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.517286 Aug 01 15:36:04.038698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 143/279] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:03 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:05.077442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8b9a0aa5-3134-44e5-a4e9-03288a043e01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:05.081677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8b9a0aa5-3134-44e5-a4e9-03288a043e01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:05.128905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b9a0aa5-3134-44e5-a4e9-03288a043e01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:05.132695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b9a0aa5-3134-44e5-a4e9-03288a043e01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:05.139673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b9a0aa5-3134-44e5-a4e9-03288a043e01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:05.145238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b9a0aa5-3134-44e5-a4e9-03288a043e01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:05.630717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8b9a0aa5-3134-44e5-a4e9-03288a043e01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:05.651756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8b9a0aa5-3134-44e5-a4e9-03288a043e01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.610322 Aug 01 15:36:05.680445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 137/280] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:05 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:06.691238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-61d73b5b-b6e7-46c4-b467-5bc174593ba9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:06.691884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-61d73b5b-b6e7-46c4-b467-5bc174593ba9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:06.716578 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-61d73b5b-b6e7-46c4-b467-5bc174593ba9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:06.717357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-61d73b5b-b6e7-46c4-b467-5bc174593ba9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:06.718433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-61d73b5b-b6e7-46c4-b467-5bc174593ba9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:06.719035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-61d73b5b-b6e7-46c4-b467-5bc174593ba9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:07.161766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-61d73b5b-b6e7-46c4-b467-5bc174593ba9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:07.178082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-61d73b5b-b6e7-46c4-b467-5bc174593ba9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.490757 Aug 01 15:36:07.191988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 144/281] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:06 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:08.180616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bee68505-ad53-43cf-b882-94b4494f5b89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:08.181753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bee68505-ad53-43cf-b882-94b4494f5b89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:08.202541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bee68505-ad53-43cf-b882-94b4494f5b89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:08.203377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bee68505-ad53-43cf-b882-94b4494f5b89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:08.205751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0d8e1d19-ae0a-48a2-b5f6-68d16f88e2f5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:08.206531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0d8e1d19-ae0a-48a2-b5f6-68d16f88e2f5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:08.207901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bee68505-ad53-43cf-b882-94b4494f5b89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:08.210643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bee68505-ad53-43cf-b882-94b4494f5b89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:08.222544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d8e1d19-ae0a-48a2-b5f6-68d16f88e2f5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:08.235930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d8e1d19-ae0a-48a2-b5f6-68d16f88e2f5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:08.242349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d8e1d19-ae0a-48a2-b5f6-68d16f88e2f5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:08.245198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d8e1d19-ae0a-48a2-b5f6-68d16f88e2f5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:08.257655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bee68505-ad53-43cf-b882-94b4494f5b89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/ips" status: 200 len: 152 microversion: 2.20 time: 0.084833 Aug 01 15:36:08.266038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 138/282] 10.222.0.83 () {60 vars in 1289 bytes} [Mon Aug 1 15:36:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/ips => generated 152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:36:08.633461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0d8e1d19-ae0a-48a2-b5f6-68d16f88e2f5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:08.639529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:08.657442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0d8e1d19-ae0a-48a2-b5f6-68d16f88e2f5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.454366 Aug 01 15:36:08.658286 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 145/283] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:08 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:08.994205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4a174378-259b-4f33-b9ca-ba3e2a4d6a54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:09.004395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a174378-259b-4f33-b9ca-ba3e2a4d6a54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:09.004885 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a174378-259b-4f33-b9ca-ba3e2a4d6a54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:09.130080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4a174378-259b-4f33-b9ca-ba3e2a4d6a54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Going to try to stop instance {{(pid=124526) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 15:36:09.244197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4a174378-259b-4f33-b9ca-ba3e2a4d6a54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "POST /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/action" status: 202 len: 0 microversion: 2.1 time: 0.254569 Aug 01 15:36:09.244795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 139/284] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 1 15:36:08 2022] POST /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:36:09.254752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5d2d11ec-b4dc-4ec8-95ef-9a8fc96e6d67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:09.255363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5d2d11ec-b4dc-4ec8-95ef-9a8fc96e6d67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:09.270936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d2d11ec-b4dc-4ec8-95ef-9a8fc96e6d67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:09.271603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d2d11ec-b4dc-4ec8-95ef-9a8fc96e6d67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:09.273003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d2d11ec-b4dc-4ec8-95ef-9a8fc96e6d67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:09.276906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d2d11ec-b4dc-4ec8-95ef-9a8fc96e6d67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:09.680577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d2d11ec-b4dc-4ec8-95ef-9a8fc96e6d67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:09.699951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aeb6bc68-370d-4755-91bf-c702e0edd929 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:09.701122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aeb6bc68-370d-4755-91bf-c702e0edd929 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:09.705790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5d2d11ec-b4dc-4ec8-95ef-9a8fc96e6d67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.448281 Aug 01 15:36:09.711329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aeb6bc68-370d-4755-91bf-c702e0edd929 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:09.711753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 146/285] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:09 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:09.712417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aeb6bc68-370d-4755-91bf-c702e0edd929 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:09.713407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aeb6bc68-370d-4755-91bf-c702e0edd929 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:09.714023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aeb6bc68-370d-4755-91bf-c702e0edd929 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:10.059360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aeb6bc68-370d-4755-91bf-c702e0edd929 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:10.094160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aeb6bc68-370d-4755-91bf-c702e0edd929 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.411162 Aug 01 15:36:10.103709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 140/286] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:09 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:10.741832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1bed2701-023e-4c05-b3d8-3ad8aebff180 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:10.746831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1bed2701-023e-4c05-b3d8-3ad8aebff180 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:10.760695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1bed2701-023e-4c05-b3d8-3ad8aebff180 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:10.762641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1bed2701-023e-4c05-b3d8-3ad8aebff180 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:10.765631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1bed2701-023e-4c05-b3d8-3ad8aebff180 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:10.767271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1bed2701-023e-4c05-b3d8-3ad8aebff180 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:11.124214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4026214f-55ae-4db7-a5c5-32eb184e4534 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:11.124931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4026214f-55ae-4db7-a5c5-32eb184e4534 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:11.143390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4026214f-55ae-4db7-a5c5-32eb184e4534 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:11.144308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4026214f-55ae-4db7-a5c5-32eb184e4534 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:11.146243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4026214f-55ae-4db7-a5c5-32eb184e4534 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:11.147627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4026214f-55ae-4db7-a5c5-32eb184e4534 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:11.261290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1bed2701-023e-4c05-b3d8-3ad8aebff180 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:11.285473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1bed2701-023e-4c05-b3d8-3ad8aebff180 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.548224 Aug 01 15:36:11.287019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 147/287] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:10 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:11.392106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-58400d3b-e952-4014-a2fa-3a3421fcd872 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:11.393431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-58400d3b-e952-4014-a2fa-3a3421fcd872 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:11.410930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-58400d3b-e952-4014-a2fa-3a3421fcd872 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:11.421754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-58400d3b-e952-4014-a2fa-3a3421fcd872 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:11.425279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-58400d3b-e952-4014-a2fa-3a3421fcd872 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:11.428153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-58400d3b-e952-4014-a2fa-3a3421fcd872 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:11.575144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-58400d3b-e952-4014-a2fa-3a3421fcd872 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lazy-loading 'flavor' on Instance uuid 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:36:11.721837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4026214f-55ae-4db7-a5c5-32eb184e4534 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:11.732744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4026214f-55ae-4db7-a5c5-32eb184e4534 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.611428 Aug 01 15:36:11.733957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 141/288] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:11 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:12.034933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-58400d3b-e952-4014-a2fa-3a3421fcd872 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "POST /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/action" status: 202 len: 0 microversion: 2.20 time: 0.642607 Aug 01 15:36:12.036437 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 148/289] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 1 15:36:11 2022] POST /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:12.092550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-da33d775-12e7-41ef-8106-d156965997a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:12.095968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-da33d775-12e7-41ef-8106-d156965997a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:12.110651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da33d775-12e7-41ef-8106-d156965997a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:12.111578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da33d775-12e7-41ef-8106-d156965997a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:12.114559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da33d775-12e7-41ef-8106-d156965997a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:12.115269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da33d775-12e7-41ef-8106-d156965997a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:12.319372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-08428fa1-c6f6-4ff7-9b1e-711591ca8a67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:12.332434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-08428fa1-c6f6-4ff7-9b1e-711591ca8a67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:12.345013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08428fa1-c6f6-4ff7-9b1e-711591ca8a67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:12.345853 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08428fa1-c6f6-4ff7-9b1e-711591ca8a67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:12.348128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08428fa1-c6f6-4ff7-9b1e-711591ca8a67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:12.348579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08428fa1-c6f6-4ff7-9b1e-711591ca8a67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:12.689622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-da33d775-12e7-41ef-8106-d156965997a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:12.698319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-da33d775-12e7-41ef-8106-d156965997a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:12.699911 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-da33d775-12e7-41ef-8106-d156965997a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:12.702175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-da33d775-12e7-41ef-8106-d156965997a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.659632 Aug 01 15:36:12.705277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 142/290] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:12.745680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-08428fa1-c6f6-4ff7-9b1e-711591ca8a67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:12.760520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-be35ff64-3a10-4f16-8a7c-327a32be92d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:12.761794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-be35ff64-3a10-4f16-8a7c-327a32be92d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:12.766012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-08428fa1-c6f6-4ff7-9b1e-711591ca8a67 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.448971 Aug 01 15:36:12.770099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 149/291] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:12 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:12.776959 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be35ff64-3a10-4f16-8a7c-327a32be92d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:12.777557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be35ff64-3a10-4f16-8a7c-327a32be92d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:12.778565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be35ff64-3a10-4f16-8a7c-327a32be92d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:12.779161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be35ff64-3a10-4f16-8a7c-327a32be92d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:13.361647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-be35ff64-3a10-4f16-8a7c-327a32be92d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:13.387396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-be35ff64-3a10-4f16-8a7c-327a32be92d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.634651 Aug 01 15:36:13.398831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 143/292] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:12 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:13.733166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-587177f6-b1f7-4929-9e59-0c6a17090795 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:13.736431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-587177f6-b1f7-4929-9e59-0c6a17090795 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:13.749156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-587177f6-b1f7-4929-9e59-0c6a17090795 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:13.750095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-587177f6-b1f7-4929-9e59-0c6a17090795 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:13.751226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-587177f6-b1f7-4929-9e59-0c6a17090795 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:13.751881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-587177f6-b1f7-4929-9e59-0c6a17090795 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:13.795582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bfbb486b-c17f-47b4-8906-0eb396526c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:13.796417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bfbb486b-c17f-47b4-8906-0eb396526c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:13.814744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bfbb486b-c17f-47b4-8906-0eb396526c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:13.819514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bfbb486b-c17f-47b4-8906-0eb396526c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:13.820779 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bfbb486b-c17f-47b4-8906-0eb396526c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:13.821562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bfbb486b-c17f-47b4-8906-0eb396526c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:14.786366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-587177f6-b1f7-4929-9e59-0c6a17090795 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:14.840230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-587177f6-b1f7-4929-9e59-0c6a17090795 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:14.856562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-587177f6-b1f7-4929-9e59-0c6a17090795 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:14.858825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-587177f6-b1f7-4929-9e59-0c6a17090795 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 1.131435 Aug 01 15:36:14.864388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 150/293] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:14.877215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-84f907ac-ec29-46b8-acc4-0e88946df53b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c504c13-f960-4702-b836-37f286cdce5c", "device": "/dev/sdb"}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:14.884784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-84f907ac-ec29-46b8-acc4-0e88946df53b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:14.905019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84f907ac-ec29-46b8-acc4-0e88946df53b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:14.905816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84f907ac-ec29-46b8-acc4-0e88946df53b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:14.906873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84f907ac-ec29-46b8-acc4-0e88946df53b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:14.907517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84f907ac-ec29-46b8-acc4-0e88946df53b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:14.989367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bfbb486b-c17f-47b4-8906-0eb396526c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:15.020662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bfbb486b-c17f-47b4-8906-0eb396526c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 1.229736 Aug 01 15:36:15.029307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 144/294] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:13 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:36:15.052004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3db6bb63-5ee7-402b-94f6-d40ea9a51d67 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:15.057339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3db6bb63-5ee7-402b-94f6-d40ea9a51d67 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:15.089283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3db6bb63-5ee7-402b-94f6-d40ea9a51d67 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:15.090583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3db6bb63-5ee7-402b-94f6-d40ea9a51d67 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:15.095301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3db6bb63-5ee7-402b-94f6-d40ea9a51d67 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:15.103258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3db6bb63-5ee7-402b-94f6-d40ea9a51d67 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:15.720641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-84f907ac-ec29-46b8-acc4-0e88946df53b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "POST /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.854598 Aug 01 15:36:15.721283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 151/295] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 1 15:36:14 2022] POST /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:36:15.846112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2829c9fe-cb98-4403-b5d8-085c0f8e0011 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Action: 'create', calling method: .version_select at 0x7feb161e7b80>, body: {"keypair": {"name": "tempest-keypair-241029234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyLyN11xfYvuTjRQgY2sd/60r23fX0c/Fw+nzwcVuk3LnJwLm6W7af/ehgDL5Ti7ZJq18gDRTw8jV2pyvI2JLS6bFcWrNApFB6K+FKAyf3Wcz8pp4STSsDu1QFUv7piJA=="}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:15.863981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3db6bb63-5ee7-402b-94f6-d40ea9a51d67 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:15.887064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3db6bb63-5ee7-402b-94f6-d40ea9a51d67 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.855556 Aug 01 15:36:15.894324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 145/296] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:15 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:15.916636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-185ec13d-8171-46b8-99c2-6cd4d1303f63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:15.920988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-185ec13d-8171-46b8-99c2-6cd4d1303f63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:15.947237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-2829c9fe-cb98-4403-b5d8-085c0f8e0011 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'key_pairs'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:36:15.952009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-2829c9fe-cb98-4403-b5d8-085c0f8e0011 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for user 4001e8ec57b34f57aae1654fad9217f8 and project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'key_pairs'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:36:15.954728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-185ec13d-8171-46b8-99c2-6cd4d1303f63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:15.955431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-185ec13d-8171-46b8-99c2-6cd4d1303f63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:15.956451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-185ec13d-8171-46b8-99c2-6cd4d1303f63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:15.956894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-185ec13d-8171-46b8-99c2-6cd4d1303f63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:16.008866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2829c9fe-cb98-4403-b5d8-085c0f8e0011 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170762 Aug 01 15:36:16.011157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 152/297] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 1 15:36:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:36:16.068650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4a85debd-10ee-4c78-8a74-2ed37e2697e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:16.069398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4a85debd-10ee-4c78-8a74-2ed37e2697e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:16.083334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a85debd-10ee-4c78-8a74-2ed37e2697e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:16.083784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a85debd-10ee-4c78-8a74-2ed37e2697e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:16.084714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a85debd-10ee-4c78-8a74-2ed37e2697e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:16.084997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a85debd-10ee-4c78-8a74-2ed37e2697e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:16.357461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-185ec13d-8171-46b8-99c2-6cd4d1303f63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:16.390975 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-185ec13d-8171-46b8-99c2-6cd4d1303f63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:16.394481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-185ec13d-8171-46b8-99c2-6cd4d1303f63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:16.396387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-185ec13d-8171-46b8-99c2-6cd4d1303f63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.500431 Aug 01 15:36:16.397320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 146/298] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:16.527157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4a85debd-10ee-4c78-8a74-2ed37e2697e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:16.537683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4a85debd-10ee-4c78-8a74-2ed37e2697e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.473586 Aug 01 15:36:16.539426 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 153/299] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:16 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:36:16.919015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1cfbea34-939b-450c-b664-4b565a63351c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:16.919939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1cfbea34-939b-450c-b664-4b565a63351c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:16.928190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cfbea34-939b-450c-b664-4b565a63351c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:16.931424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cfbea34-939b-450c-b664-4b565a63351c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:16.932448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cfbea34-939b-450c-b664-4b565a63351c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:16.934168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cfbea34-939b-450c-b664-4b565a63351c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:17.422256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a0b125ff-d786-4881-a246-ef9577c66b98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:17.422962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a0b125ff-d786-4881-a246-ef9577c66b98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:17.443834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0b125ff-d786-4881-a246-ef9577c66b98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:17.448074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0b125ff-d786-4881-a246-ef9577c66b98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:17.449218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0b125ff-d786-4881-a246-ef9577c66b98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:17.451342 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0b125ff-d786-4881-a246-ef9577c66b98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:17.623339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1cfbea34-939b-450c-b664-4b565a63351c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:17.638491 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1cfbea34-939b-450c-b664-4b565a63351c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.723181 Aug 01 15:36:17.643467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 147/300] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:16 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:17.650363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f5a5bc9c-1ef0-4a70-bb4b-17db4faaaba1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:17.655474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f5a5bc9c-1ef0-4a70-bb4b-17db4faaaba1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:17.675944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f5a5bc9c-1ef0-4a70-bb4b-17db4faaaba1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:17.676837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f5a5bc9c-1ef0-4a70-bb4b-17db4faaaba1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:17.677989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f5a5bc9c-1ef0-4a70-bb4b-17db4faaaba1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:17.680325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f5a5bc9c-1ef0-4a70-bb4b-17db4faaaba1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:17.931411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a0b125ff-d786-4881-a246-ef9577c66b98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:17.940687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a0b125ff-d786-4881-a246-ef9577c66b98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:17.951941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a0b125ff-d786-4881-a246-ef9577c66b98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:17.953151 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a0b125ff-d786-4881-a246-ef9577c66b98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.536291 Aug 01 15:36:17.953708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 154/301] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:36:18.182191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f5a5bc9c-1ef0-4a70-bb4b-17db4faaaba1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:18.197170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f5a5bc9c-1ef0-4a70-bb4b-17db4faaaba1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.546032 Aug 01 15:36:18.198403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 148/302] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:17 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:18.681180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-64b9438a-0ae4-459b-ae27-ab4804dbda92 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:18.681880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-64b9438a-0ae4-459b-ae27-ab4804dbda92 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:18.700780 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-64b9438a-0ae4-459b-ae27-ab4804dbda92 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:18.711078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-64b9438a-0ae4-459b-ae27-ab4804dbda92 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:18.713284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-64b9438a-0ae4-459b-ae27-ab4804dbda92 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:18.714444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-64b9438a-0ae4-459b-ae27-ab4804dbda92 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:18.990037 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5d56b9bf-6416-4313-93dc-4d62e8855deb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:18.991390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5d56b9bf-6416-4313-93dc-4d62e8855deb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:19.037925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d56b9bf-6416-4313-93dc-4d62e8855deb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:19.037925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d56b9bf-6416-4313-93dc-4d62e8855deb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:19.040742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d56b9bf-6416-4313-93dc-4d62e8855deb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:19.044285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d56b9bf-6416-4313-93dc-4d62e8855deb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:19.351596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-64b9438a-0ae4-459b-ae27-ab4804dbda92 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:19.360553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-64b9438a-0ae4-459b-ae27-ab4804dbda92 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.695423 Aug 01 15:36:19.361049 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 155/303] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:18 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:19.370615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c2eaab1d-f9c3-451e-b932-c00c3533bc5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:19.379799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c2eaab1d-f9c3-451e-b932-c00c3533bc5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:19.393164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2eaab1d-f9c3-451e-b932-c00c3533bc5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:19.393630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2eaab1d-f9c3-451e-b932-c00c3533bc5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:19.394461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2eaab1d-f9c3-451e-b932-c00c3533bc5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:19.395064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2eaab1d-f9c3-451e-b932-c00c3533bc5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:19.505103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5d56b9bf-6416-4313-93dc-4d62e8855deb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:19.554993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5d56b9bf-6416-4313-93dc-4d62e8855deb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:19.557115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5d56b9bf-6416-4313-93dc-4d62e8855deb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:19.568342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5d56b9bf-6416-4313-93dc-4d62e8855deb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.585532 Aug 01 15:36:19.583249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 149/304] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:19.900162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c2eaab1d-f9c3-451e-b932-c00c3533bc5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:19.927258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c2eaab1d-f9c3-451e-b932-c00c3533bc5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.560565 Aug 01 15:36:19.928237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 156/305] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:19 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:20.384611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1b7c7021-82ea-4a9e-bd7e-51a497d6e921 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:20.385240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1b7c7021-82ea-4a9e-bd7e-51a497d6e921 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:20.405521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b7c7021-82ea-4a9e-bd7e-51a497d6e921 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:20.415011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b7c7021-82ea-4a9e-bd7e-51a497d6e921 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:20.416745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b7c7021-82ea-4a9e-bd7e-51a497d6e921 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:20.421071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b7c7021-82ea-4a9e-bd7e-51a497d6e921 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:20.829303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c2979ab6-8bbf-459d-aac7-c51bd0413d2d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Action: 'create', calling method: .version_select at 0x7feb16c63820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1101178689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhIMf8LYAh2gOsJ0up3WT6dGdyWP0cAcWIxHs/gwClVPo70MkJsDLF4ohD397zbNpxgm2s43WM9wTYbhPGTEpc61N4n0SpieTSz+ZEho/P43jHm/SAjNu+8Y8AMze2tGQ=="}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:20.854238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-c2979ab6-8bbf-459d-aac7-c51bd0413d2d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Getting quotas for project 63125418cd9949cdbf76099952b31950. Resources: {'key_pairs'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:36:20.860185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-c2979ab6-8bbf-459d-aac7-c51bd0413d2d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Getting quotas for user 6d903b4429664fceaa1344f1b99791dd and project 63125418cd9949cdbf76099952b31950. Resources: {'key_pairs'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:36:20.921013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1b7c7021-82ea-4a9e-bd7e-51a497d6e921 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:20.935297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1b7c7021-82ea-4a9e-bd7e-51a497d6e921 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.555035 Aug 01 15:36:20.959474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 157/306] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:20 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:20.969757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-69df8395-21ac-4427-9337-f6972c90942b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:20.970656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-69df8395-21ac-4427-9337-f6972c90942b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:20.980166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c2979ab6-8bbf-459d-aac7-c51bd0413d2d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.651567 Aug 01 15:36:20.984205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 150/307] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 1 15:36:20 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:36:21.016815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-69df8395-21ac-4427-9337-f6972c90942b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:21.017058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-746709105", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f1bed6a-c264-454e-855c-f998e359854d"}], "security_groups": [{"name": "tempest-securitygroup--2051430912"}], "key_name": "tempest-keypair-241029234", "user_data": "}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:21.053050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-69df8395-21ac-4427-9337-f6972c90942b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:21.055204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-69df8395-21ac-4427-9337-f6972c90942b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:21.065930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-69df8395-21ac-4427-9337-f6972c90942b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:21.556063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.network.neutron [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] validate_networks() for [('2f1bed6a-c264-454e-855c-f998e359854d', None, None, None, None, None)] {{(pid=124526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:36:21.805426 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-69df8395-21ac-4427-9337-f6972c90942b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:21.819140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-69df8395-21ac-4427-9337-f6972c90942b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:21.826261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-69df8395-21ac-4427-9337-f6972c90942b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:21.831002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-69df8395-21ac-4427-9337-f6972c90942b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.869160 Aug 01 15:36:21.832015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 158/308] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:21.844674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8ffc375d-a81f-4b36-8f7e-ebf077be4ba7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:21.848626 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8ffc375d-a81f-4b36-8f7e-ebf077be4ba7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:21.873949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ffc375d-a81f-4b36-8f7e-ebf077be4ba7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:21.874821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ffc375d-a81f-4b36-8f7e-ebf077be4ba7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:21.876410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ffc375d-a81f-4b36-8f7e-ebf077be4ba7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:21.877033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ffc375d-a81f-4b36-8f7e-ebf077be4ba7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:22.284173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8ffc375d-a81f-4b36-8f7e-ebf077be4ba7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:22.305239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8ffc375d-a81f-4b36-8f7e-ebf077be4ba7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.471261 Aug 01 15:36:22.320693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 159/309] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:21 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:22.333843 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-73166436-a1c4-435c-9513-fbc1d5fc2d9f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:22.335298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-73166436-a1c4-435c-9513-fbc1d5fc2d9f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:22.347370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73166436-a1c4-435c-9513-fbc1d5fc2d9f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:22.348173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73166436-a1c4-435c-9513-fbc1d5fc2d9f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:22.349366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73166436-a1c4-435c-9513-fbc1d5fc2d9f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:22.350358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73166436-a1c4-435c-9513-fbc1d5fc2d9f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:22.357769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:23.072977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-73166436-a1c4-435c-9513-fbc1d5fc2d9f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:23.110549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-73166436-a1c4-435c-9513-fbc1d5fc2d9f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.782544 Aug 01 15:36:23.112621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 160/310] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:22 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:23.140362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-081e7632-e173-46f6-a057-830d86197af1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:23.143083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-081e7632-e173-46f6-a057-830d86197af1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:23.152894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-081e7632-e173-46f6-a057-830d86197af1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:23.155666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-081e7632-e173-46f6-a057-830d86197af1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:23.157000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-081e7632-e173-46f6-a057-830d86197af1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:23.158022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-081e7632-e173-46f6-a057-830d86197af1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:23.175860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Flavor limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:36:23.177070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Image limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:36:23.177070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Flavor pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:36:23.177392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Image pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:36:23.177605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:36:23.194485 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:23.197086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:23.199653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:23.203454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:23.281919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:36:23.295092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for user 4001e8ec57b34f57aae1654fad9217f8 and project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:36:23.326002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Going to run 1 instances... {{(pid=124526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:36:23.332598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:36:23.471664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-76aa0cad-120c-404c-826e-eb45ca90cb17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.483005 Aug 01 15:36:23.472426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 151/311] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:36:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 2485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:36:23.484289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-964f1538-7603-4dad-8fa7-2e7318ba03cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:23.485579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-964f1538-7603-4dad-8fa7-2e7318ba03cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:23.495704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-964f1538-7603-4dad-8fa7-2e7318ba03cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:23.498517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-964f1538-7603-4dad-8fa7-2e7318ba03cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:23.499351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-964f1538-7603-4dad-8fa7-2e7318ba03cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:23.501432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-964f1538-7603-4dad-8fa7-2e7318ba03cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:23.775606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-081e7632-e173-46f6-a057-830d86197af1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:23.789981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-081e7632-e173-46f6-a057-830d86197af1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:23.792966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-081e7632-e173-46f6-a057-830d86197af1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:23.795153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-081e7632-e173-46f6-a057-830d86197af1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.681022 Aug 01 15:36:23.796272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 161/312] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:23.871867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0f541e04-a8d7-4815-88c4-44f1162cdcc9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:23.877013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0f541e04-a8d7-4815-88c4-44f1162cdcc9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:24.006520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0f541e04-a8d7-4815-88c4-44f1162cdcc9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:24.029261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0f541e04-a8d7-4815-88c4-44f1162cdcc9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1240 microversion: 2.1 time: 0.201704 Aug 01 15:36:24.029860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 162/313] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:23 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1240 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:24.083808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-964f1538-7603-4dad-8fa7-2e7318ba03cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:24.094411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-964f1538-7603-4dad-8fa7-2e7318ba03cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.615865 Aug 01 15:36:24.096086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 152/314] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:23 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:24.135459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9c8b5020-d123-410d-90f1-737f52dcabec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:24.137576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9c8b5020-d123-410d-90f1-737f52dcabec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:24.160906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c8b5020-d123-410d-90f1-737f52dcabec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:24.161716 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c8b5020-d123-410d-90f1-737f52dcabec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:24.162575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c8b5020-d123-410d-90f1-737f52dcabec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:24.163057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c8b5020-d123-410d-90f1-737f52dcabec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:24.756821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9c8b5020-d123-410d-90f1-737f52dcabec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:24.801951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9c8b5020-d123-410d-90f1-737f52dcabec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.659169 Aug 01 15:36:24.824856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5cc1e9dd-1d42-4ffc-96c5-5080bcb6c036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:24.825478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5cc1e9dd-1d42-4ffc-96c5-5080bcb6c036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:24.830487 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 163/315] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:24 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:24.839292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:24.841984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5cc1e9dd-1d42-4ffc-96c5-5080bcb6c036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:24.842455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5cc1e9dd-1d42-4ffc-96c5-5080bcb6c036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:24.843515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5cc1e9dd-1d42-4ffc-96c5-5080bcb6c036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:24.844127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5cc1e9dd-1d42-4ffc-96c5-5080bcb6c036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:25.069326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-36420d9a-3135-459e-a23b-c6eb5589f887 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:25.069977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-36420d9a-3135-459e-a23b-c6eb5589f887 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:25.097318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-36420d9a-3135-459e-a23b-c6eb5589f887 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:25.097997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-36420d9a-3135-459e-a23b-c6eb5589f887 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:25.101404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-36420d9a-3135-459e-a23b-c6eb5589f887 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:25.102045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-36420d9a-3135-459e-a23b-c6eb5589f887 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:25.345344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-36420d9a-3135-459e-a23b-c6eb5589f887 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:25.370199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-36420d9a-3135-459e-a23b-c6eb5589f887 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1236 microversion: 2.1 time: 0.312009 Aug 01 15:36:25.376046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 164/316] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:25 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1236 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:25.411726 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-77c79aa1-10b0-4fd1-b1e2-e17e8529c91e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:25.415007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-77c79aa1-10b0-4fd1-b1e2-e17e8529c91e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:25.436720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-77c79aa1-10b0-4fd1-b1e2-e17e8529c91e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:25.437603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-77c79aa1-10b0-4fd1-b1e2-e17e8529c91e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:25.438807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-77c79aa1-10b0-4fd1-b1e2-e17e8529c91e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:25.439558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-77c79aa1-10b0-4fd1-b1e2-e17e8529c91e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:25.463312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5cc1e9dd-1d42-4ffc-96c5-5080bcb6c036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:25.481103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5cc1e9dd-1d42-4ffc-96c5-5080bcb6c036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:25.482675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5cc1e9dd-1d42-4ffc-96c5-5080bcb6c036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:25.483881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5cc1e9dd-1d42-4ffc-96c5-5080bcb6c036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.663012 Aug 01 15:36:25.492770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 153/317] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:25.756831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-77c79aa1-10b0-4fd1-b1e2-e17e8529c91e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:25.773565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-77c79aa1-10b0-4fd1-b1e2-e17e8529c91e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.395850 Aug 01 15:36:25.774598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 165/318] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:25 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:25.848789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ccf058a1-55b2-495d-af0c-1c45a598a8c0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:25.849577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ccf058a1-55b2-495d-af0c-1c45a598a8c0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:25.861161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ccf058a1-55b2-495d-af0c-1c45a598a8c0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:25.861719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ccf058a1-55b2-495d-af0c-1c45a598a8c0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:25.862673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ccf058a1-55b2-495d-af0c-1c45a598a8c0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:25.863650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ccf058a1-55b2-495d-af0c-1c45a598a8c0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:25.892049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:26.255329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ccf058a1-55b2-495d-af0c-1c45a598a8c0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:26.267531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ccf058a1-55b2-495d-af0c-1c45a598a8c0 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.424511 Aug 01 15:36:26.268678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 154/319] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:25 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:26.413431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6ea0d531-ba72-49ed-8ba5-050014ab93a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:26.414337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6ea0d531-ba72-49ed-8ba5-050014ab93a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:26.438456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6ea0d531-ba72-49ed-8ba5-050014ab93a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:26.438456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6ea0d531-ba72-49ed-8ba5-050014ab93a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:26.438456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6ea0d531-ba72-49ed-8ba5-050014ab93a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:26.438456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6ea0d531-ba72-49ed-8ba5-050014ab93a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:26.525383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-47d94fe8-8b45-499b-92c2-8fd68bc5e385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:26.526153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-47d94fe8-8b45-499b-92c2-8fd68bc5e385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:26.549589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-47d94fe8-8b45-499b-92c2-8fd68bc5e385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:26.550188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-47d94fe8-8b45-499b-92c2-8fd68bc5e385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:26.551083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-47d94fe8-8b45-499b-92c2-8fd68bc5e385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:26.551607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-47d94fe8-8b45-499b-92c2-8fd68bc5e385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:26.576080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6ea0d531-ba72-49ed-8ba5-050014ab93a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:26.590073 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6ea0d531-ba72-49ed-8ba5-050014ab93a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1292 microversion: 2.1 time: 0.182523 Aug 01 15:36:26.590661 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 166/320] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:26 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1292 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:26.794936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-47d94fe8-8b45-499b-92c2-8fd68bc5e385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:26.806154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-47d94fe8-8b45-499b-92c2-8fd68bc5e385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:26.809601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-47d94fe8-8b45-499b-92c2-8fd68bc5e385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:26.811139 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-47d94fe8-8b45-499b-92c2-8fd68bc5e385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.293817 Aug 01 15:36:26.812250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 155/321] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:36:26.821056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-03a9c9b5-0038-4566-a4b9-1d431df2ded1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:26.821694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-03a9c9b5-0038-4566-a4b9-1d431df2ded1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:26.830658 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03a9c9b5-0038-4566-a4b9-1d431df2ded1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:26.831351 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03a9c9b5-0038-4566-a4b9-1d431df2ded1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:26.832317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03a9c9b5-0038-4566-a4b9-1d431df2ded1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:26.832905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03a9c9b5-0038-4566-a4b9-1d431df2ded1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:26.999732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-03a9c9b5-0038-4566-a4b9-1d431df2ded1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:27.009644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-03a9c9b5-0038-4566-a4b9-1d431df2ded1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.203355 Aug 01 15:36:27.010477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 167/322] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:26 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:27.290966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a8668af0-06cd-4275-ba67-5061505d5619 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:27.291831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a8668af0-06cd-4275-ba67-5061505d5619 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:27.299350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8668af0-06cd-4275-ba67-5061505d5619 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:27.299810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8668af0-06cd-4275-ba67-5061505d5619 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:27.301867 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8668af0-06cd-4275-ba67-5061505d5619 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:27.302364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8668af0-06cd-4275-ba67-5061505d5619 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:27.456795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a8668af0-06cd-4275-ba67-5061505d5619 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:27.465465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a8668af0-06cd-4275-ba67-5061505d5619 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.177830 Aug 01 15:36:27.466083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 156/323] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:27 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:27.612872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-904121dc-6aae-48dc-abe7-3cdf0b41a558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:27.613536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-904121dc-6aae-48dc-abe7-3cdf0b41a558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:27.621337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-904121dc-6aae-48dc-abe7-3cdf0b41a558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:27.621721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-904121dc-6aae-48dc-abe7-3cdf0b41a558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:27.622532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-904121dc-6aae-48dc-abe7-3cdf0b41a558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:27.622972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-904121dc-6aae-48dc-abe7-3cdf0b41a558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:27.692098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-904121dc-6aae-48dc-abe7-3cdf0b41a558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:27.700017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-904121dc-6aae-48dc-abe7-3cdf0b41a558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1292 microversion: 2.1 time: 0.090595 Aug 01 15:36:27.700583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 168/324] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:27 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:27.837112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fed59df0-72f2-44bd-b15a-b8744ebeef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:27.837639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fed59df0-72f2-44bd-b15a-b8744ebeef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:27.844546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fed59df0-72f2-44bd-b15a-b8744ebeef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:27.844988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fed59df0-72f2-44bd-b15a-b8744ebeef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:27.845776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fed59df0-72f2-44bd-b15a-b8744ebeef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:27.846255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fed59df0-72f2-44bd-b15a-b8744ebeef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:27.984973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fed59df0-72f2-44bd-b15a-b8744ebeef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:27.998162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fed59df0-72f2-44bd-b15a-b8744ebeef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:27.999654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fed59df0-72f2-44bd-b15a-b8744ebeef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:28.000823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fed59df0-72f2-44bd-b15a-b8744ebeef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.168020 Aug 01 15:36:28.001380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 157/325] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:28.033432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-345e17e8-84b9-4594-9966-a8d1c3ef2808 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:28.034004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-345e17e8-84b9-4594-9966-a8d1c3ef2808 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:28.041553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-345e17e8-84b9-4594-9966-a8d1c3ef2808 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:28.042296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-345e17e8-84b9-4594-9966-a8d1c3ef2808 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:28.043000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-345e17e8-84b9-4594-9966-a8d1c3ef2808 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:28.043444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-345e17e8-84b9-4594-9966-a8d1c3ef2808 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:28.189806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-345e17e8-84b9-4594-9966-a8d1c3ef2808 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:28.199665 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-345e17e8-84b9-4594-9966-a8d1c3ef2808 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.169014 Aug 01 15:36:28.199986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 169/326] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:28 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:28.494764 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-df379fad-a4a0-4754-87b4-fb6137bc73e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:28.495609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-df379fad-a4a0-4754-87b4-fb6137bc73e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:28.509050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df379fad-a4a0-4754-87b4-fb6137bc73e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:28.510010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df379fad-a4a0-4754-87b4-fb6137bc73e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:28.511412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df379fad-a4a0-4754-87b4-fb6137bc73e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:28.513441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df379fad-a4a0-4754-87b4-fb6137bc73e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:28.733403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c2e21a7a-8d21-4499-943f-a1bcef5cafaa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:28.735240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c2e21a7a-8d21-4499-943f-a1bcef5cafaa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:28.744683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2e21a7a-8d21-4499-943f-a1bcef5cafaa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:28.745620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2e21a7a-8d21-4499-943f-a1bcef5cafaa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:28.747856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2e21a7a-8d21-4499-943f-a1bcef5cafaa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:28.749436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2e21a7a-8d21-4499-943f-a1bcef5cafaa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:28.834630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-df379fad-a4a0-4754-87b4-fb6137bc73e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:28.863933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-df379fad-a4a0-4754-87b4-fb6137bc73e4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.376113 Aug 01 15:36:28.866766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 158/327] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:28 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:29.003463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c2e21a7a-8d21-4499-943f-a1bcef5cafaa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:29.016847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c2e21a7a-8d21-4499-943f-a1bcef5cafaa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1300 microversion: 2.1 time: 0.293910 Aug 01 15:36:29.032684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7d0d29ac-aa48-4024-9eed-c0e4b2215bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:29.033499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7d0d29ac-aa48-4024-9eed-c0e4b2215bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:29.039776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 170/328] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:28 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1300 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:29.051031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d0d29ac-aa48-4024-9eed-c0e4b2215bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:29.053099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d0d29ac-aa48-4024-9eed-c0e4b2215bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:29.055906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d0d29ac-aa48-4024-9eed-c0e4b2215bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:29.060015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d0d29ac-aa48-4024-9eed-c0e4b2215bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:29.224267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4347199a-11af-4ec8-84ef-33131f52941f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:29.228998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4347199a-11af-4ec8-84ef-33131f52941f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:29.240122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4347199a-11af-4ec8-84ef-33131f52941f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:29.241139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4347199a-11af-4ec8-84ef-33131f52941f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:29.242607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4347199a-11af-4ec8-84ef-33131f52941f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:29.243514 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4347199a-11af-4ec8-84ef-33131f52941f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:29.377864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7d0d29ac-aa48-4024-9eed-c0e4b2215bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:29.387755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7d0d29ac-aa48-4024-9eed-c0e4b2215bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:29.395825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7d0d29ac-aa48-4024-9eed-c0e4b2215bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:29.398242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7d0d29ac-aa48-4024-9eed-c0e4b2215bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.377326 Aug 01 15:36:29.398965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 159/329] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:36:29.526971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4347199a-11af-4ec8-84ef-33131f52941f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:29.535670 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4347199a-11af-4ec8-84ef-33131f52941f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.317116 Aug 01 15:36:29.537444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 171/330] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:29 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:29.890328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ed098df2-615e-41dc-8ed4-339af0d76980 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:29.891609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ed098df2-615e-41dc-8ed4-339af0d76980 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:29.901421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed098df2-615e-41dc-8ed4-339af0d76980 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:29.901879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed098df2-615e-41dc-8ed4-339af0d76980 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:29.903246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed098df2-615e-41dc-8ed4-339af0d76980 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:29.903846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed098df2-615e-41dc-8ed4-339af0d76980 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:30.046697 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-729bb786-82d7-47b5-a1a3-8fe868791799 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:30.049494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-729bb786-82d7-47b5-a1a3-8fe868791799 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:30.068052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-729bb786-82d7-47b5-a1a3-8fe868791799 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:30.075004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-729bb786-82d7-47b5-a1a3-8fe868791799 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:30.078757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-729bb786-82d7-47b5-a1a3-8fe868791799 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:30.081858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-729bb786-82d7-47b5-a1a3-8fe868791799 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:30.251136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-729bb786-82d7-47b5-a1a3-8fe868791799 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:30.264670 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-729bb786-82d7-47b5-a1a3-8fe868791799 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1298 microversion: 2.1 time: 0.222200 Aug 01 15:36:30.266261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 172/331] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:30 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1298 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:30.276300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ed098df2-615e-41dc-8ed4-339af0d76980 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:30.289013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ed098df2-615e-41dc-8ed4-339af0d76980 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.402825 Aug 01 15:36:30.289593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 160/332] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:29 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:30.422614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7f1ed0db-1f37-46c2-adb7-0a0db42f3901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:30.423637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7f1ed0db-1f37-46c2-adb7-0a0db42f3901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:30.425743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:30.431820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7f1ed0db-1f37-46c2-adb7-0a0db42f3901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:30.432273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7f1ed0db-1f37-46c2-adb7-0a0db42f3901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:30.433050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7f1ed0db-1f37-46c2-adb7-0a0db42f3901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:30.433517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7f1ed0db-1f37-46c2-adb7-0a0db42f3901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:30.562155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d1556d73-0e06-40a9-b4d4-0e5e6be7cedd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:30.563053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d1556d73-0e06-40a9-b4d4-0e5e6be7cedd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:30.571002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d1556d73-0e06-40a9-b4d4-0e5e6be7cedd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:30.571894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d1556d73-0e06-40a9-b4d4-0e5e6be7cedd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:30.572972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d1556d73-0e06-40a9-b4d4-0e5e6be7cedd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:30.573634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d1556d73-0e06-40a9-b4d4-0e5e6be7cedd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:30.599347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7f1ed0db-1f37-46c2-adb7-0a0db42f3901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:30.613544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7f1ed0db-1f37-46c2-adb7-0a0db42f3901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:30.616175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7f1ed0db-1f37-46c2-adb7-0a0db42f3901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:30.618812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7f1ed0db-1f37-46c2-adb7-0a0db42f3901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.200543 Aug 01 15:36:30.620505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 173/333] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:30.741680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d1556d73-0e06-40a9-b4d4-0e5e6be7cedd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:30.756736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d1556d73-0e06-40a9-b4d4-0e5e6be7cedd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.194589 Aug 01 15:36:30.756736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 161/334] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:30 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:31.287608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-17c275b4-18ec-4f94-ad95-620028b649bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:31.288225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-17c275b4-18ec-4f94-ad95-620028b649bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:31.295397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17c275b4-18ec-4f94-ad95-620028b649bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:31.295895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17c275b4-18ec-4f94-ad95-620028b649bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:31.296680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17c275b4-18ec-4f94-ad95-620028b649bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:31.297117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17c275b4-18ec-4f94-ad95-620028b649bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:31.333933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-04dc43c7-b04d-4ac3-a1b0-05a2e7f13f52 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:31.346333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-04dc43c7-b04d-4ac3-a1b0-05a2e7f13f52 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:31.357082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-04dc43c7-b04d-4ac3-a1b0-05a2e7f13f52 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:31.358255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-04dc43c7-b04d-4ac3-a1b0-05a2e7f13f52 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:31.359353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-04dc43c7-b04d-4ac3-a1b0-05a2e7f13f52 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:31.359904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-04dc43c7-b04d-4ac3-a1b0-05a2e7f13f52 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:31.381157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-17c275b4-18ec-4f94-ad95-620028b649bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:31.391824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-17c275b4-18ec-4f94-ad95-620028b649bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1298 microversion: 2.1 time: 0.107618 Aug 01 15:36:31.392708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 174/335] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:31 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:31.509854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-04dc43c7-b04d-4ac3-a1b0-05a2e7f13f52 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:31.518033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-04dc43c7-b04d-4ac3-a1b0-05a2e7f13f52 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.188721 Aug 01 15:36:31.518612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 162/336] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:31 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:36:31.664287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c5ac7e18-2114-4513-bcde-7f1d7ce1947d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:31.665026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c5ac7e18-2114-4513-bcde-7f1d7ce1947d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:31.675457 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5ac7e18-2114-4513-bcde-7f1d7ce1947d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:31.676197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5ac7e18-2114-4513-bcde-7f1d7ce1947d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:31.677425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5ac7e18-2114-4513-bcde-7f1d7ce1947d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:31.678467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5ac7e18-2114-4513-bcde-7f1d7ce1947d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:31.792153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-526c3bd9-8485-4c42-a0a9-ccffb8839e8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:31.794948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-526c3bd9-8485-4c42-a0a9-ccffb8839e8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:31.803368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-526c3bd9-8485-4c42-a0a9-ccffb8839e8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:31.804963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-526c3bd9-8485-4c42-a0a9-ccffb8839e8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:31.806159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-526c3bd9-8485-4c42-a0a9-ccffb8839e8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:31.806599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-526c3bd9-8485-4c42-a0a9-ccffb8839e8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:31.888460 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c5ac7e18-2114-4513-bcde-7f1d7ce1947d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:31.899655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c5ac7e18-2114-4513-bcde-7f1d7ce1947d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:31.901761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c5ac7e18-2114-4513-bcde-7f1d7ce1947d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:31.903909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c5ac7e18-2114-4513-bcde-7f1d7ce1947d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.245660 Aug 01 15:36:31.905205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 175/337] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:31.962138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-526c3bd9-8485-4c42-a0a9-ccffb8839e8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:31.971007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-526c3bd9-8485-4c42-a0a9-ccffb8839e8b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1724 microversion: 2.1 time: 0.188258 Aug 01 15:36:31.971656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 163/338] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:31 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:36:32.413077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-97b58191-11bc-41c0-b59f-174effe24299 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:32.413913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-97b58191-11bc-41c0-b59f-174effe24299 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:32.420550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-97b58191-11bc-41c0-b59f-174effe24299 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:32.421080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-97b58191-11bc-41c0-b59f-174effe24299 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:32.421992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-97b58191-11bc-41c0-b59f-174effe24299 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:32.422550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-97b58191-11bc-41c0-b59f-174effe24299 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:32.542577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ca72626c-4e18-4451-ab30-76eadcd0fab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:32.543206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ca72626c-4e18-4451-ab30-76eadcd0fab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:32.546848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-97b58191-11bc-41c0-b59f-174effe24299 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:32.551302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ca72626c-4e18-4451-ab30-76eadcd0fab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:32.552025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ca72626c-4e18-4451-ab30-76eadcd0fab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:32.553023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ca72626c-4e18-4451-ab30-76eadcd0fab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:32.553457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ca72626c-4e18-4451-ab30-76eadcd0fab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:32.558222 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-97b58191-11bc-41c0-b59f-174effe24299 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1298 microversion: 2.1 time: 0.148823 Aug 01 15:36:32.559776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 176/339] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:32 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:32.807075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ca72626c-4e18-4451-ab30-76eadcd0fab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:32.821828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ca72626c-4e18-4451-ab30-76eadcd0fab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.285979 Aug 01 15:36:32.823184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 164/340] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:32 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:32.937822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e2996d75-92e3-4cfe-a54d-f0a08dd95958 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:32.938807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e2996d75-92e3-4cfe-a54d-f0a08dd95958 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:32.946113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2996d75-92e3-4cfe-a54d-f0a08dd95958 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:32.946664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2996d75-92e3-4cfe-a54d-f0a08dd95958 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:32.947526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2996d75-92e3-4cfe-a54d-f0a08dd95958 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:32.948030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2996d75-92e3-4cfe-a54d-f0a08dd95958 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:32.993692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a6ddf441-275b-4970-bf11-398a1deb214c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:32.994616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a6ddf441-275b-4970-bf11-398a1deb214c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:33.002550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a6ddf441-275b-4970-bf11-398a1deb214c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:33.003167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a6ddf441-275b-4970-bf11-398a1deb214c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:33.004088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a6ddf441-275b-4970-bf11-398a1deb214c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:33.004639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a6ddf441-275b-4970-bf11-398a1deb214c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:33.239397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=2 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.319169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=10 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.515497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e2996d75-92e3-4cfe-a54d-f0a08dd95958 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:33.519225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:33.523621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a6ddf441-275b-4970-bf11-398a1deb214c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:33.525640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e2996d75-92e3-4cfe-a54d-f0a08dd95958 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:33.527704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e2996d75-92e3-4cfe-a54d-f0a08dd95958 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:33.529096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e2996d75-92e3-4cfe-a54d-f0a08dd95958 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.598050 Aug 01 15:36:33.530107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 177/341] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:33.534637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a6ddf441-275b-4970-bf11-398a1deb214c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1701 microversion: 2.1 time: 0.544957 Aug 01 15:36:33.535878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 165/342] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:32 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1701 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:33.558218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8f8d799a-a394-4cb4-a819-dea7ef50ce92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:33.565469 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f8d799a-a394-4cb4-a819-dea7ef50ce92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:33.565943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f8d799a-a394-4cb4-a819-dea7ef50ce92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:33.590590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-474c1b5c-5eae-45d7-bd08-1d0629a741f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:33.591880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-474c1b5c-5eae-45d7-bd08-1d0629a741f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:33.599615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-474c1b5c-5eae-45d7-bd08-1d0629a741f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:33.600158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-474c1b5c-5eae-45d7-bd08-1d0629a741f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:33.601080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-474c1b5c-5eae-45d7-bd08-1d0629a741f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:33.601571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-474c1b5c-5eae-45d7-bd08-1d0629a741f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:33.632708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8f8d799a-a394-4cb4-a819-dea7ef50ce92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Going to try to start instance {{(pid=124527) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 15:36:33.691490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8f8d799a-a394-4cb4-a819-dea7ef50ce92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "POST /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/action" status: 202 len: 0 microversion: 2.1 time: 0.136946 Aug 01 15:36:33.692504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 178/343] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 1 15:36:33 2022] POST /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:36:33.701288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3bbf1a02-928b-455e-9ddc-e8227ac47c54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:33.702117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3bbf1a02-928b-455e-9ddc-e8227ac47c54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:33.708593 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3bbf1a02-928b-455e-9ddc-e8227ac47c54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:33.709153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3bbf1a02-928b-455e-9ddc-e8227ac47c54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:33.709954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3bbf1a02-928b-455e-9ddc-e8227ac47c54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:33.710949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3bbf1a02-928b-455e-9ddc-e8227ac47c54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:33.780395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-474c1b5c-5eae-45d7-bd08-1d0629a741f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:33.788592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-474c1b5c-5eae-45d7-bd08-1d0629a741f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.203338 Aug 01 15:36:33.789296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 166/344] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:33 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:33.856209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a511d137-8fc2-4632-be43-8065ac2e6bc1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:33.856884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a511d137-8fc2-4632-be43-8065ac2e6bc1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:33.864759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a511d137-8fc2-4632-be43-8065ac2e6bc1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:33.865221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a511d137-8fc2-4632-be43-8065ac2e6bc1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:33.866067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a511d137-8fc2-4632-be43-8065ac2e6bc1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:33.866483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a511d137-8fc2-4632-be43-8065ac2e6bc1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:33.871377 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3bbf1a02-928b-455e-9ddc-e8227ac47c54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:33.884966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3bbf1a02-928b-455e-9ddc-e8227ac47c54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1710 microversion: 2.1 time: 0.188200 Aug 01 15:36:33.885727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 179/345] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:33 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1710 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:36:34.009595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a511d137-8fc2-4632-be43-8065ac2e6bc1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:34.017556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a511d137-8fc2-4632-be43-8065ac2e6bc1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1502 microversion: 2.1 time: 0.165255 Aug 01 15:36:34.018190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 167/346] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:33 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:36:34.039023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-90ff4ea4-cdf9-4b9e-b533-46859472d36b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e485c3a-5602-4449-b9ce-c6c187af959b"}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:34.041695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-90ff4ea4-cdf9-4b9e-b533-46859472d36b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:34.043793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=6 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:34.049522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-90ff4ea4-cdf9-4b9e-b533-46859472d36b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:34.050001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-90ff4ea4-cdf9-4b9e-b533-46859472d36b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:34.050777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-90ff4ea4-cdf9-4b9e-b533-46859472d36b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:34.051202 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-90ff4ea4-cdf9-4b9e-b533-46859472d36b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:34.081060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-90ff4ea4-cdf9-4b9e-b533-46859472d36b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] HTTP exception thrown: Cannot 'attach_volume' instance 98608629-6a0a-496b-9d09-cdb8a2e5118e while it is in vm_state rescued Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-90ff4ea4-cdf9-4b9e-b533-46859472d36b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Request method failure captured: Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: POST /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e/os-volume_attachments HTTP/1.1 Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 74 Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_J2ZHRqxCwFvaKrEkSd8ORzK2PwsmTx60DF_ba7S6dAUTJUvKWYA4hRugEhtyhv0hZHV6Uf_HgHb3vG86PQEcDc4NnXYlJGwlBGATM-_7LlCX46G0SLfNms7SRDrYtedFO_ChgOei2pLR71F5jaEKNvk5jZYGYGTAsANlrWOTt8u8E Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 2d49f0b3378c42ada96c61586a38136e Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-262587399 Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:36:34.082816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:36:34.084341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d49f0b3378c42ada96c61586a38136e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d49f0b3378c42ada96c61586a38136e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d49f0b3378c42ada96c61586a38136e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d49f0b3378c42ada96c61586a38136e"}]}] Aug 01 15:36:34.084341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-ServerRescueNegativeTestJSON-262587399 Aug 01 15:36:34.084341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 2d49f0b3378c42ada96c61586a38136e Aug 01 15:36:34.084341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-262587399 Aug 01 15:36:34.084341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-ServerRescueNegativeTestJSON-262587399-project Aug 01 15:36:34.084341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:36:34.084341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:36:34.084341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 5f0b12ba782244d7b44783c3f3532bfa Aug 01 15:36:34.084341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-ServerRescueNegativeTestJSON-262587399-project Aug 01 15:36:34.084341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Aug 01 15:36:34.084341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {"volumeAttachment": {"volumeId": "1e485c3a-5602-4449-b9ce-c6c187af959b"}} Aug 01 15:36:34.084341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Cannot 'attach_volume' instance 98608629-6a0a-496b-9d09-cdb8a2e5118e while it is in vm_state rescued Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'server_id': '98608629-6a0a-496b-9d09-cdb8a2e5118e', 'body': {'volumeAttachment': {'volumeId': '1e485c3a-5602-4449-b9ce-c6c187af959b'}}} Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 98608629-6a0a-496b-9d09-cdb8a2e5118e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:36:34.085186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 98608629-6a0a-496b-9d09-cdb8a2e5118e while it is in vm_state rescued Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:36:34.086419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:36:34.087860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:36:34.087860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:36:34.087860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 98608629-6a0a-496b-9d09-cdb8a2e5118e while it is in vm_state rescued Aug 01 15:36:34.087860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:36:34.087860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-90ff4ea4-cdf9-4b9e-b533-46859472d36b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Returning 409 to user: Cannot 'attach_volume' instance 98608629-6a0a-496b-9d09-cdb8a2e5118e while it is in vm_state rescued {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:36:34.087860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-90ff4ea4-cdf9-4b9e-b533-46859472d36b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "POST /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049909 Aug 01 15:36:34.087860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 180/347] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 1 15:36:34 2022] POST /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 15:36:34.096694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c24fb11a-c1a0-4b6c-a5e4-32c0cd3ac3b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:34.097232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c24fb11a-c1a0-4b6c-a5e4-32c0cd3ac3b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:34.104142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c24fb11a-c1a0-4b6c-a5e4-32c0cd3ac3b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:34.104514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c24fb11a-c1a0-4b6c-a5e4-32c0cd3ac3b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:34.105354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c24fb11a-c1a0-4b6c-a5e4-32c0cd3ac3b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:34.105784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c24fb11a-c1a0-4b6c-a5e4-32c0cd3ac3b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:34.182678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c24fb11a-c1a0-4b6c-a5e4-32c0cd3ac3b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "POST /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e/action" status: 202 len: 0 microversion: 2.1 time: 0.089850 Aug 01 15:36:34.183872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 168/348] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 1 15:36:34 2022] POST /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:36:34.192471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e0c188a3-c149-4a2d-9a2e-48bfa6739576 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:34.193086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e0c188a3-c149-4a2d-9a2e-48bfa6739576 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:34.200032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e0c188a3-c149-4a2d-9a2e-48bfa6739576 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:34.200533 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e0c188a3-c149-4a2d-9a2e-48bfa6739576 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:34.202189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e0c188a3-c149-4a2d-9a2e-48bfa6739576 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:34.202189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e0c188a3-c149-4a2d-9a2e-48bfa6739576 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:34.341695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e0c188a3-c149-4a2d-9a2e-48bfa6739576 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:34.349753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e0c188a3-c149-4a2d-9a2e-48bfa6739576 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1510 microversion: 2.1 time: 0.161251 Aug 01 15:36:34.350358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 181/349] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:34 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:34.566787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-260e8662-8e84-478c-8acc-c33760626af2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:34.567481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-260e8662-8e84-478c-8acc-c33760626af2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:34.573857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-260e8662-8e84-478c-8acc-c33760626af2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:34.574361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-260e8662-8e84-478c-8acc-c33760626af2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:34.575122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-260e8662-8e84-478c-8acc-c33760626af2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:34.575559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-260e8662-8e84-478c-8acc-c33760626af2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:34.728971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-260e8662-8e84-478c-8acc-c33760626af2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:34.731557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:34.740432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-260e8662-8e84-478c-8acc-c33760626af2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:34.742193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-260e8662-8e84-478c-8acc-c33760626af2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:34.743402 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-260e8662-8e84-478c-8acc-c33760626af2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.180977 Aug 01 15:36:34.744002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 169/350] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:34.820068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-440d3544-8bb4-4013-97ba-3d1b284eef61 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:34.820685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-440d3544-8bb4-4013-97ba-3d1b284eef61 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:34.828060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-440d3544-8bb4-4013-97ba-3d1b284eef61 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:34.828517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-440d3544-8bb4-4013-97ba-3d1b284eef61 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:34.829296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-440d3544-8bb4-4013-97ba-3d1b284eef61 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:34.829734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-440d3544-8bb4-4013-97ba-3d1b284eef61 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:34.911051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e1dfda5f-ca07-4cc0-a2ca-ea57951497aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:34.911644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e1dfda5f-ca07-4cc0-a2ca-ea57951497aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:34.919224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1dfda5f-ca07-4cc0-a2ca-ea57951497aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:34.919670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1dfda5f-ca07-4cc0-a2ca-ea57951497aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:34.920452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1dfda5f-ca07-4cc0-a2ca-ea57951497aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:34.920887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1dfda5f-ca07-4cc0-a2ca-ea57951497aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:34.979829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-440d3544-8bb4-4013-97ba-3d1b284eef61 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:34.990510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-440d3544-8bb4-4013-97ba-3d1b284eef61 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.174228 Aug 01 15:36:34.991089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 182/351] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:34 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:36:35.071134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e1dfda5f-ca07-4cc0-a2ca-ea57951497aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:35.079903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e1dfda5f-ca07-4cc0-a2ca-ea57951497aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1710 microversion: 2.1 time: 0.175200 Aug 01 15:36:35.080476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 170/352] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:34 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1710 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:36:35.372153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-41aaeb79-9241-4e83-bd6d-b6a861180a87 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:35.372802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-41aaeb79-9241-4e83-bd6d-b6a861180a87 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:35.379076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41aaeb79-9241-4e83-bd6d-b6a861180a87 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:35.379539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41aaeb79-9241-4e83-bd6d-b6a861180a87 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:35.380310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41aaeb79-9241-4e83-bd6d-b6a861180a87 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:35.380749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41aaeb79-9241-4e83-bd6d-b6a861180a87 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:35.536163 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-41aaeb79-9241-4e83-bd6d-b6a861180a87 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:35.548869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-41aaeb79-9241-4e83-bd6d-b6a861180a87 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1510 microversion: 2.1 time: 0.179214 Aug 01 15:36:35.548869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 183/353] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:35 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:35.767311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8087691e-78a9-414e-8550-b707b67d023b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:35.768090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8087691e-78a9-414e-8550-b707b67d023b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:35.775308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8087691e-78a9-414e-8550-b707b67d023b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:35.775760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8087691e-78a9-414e-8550-b707b67d023b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:35.776548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8087691e-78a9-414e-8550-b707b67d023b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:35.777481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8087691e-78a9-414e-8550-b707b67d023b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:35.928594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8087691e-78a9-414e-8550-b707b67d023b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:35.936850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8087691e-78a9-414e-8550-b707b67d023b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:35.938400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8087691e-78a9-414e-8550-b707b67d023b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:35.939605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8087691e-78a9-414e-8550-b707b67d023b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1724 microversion: 2.20 time: 0.176295 Aug 01 15:36:35.940553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 171/354] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:36.021576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-122abd45-c324-4164-b76e-6fa584a30943 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:36.022217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-122abd45-c324-4164-b76e-6fa584a30943 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:36.030536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-122abd45-c324-4164-b76e-6fa584a30943 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:36.030990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-122abd45-c324-4164-b76e-6fa584a30943 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:36.031789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-122abd45-c324-4164-b76e-6fa584a30943 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:36.032234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-122abd45-c324-4164-b76e-6fa584a30943 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:36.103391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-13fff472-b5fe-4afa-8141-e7c9e0fe8fed tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:36.104108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-13fff472-b5fe-4afa-8141-e7c9e0fe8fed tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:36.111105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13fff472-b5fe-4afa-8141-e7c9e0fe8fed tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:36.111878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13fff472-b5fe-4afa-8141-e7c9e0fe8fed tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:36.113304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13fff472-b5fe-4afa-8141-e7c9e0fe8fed tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:36.114150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13fff472-b5fe-4afa-8141-e7c9e0fe8fed tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:36.260116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-122abd45-c324-4164-b76e-6fa584a30943 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:36.269071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-122abd45-c324-4164-b76e-6fa584a30943 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.251961 Aug 01 15:36:36.269856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 184/355] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:36 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:36.352688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-13fff472-b5fe-4afa-8141-e7c9e0fe8fed tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:36.369610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-13fff472-b5fe-4afa-8141-e7c9e0fe8fed tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1710 microversion: 2.1 time: 0.269662 Aug 01 15:36:36.369610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 172/356] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:36 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1710 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:36:36.570037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-89612616-35b9-4123-b5c6-725fa1ae78bb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:36.571186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-89612616-35b9-4123-b5c6-725fa1ae78bb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:36.582871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89612616-35b9-4123-b5c6-725fa1ae78bb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:36.583790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89612616-35b9-4123-b5c6-725fa1ae78bb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:36.584956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89612616-35b9-4123-b5c6-725fa1ae78bb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:36.585557 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89612616-35b9-4123-b5c6-725fa1ae78bb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:36.976756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e8db7aec-4444-4f51-b578-198ebd5fc9fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:36.978922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e8db7aec-4444-4f51-b578-198ebd5fc9fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:37.011018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8db7aec-4444-4f51-b578-198ebd5fc9fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:37.012360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8db7aec-4444-4f51-b578-198ebd5fc9fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:37.016841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8db7aec-4444-4f51-b578-198ebd5fc9fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:37.017401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8db7aec-4444-4f51-b578-198ebd5fc9fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:37.131862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-89612616-35b9-4123-b5c6-725fa1ae78bb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:37.151185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-89612616-35b9-4123-b5c6-725fa1ae78bb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1510 microversion: 2.1 time: 0.585854 Aug 01 15:36:37.176078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 185/357] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:36 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1510 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:37.300684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cff76cd2-2621-4919-ae8e-259c2f6c545c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:37.301442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cff76cd2-2621-4919-ae8e-259c2f6c545c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:37.315425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cff76cd2-2621-4919-ae8e-259c2f6c545c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:37.315959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cff76cd2-2621-4919-ae8e-259c2f6c545c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:37.316860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cff76cd2-2621-4919-ae8e-259c2f6c545c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:37.317486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cff76cd2-2621-4919-ae8e-259c2f6c545c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:37.594764 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e8db7aec-4444-4f51-b578-198ebd5fc9fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:37.610155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e8db7aec-4444-4f51-b578-198ebd5fc9fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:37.612281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e8db7aec-4444-4f51-b578-198ebd5fc9fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:37.615029 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e8db7aec-4444-4f51-b578-198ebd5fc9fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1745 microversion: 2.20 time: 0.650539 Aug 01 15:36:37.616380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 173/358] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1745 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:36:37.624554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-92f4cb09-7247-41e0-8f7b-88cc2b471a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:37.628008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-92f4cb09-7247-41e0-8f7b-88cc2b471a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:37.641359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92f4cb09-7247-41e0-8f7b-88cc2b471a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:37.642098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92f4cb09-7247-41e0-8f7b-88cc2b471a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:37.642897 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92f4cb09-7247-41e0-8f7b-88cc2b471a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:37.643435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92f4cb09-7247-41e0-8f7b-88cc2b471a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:37.779981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cff76cd2-2621-4919-ae8e-259c2f6c545c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:37.792212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cff76cd2-2621-4919-ae8e-259c2f6c545c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.501399 Aug 01 15:36:37.793209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 186/359] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:37 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:36:37.937472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-92f4cb09-7247-41e0-8f7b-88cc2b471a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:37.950125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-92f4cb09-7247-41e0-8f7b-88cc2b471a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1710 microversion: 2.1 time: 0.331321 Aug 01 15:36:37.950903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 174/360] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:37 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1710 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:37.998845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-2d3f1cf9-5f92-415d-8241-363356245e6d req-9470d51d-6baf-4230-beba-f0c7ead57b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6675886-2e34-4d44-b8df-0d31d3b19c02", "tag": "6c6d11cc-7ba5-440d-b123-0214fb8dd8a2"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:38.008627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-2d3f1cf9-5f92-415d-8241-363356245e6d req-9470d51d-6baf-4230-beba-f0c7ead57b47 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:38.009326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-2d3f1cf9-5f92-415d-8241-363356245e6d req-9470d51d-6baf-4230-beba-f0c7ead57b47 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:38.022520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-2d3f1cf9-5f92-415d-8241-363356245e6d req-9470d51d-6baf-4230-beba-f0c7ead57b47 service nova] Creating event network-changed:6c6d11cc-7ba5-440d-b123-0214fb8dd8a2 for instance d6675886-2e34-4d44-b8df-0d31d3b19c02 on hv-cinder-84753 Aug 01 15:36:38.027834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-2d3f1cf9-5f92-415d-8241-363356245e6d req-9470d51d-6baf-4230-beba-f0c7ead57b47 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033749 Aug 01 15:36:38.028432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 187/361] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:36:38.182641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a3677670-f6c0-4990-a0c3-35b78dbeaa16 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:38.183482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a3677670-f6c0-4990-a0c3-35b78dbeaa16 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:38.193064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a3677670-f6c0-4990-a0c3-35b78dbeaa16 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:38.194058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a3677670-f6c0-4990-a0c3-35b78dbeaa16 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:38.195474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a3677670-f6c0-4990-a0c3-35b78dbeaa16 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:38.196167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a3677670-f6c0-4990-a0c3-35b78dbeaa16 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:38.391373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a3677670-f6c0-4990-a0c3-35b78dbeaa16 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:38.399692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a3677670-f6c0-4990-a0c3-35b78dbeaa16 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1510 microversion: 2.1 time: 0.222389 Aug 01 15:36:38.400630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 175/362] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:38 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:38.643620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-98908ca7-2760-4bf1-802f-107cc2569eb1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:38.644464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-98908ca7-2760-4bf1-802f-107cc2569eb1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:38.653604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-98908ca7-2760-4bf1-802f-107cc2569eb1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:38.654286 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-98908ca7-2760-4bf1-802f-107cc2569eb1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:38.655187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-98908ca7-2760-4bf1-802f-107cc2569eb1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:38.655526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-98908ca7-2760-4bf1-802f-107cc2569eb1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:38.813484 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a8d7d5d0-30c9-49f2-97fe-58461466086c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:38.814135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a8d7d5d0-30c9-49f2-97fe-58461466086c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:38.818035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-98908ca7-2760-4bf1-802f-107cc2569eb1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:38.821161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8d7d5d0-30c9-49f2-97fe-58461466086c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:38.821945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8d7d5d0-30c9-49f2-97fe-58461466086c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:38.822668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8d7d5d0-30c9-49f2-97fe-58461466086c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:38.823109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8d7d5d0-30c9-49f2-97fe-58461466086c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:38.832653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-98908ca7-2760-4bf1-802f-107cc2569eb1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:38.832653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-98908ca7-2760-4bf1-802f-107cc2569eb1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:38.832653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-98908ca7-2760-4bf1-802f-107cc2569eb1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1745 microversion: 2.20 time: 0.190571 Aug 01 15:36:38.832960 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 188/363] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:38.982833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9d67c235-9e5d-430e-872f-e90b5b083fc3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:38.983457 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9d67c235-9e5d-430e-872f-e90b5b083fc3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:38.986234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a8d7d5d0-30c9-49f2-97fe-58461466086c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:38.990955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d67c235-9e5d-430e-872f-e90b5b083fc3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:38.991408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d67c235-9e5d-430e-872f-e90b5b083fc3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:38.992191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d67c235-9e5d-430e-872f-e90b5b083fc3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:38.992628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d67c235-9e5d-430e-872f-e90b5b083fc3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:38.995339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a8d7d5d0-30c9-49f2-97fe-58461466086c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.185842 Aug 01 15:36:38.996377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 176/364] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:38 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:39.137614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9d67c235-9e5d-430e-872f-e90b5b083fc3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:39.146459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9d67c235-9e5d-430e-872f-e90b5b083fc3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1710 microversion: 2.1 time: 0.168296 Aug 01 15:36:39.147423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 189/365] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:38 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1710 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:39.424754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-91d2d83d-2585-460c-83be-5c90d225c735 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:39.426162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-91d2d83d-2585-460c-83be-5c90d225c735 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:39.436281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91d2d83d-2585-460c-83be-5c90d225c735 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:39.436725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91d2d83d-2585-460c-83be-5c90d225c735 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:39.437502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91d2d83d-2585-460c-83be-5c90d225c735 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:39.437960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91d2d83d-2585-460c-83be-5c90d225c735 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:39.584602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-91d2d83d-2585-460c-83be-5c90d225c735 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:39.598849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-91d2d83d-2585-460c-83be-5c90d225c735 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1510 microversion: 2.1 time: 0.177565 Aug 01 15:36:39.600353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 177/366] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:39 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:39.855889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cbe25d82-3115-4045-a4c4-eed480f23661 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:39.856511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cbe25d82-3115-4045-a4c4-eed480f23661 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:39.863378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cbe25d82-3115-4045-a4c4-eed480f23661 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:39.863838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cbe25d82-3115-4045-a4c4-eed480f23661 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:39.864681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cbe25d82-3115-4045-a4c4-eed480f23661 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:39.865144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cbe25d82-3115-4045-a4c4-eed480f23661 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:40.020232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-889cc71b-9197-4e97-966a-9b62e76145b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:40.020856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-889cc71b-9197-4e97-966a-9b62e76145b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:40.028996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-889cc71b-9197-4e97-966a-9b62e76145b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:40.029750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-889cc71b-9197-4e97-966a-9b62e76145b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:40.030749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-889cc71b-9197-4e97-966a-9b62e76145b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:40.031191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-889cc71b-9197-4e97-966a-9b62e76145b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:40.052276 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cbe25d82-3115-4045-a4c4-eed480f23661 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:40.064885 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cbe25d82-3115-4045-a4c4-eed480f23661 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:40.066978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cbe25d82-3115-4045-a4c4-eed480f23661 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:40.068448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cbe25d82-3115-4045-a4c4-eed480f23661 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1745 microversion: 2.20 time: 0.217869 Aug 01 15:36:40.069686 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 190/367] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:40.170258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bac66be0-39b5-49e0-b7be-967e2ee8493c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:40.170614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bac66be0-39b5-49e0-b7be-967e2ee8493c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:40.177380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bac66be0-39b5-49e0-b7be-967e2ee8493c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:40.177845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bac66be0-39b5-49e0-b7be-967e2ee8493c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:40.178868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bac66be0-39b5-49e0-b7be-967e2ee8493c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:40.179516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bac66be0-39b5-49e0-b7be-967e2ee8493c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:40.191297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-889cc71b-9197-4e97-966a-9b62e76145b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:40.200938 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-889cc71b-9197-4e97-966a-9b62e76145b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.185365 Aug 01 15:36:40.201687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 178/368] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:40 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:40.352860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bac66be0-39b5-49e0-b7be-967e2ee8493c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:40.366889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bac66be0-39b5-49e0-b7be-967e2ee8493c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1710 microversion: 2.1 time: 0.201746 Aug 01 15:36:40.368200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 191/369] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:40 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1710 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:40.623470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-89b8c93c-a5a7-4923-94f5-199927253e05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:40.624108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-89b8c93c-a5a7-4923-94f5-199927253e05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:40.631342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89b8c93c-a5a7-4923-94f5-199927253e05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:40.631850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89b8c93c-a5a7-4923-94f5-199927253e05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:40.633043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89b8c93c-a5a7-4923-94f5-199927253e05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:40.633509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89b8c93c-a5a7-4923-94f5-199927253e05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:40.802255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-89b8c93c-a5a7-4923-94f5-199927253e05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:40.811879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-89b8c93c-a5a7-4923-94f5-199927253e05 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1510 microversion: 2.1 time: 0.193838 Aug 01 15:36:40.812997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 179/370] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:40 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:41.109039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-619cb905-b803-4455-b199-fd9118fa117a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:41.111224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-619cb905-b803-4455-b199-fd9118fa117a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:41.123502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-619cb905-b803-4455-b199-fd9118fa117a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:41.124244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-619cb905-b803-4455-b199-fd9118fa117a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:41.125621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-619cb905-b803-4455-b199-fd9118fa117a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:41.126406 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-619cb905-b803-4455-b199-fd9118fa117a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:41.225919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9c7dc1a6-3e78-4206-8fdd-7922770f1338 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:41.226679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9c7dc1a6-3e78-4206-8fdd-7922770f1338 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:41.244570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c7dc1a6-3e78-4206-8fdd-7922770f1338 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:41.252889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c7dc1a6-3e78-4206-8fdd-7922770f1338 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:41.254060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c7dc1a6-3e78-4206-8fdd-7922770f1338 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:41.254855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c7dc1a6-3e78-4206-8fdd-7922770f1338 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:42.339537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-619cb905-b803-4455-b199-fd9118fa117a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:42.353579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-619cb905-b803-4455-b199-fd9118fa117a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:42.355193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-619cb905-b803-4455-b199-fd9118fa117a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:42.378986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-619cb905-b803-4455-b199-fd9118fa117a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1745 microversion: 2.20 time: 1.279000 Aug 01 15:36:42.379591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 192/371] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1745 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:42.384393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2cae529c-5ed9-4a81-b90b-bc60301d3048 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:42.385016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2cae529c-5ed9-4a81-b90b-bc60301d3048 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:42.400787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2cae529c-5ed9-4a81-b90b-bc60301d3048 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:42.402927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2cae529c-5ed9-4a81-b90b-bc60301d3048 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:42.404708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2cae529c-5ed9-4a81-b90b-bc60301d3048 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:42.405473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2cae529c-5ed9-4a81-b90b-bc60301d3048 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:42.663637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9c7dc1a6-3e78-4206-8fdd-7922770f1338 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:42.678977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9c7dc1a6-3e78-4206-8fdd-7922770f1338 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 1.459854 Aug 01 15:36:42.684174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 180/372] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:41 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:42.706824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e1325ae3-6915-4202-83c2-2df82ee807ec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:42.707443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e1325ae3-6915-4202-83c2-2df82ee807ec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:42.719672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1325ae3-6915-4202-83c2-2df82ee807ec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:42.721772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1325ae3-6915-4202-83c2-2df82ee807ec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:42.725005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1325ae3-6915-4202-83c2-2df82ee807ec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:42.725655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1325ae3-6915-4202-83c2-2df82ee807ec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:42.837406 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2cae529c-5ed9-4a81-b90b-bc60301d3048 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:42.847549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2cae529c-5ed9-4a81-b90b-bc60301d3048 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1710 microversion: 2.1 time: 0.466877 Aug 01 15:36:42.848428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 193/373] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:42 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1710 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:43.332439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e1325ae3-6915-4202-83c2-2df82ee807ec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:43.347760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e1325ae3-6915-4202-83c2-2df82ee807ec tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1510 microversion: 2.1 time: 0.660891 Aug 01 15:36:43.350089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 181/374] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:42 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1510 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:43.407203 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-375c7e58-3726-40e7-8198-1ef5eba12972 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:43.408708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-375c7e58-3726-40e7-8198-1ef5eba12972 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:43.420850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-375c7e58-3726-40e7-8198-1ef5eba12972 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:43.426071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-375c7e58-3726-40e7-8198-1ef5eba12972 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:43.427235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-375c7e58-3726-40e7-8198-1ef5eba12972 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:43.428962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-375c7e58-3726-40e7-8198-1ef5eba12972 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:43.494500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:43.711575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-12f5877f-0c94-4725-8b5e-87bc6df622da tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:43.713101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-12f5877f-0c94-4725-8b5e-87bc6df622da tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:43.723308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-12f5877f-0c94-4725-8b5e-87bc6df622da tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:43.723753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-12f5877f-0c94-4725-8b5e-87bc6df622da tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:43.756490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-12f5877f-0c94-4725-8b5e-87bc6df622da tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:43.757023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-12f5877f-0c94-4725-8b5e-87bc6df622da tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:44.129492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-375c7e58-3726-40e7-8198-1ef5eba12972 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:44.159436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-375c7e58-3726-40e7-8198-1ef5eba12972 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:44.166766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-375c7e58-3726-40e7-8198-1ef5eba12972 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:44.170774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-375c7e58-3726-40e7-8198-1ef5eba12972 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 0.768608 Aug 01 15:36:44.172644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 194/375] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:36:44.186607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1c34c695-98e5-469d-a6c2-6fac4b1885cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:44.187590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1c34c695-98e5-469d-a6c2-6fac4b1885cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:44.197401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c34c695-98e5-469d-a6c2-6fac4b1885cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:44.206241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c34c695-98e5-469d-a6c2-6fac4b1885cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:44.207525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c34c695-98e5-469d-a6c2-6fac4b1885cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:44.208147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c34c695-98e5-469d-a6c2-6fac4b1885cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:44.441579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-12f5877f-0c94-4725-8b5e-87bc6df622da tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:44.470205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-12f5877f-0c94-4725-8b5e-87bc6df622da tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.762905 Aug 01 15:36:44.483318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 182/376] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:43 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:44.493588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-351fae85-be38-45c3-905c-2cc0adc2682e req-0f2dfcf0-713c-4352-a3e0-f6ae9a2bb1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df", "name": "network-vif-plugged", "status": "completed", "tag": "ce819b69-03c1-4584-9ef2-0228b13d3351"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:44.507668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-351fae85-be38-45c3-905c-2cc0adc2682e req-0f2dfcf0-713c-4352-a3e0-f6ae9a2bb1cc service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:44.508395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-351fae85-be38-45c3-905c-2cc0adc2682e req-0f2dfcf0-713c-4352-a3e0-f6ae9a2bb1cc service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:44.533812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-351fae85-be38-45c3-905c-2cc0adc2682e req-0f2dfcf0-713c-4352-a3e0-f6ae9a2bb1cc service nova] Creating event network-vif-plugged:ce819b69-03c1-4584-9ef2-0228b13d3351 for instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df on hv-cinder-84753 Aug 01 15:36:44.548867 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-351fae85-be38-45c3-905c-2cc0adc2682e req-0f2dfcf0-713c-4352-a3e0-f6ae9a2bb1cc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063692 Aug 01 15:36:44.549785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 183/377] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:36:44.556843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-99e65bd0-57c0-4319-b91c-a8b0e8880533 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:44.557828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-99e65bd0-57c0-4319-b91c-a8b0e8880533 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:44.568661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99e65bd0-57c0-4319-b91c-a8b0e8880533 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:44.569386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99e65bd0-57c0-4319-b91c-a8b0e8880533 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:44.576060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99e65bd0-57c0-4319-b91c-a8b0e8880533 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:44.578312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99e65bd0-57c0-4319-b91c-a8b0e8880533 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:44.816315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c34c695-98e5-469d-a6c2-6fac4b1885cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:44.850031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1c34c695-98e5-469d-a6c2-6fac4b1885cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1710 microversion: 2.1 time: 0.675094 Aug 01 15:36:44.853603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 195/378] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:44 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1710 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:45.130558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-99e65bd0-57c0-4319-b91c-a8b0e8880533 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:45.146704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-99e65bd0-57c0-4319-b91c-a8b0e8880533 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1510 microversion: 2.1 time: 0.595459 Aug 01 15:36:45.147353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 184/379] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:44 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1510 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:45.210803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bd06a0fe-61d2-462a-9cb1-badea46a8d92 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:45.211534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bd06a0fe-61d2-462a-9cb1-badea46a8d92 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:45.226273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd06a0fe-61d2-462a-9cb1-badea46a8d92 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:45.229040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd06a0fe-61d2-462a-9cb1-badea46a8d92 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:45.229918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd06a0fe-61d2-462a-9cb1-badea46a8d92 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:45.233532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd06a0fe-61d2-462a-9cb1-badea46a8d92 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:45.500751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-77c696ee-0646-4530-8f21-94884f1ec152 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:45.501636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-77c696ee-0646-4530-8f21-94884f1ec152 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:45.510582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77c696ee-0646-4530-8f21-94884f1ec152 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:45.512385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77c696ee-0646-4530-8f21-94884f1ec152 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:45.514135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77c696ee-0646-4530-8f21-94884f1ec152 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:45.514792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77c696ee-0646-4530-8f21-94884f1ec152 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:46.098840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bd06a0fe-61d2-462a-9cb1-badea46a8d92 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:46.113704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bd06a0fe-61d2-462a-9cb1-badea46a8d92 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:46.115247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bd06a0fe-61d2-462a-9cb1-badea46a8d92 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:46.122062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bd06a0fe-61d2-462a-9cb1-badea46a8d92 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 0.921790 Aug 01 15:36:46.123052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 196/380] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:46.159132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bdfe590c-2d0c-490c-94de-9c84a1ae933f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:46.163813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bdfe590c-2d0c-490c-94de-9c84a1ae933f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:46.184870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bdfe590c-2d0c-490c-94de-9c84a1ae933f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:46.185570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bdfe590c-2d0c-490c-94de-9c84a1ae933f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:46.186782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bdfe590c-2d0c-490c-94de-9c84a1ae933f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:46.187424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bdfe590c-2d0c-490c-94de-9c84a1ae933f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:46.618360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-77c696ee-0646-4530-8f21-94884f1ec152 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:46.647256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-77c696ee-0646-4530-8f21-94884f1ec152 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 1.153720 Aug 01 15:36:46.648323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 185/381] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:45 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:46.704763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fbc5693d-3111-4415-8831-315de39b64a2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:46.706072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fbc5693d-3111-4415-8831-315de39b64a2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:46.721671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fbc5693d-3111-4415-8831-315de39b64a2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:46.722250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fbc5693d-3111-4415-8831-315de39b64a2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:46.723927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fbc5693d-3111-4415-8831-315de39b64a2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:46.725222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fbc5693d-3111-4415-8831-315de39b64a2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:46.826757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bdfe590c-2d0c-490c-94de-9c84a1ae933f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:46.837679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bdfe590c-2d0c-490c-94de-9c84a1ae933f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1714 microversion: 2.1 time: 0.713016 Aug 01 15:36:46.838552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 197/382] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:46 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1714 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:46.846587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0b4417b0-e6fc-428f-b760-c5fe14925f51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:46.847510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0b4417b0-e6fc-428f-b760-c5fe14925f51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:46.858042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b4417b0-e6fc-428f-b760-c5fe14925f51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:46.858915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b4417b0-e6fc-428f-b760-c5fe14925f51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:46.864840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b4417b0-e6fc-428f-b760-c5fe14925f51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:46.865987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b4417b0-e6fc-428f-b760-c5fe14925f51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:47.212761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-0b4417b0-e6fc-428f-b760-c5fe14925f51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lazy-loading 'services' on Instance uuid fac32bea-aa1d-4abf-bd69-332c15fa2ebf {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:36:47.465043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fbc5693d-3111-4415-8831-315de39b64a2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:47.481454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fbc5693d-3111-4415-8831-315de39b64a2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1516 microversion: 2.1 time: 0.797670 Aug 01 15:36:47.491437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 186/383] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:46 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1516 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:47.497525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bcc670a6-7e82-49f9-9228-34cca8acdadd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:47.509906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bcc670a6-7e82-49f9-9228-34cca8acdadd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:47.522216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bcc670a6-7e82-49f9-9228-34cca8acdadd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:47.541558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bcc670a6-7e82-49f9-9228-34cca8acdadd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:47.554618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bcc670a6-7e82-49f9-9228-34cca8acdadd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:47.559567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bcc670a6-7e82-49f9-9228-34cca8acdadd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:47.570612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:47.994412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0b4417b0-e6fc-428f-b760-c5fe14925f51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "DELETE /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf/os-volume_attachments/0c504c13-f960-4702-b836-37f286cdce5c" status: 202 len: 0 microversion: 2.1 time: 1.153958 Aug 01 15:36:48.002711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 198/384] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 1 15:36:46 2022] DELETE /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf/os-volume_attachments/0c504c13-f960-4702-b836-37f286cdce5c => generated 0 bytes in 1163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:36:48.028239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4c1f03a9-75c7-41c9-8553-1f1b7bb477ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:48.029096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4c1f03a9-75c7-41c9-8553-1f1b7bb477ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:48.048201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c1f03a9-75c7-41c9-8553-1f1b7bb477ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:48.054238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c1f03a9-75c7-41c9-8553-1f1b7bb477ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:48.072895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c1f03a9-75c7-41c9-8553-1f1b7bb477ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:48.076652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c1f03a9-75c7-41c9-8553-1f1b7bb477ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:48.999514 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4c1f03a9-75c7-41c9-8553-1f1b7bb477ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:49.036964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bcc670a6-7e82-49f9-9228-34cca8acdadd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:49.044933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4c1f03a9-75c7-41c9-8553-1f1b7bb477ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 1.029229 Aug 01 15:36:49.047158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bcc670a6-7e82-49f9-9228-34cca8acdadd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:49.049616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bcc670a6-7e82-49f9-9228-34cca8acdadd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:49.051177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bcc670a6-7e82-49f9-9228-34cca8acdadd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 1.558494 Aug 01 15:36:49.052186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 187/385] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:49.077473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 199/386] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:48 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:49.762189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fe77e1d1-facc-432c-8921-421a5f216dd7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Action: 'create', calling method: .version_select at 0x7feb169c81f0>, body: {"keypair": {"name": "tempest-keypair-1320122182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrvN/96iKFR2PtM/0+Is8yyA5ke45yOZHcCU5G10NsKSNe4Uj6U7Yjeb+ieFDQAXVsL86jp18ilV+Zvjhfpzm3sDLrV97XpfKhL5sF61DvPph82o8ESiTnIhAvE/W2vEA=="}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:49.806143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-fe77e1d1-facc-432c-8921-421a5f216dd7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Getting quotas for project 2d49f0b3378c42ada96c61586a38136e. Resources: {'key_pairs'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:36:49.832675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-fe77e1d1-facc-432c-8921-421a5f216dd7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Getting quotas for user 5f0b12ba782244d7b44783c3f3532bfa and project 2d49f0b3378c42ada96c61586a38136e. Resources: {'key_pairs'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:36:49.888803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fe77e1d1-facc-432c-8921-421a5f216dd7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133992 Aug 01 15:36:49.889927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 188/387] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 1 15:36:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:36:50.078667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e92387c9-5274-4b55-937d-f3a7bcc0085c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:50.079077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e92387c9-5274-4b55-937d-f3a7bcc0085c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:50.093459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e92387c9-5274-4b55-937d-f3a7bcc0085c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:50.099368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7fe50c19-da8d-45d6-8982-a89ee36bdfb5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:50.100366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7fe50c19-da8d-45d6-8982-a89ee36bdfb5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:50.113073 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e92387c9-5274-4b55-937d-f3a7bcc0085c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:50.114063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e92387c9-5274-4b55-937d-f3a7bcc0085c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:50.114518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e92387c9-5274-4b55-937d-f3a7bcc0085c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:50.121643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fe50c19-da8d-45d6-8982-a89ee36bdfb5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:50.125088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fe50c19-da8d-45d6-8982-a89ee36bdfb5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:50.126046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fe50c19-da8d-45d6-8982-a89ee36bdfb5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:50.126498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fe50c19-da8d-45d6-8982-a89ee36bdfb5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:50.456867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e92387c9-5274-4b55-937d-f3a7bcc0085c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:50.461302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7fe50c19-da8d-45d6-8982-a89ee36bdfb5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:50.467875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e92387c9-5274-4b55-937d-f3a7bcc0085c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:50.476310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7fe50c19-da8d-45d6-8982-a89ee36bdfb5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.381317 Aug 01 15:36:50.477311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 189/388] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:50 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:50.486078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e92387c9-5274-4b55-937d-f3a7bcc0085c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:50.493115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e92387c9-5274-4b55-937d-f3a7bcc0085c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 0.418178 Aug 01 15:36:50.511085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 200/389] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:50.652805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6c7d95ac-a615-4c07-b32d-c9179f38af96 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:50.653555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6c7d95ac-a615-4c07-b32d-c9179f38af96 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:50.677060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c7d95ac-a615-4c07-b32d-c9179f38af96 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:50.677922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c7d95ac-a615-4c07-b32d-c9179f38af96 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:50.678973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c7d95ac-a615-4c07-b32d-c9179f38af96 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:50.679631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c7d95ac-a615-4c07-b32d-c9179f38af96 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:50.728878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6c7d95ac-a615-4c07-b32d-c9179f38af96 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:36:50.956375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6c7d95ac-a615-4c07-b32d-c9179f38af96 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "DELETE /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 204 len: 0 microversion: 2.1 time: 0.308212 Aug 01 15:36:50.961670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 190/390] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 15:36:50 2022] DELETE /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:36:50.971373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9edcae6c-0853-4103-a755-38a20d2f54a7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:50.972060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9edcae6c-0853-4103-a755-38a20d2f54a7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:50.984684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9edcae6c-0853-4103-a755-38a20d2f54a7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:50.985142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9edcae6c-0853-4103-a755-38a20d2f54a7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:50.985949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9edcae6c-0853-4103-a755-38a20d2f54a7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:50.986389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9edcae6c-0853-4103-a755-38a20d2f54a7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:51.358883 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9edcae6c-0853-4103-a755-38a20d2f54a7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:51.371386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9edcae6c-0853-4103-a755-38a20d2f54a7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1559 microversion: 2.1 time: 0.403090 Aug 01 15:36:51.372149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 201/391] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:50 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1559 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:51.504257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e02ef1c7-029c-4901-aab0-dafcf32e08c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:51.505091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e02ef1c7-029c-4901-aab0-dafcf32e08c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:51.525499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e02ef1c7-029c-4901-aab0-dafcf32e08c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:51.526984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e02ef1c7-029c-4901-aab0-dafcf32e08c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:51.527748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-73d31eb6-9863-455b-8bcd-9b7194f52c48 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:51.528371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-73d31eb6-9863-455b-8bcd-9b7194f52c48 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:51.529963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e02ef1c7-029c-4901-aab0-dafcf32e08c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:51.531717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e02ef1c7-029c-4901-aab0-dafcf32e08c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:51.545706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73d31eb6-9863-455b-8bcd-9b7194f52c48 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:51.546256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73d31eb6-9863-455b-8bcd-9b7194f52c48 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:51.547618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73d31eb6-9863-455b-8bcd-9b7194f52c48 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:51.548345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73d31eb6-9863-455b-8bcd-9b7194f52c48 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:52.125691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-73d31eb6-9863-455b-8bcd-9b7194f52c48 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:52.136427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-73d31eb6-9863-455b-8bcd-9b7194f52c48 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:52.143158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-73d31eb6-9863-455b-8bcd-9b7194f52c48 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:52.149397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-73d31eb6-9863-455b-8bcd-9b7194f52c48 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 0.624782 Aug 01 15:36:52.166590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 202/392] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:36:52.372452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e02ef1c7-029c-4901-aab0-dafcf32e08c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:52.385728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e02ef1c7-029c-4901-aab0-dafcf32e08c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.887418 Aug 01 15:36:52.388516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 191/393] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:51 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:52.394846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-dc1268f1-391d-4e94-b759-321bce2b61f6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:52.395470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-dc1268f1-391d-4e94-b759-321bce2b61f6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:52.410457 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dc1268f1-391d-4e94-b759-321bce2b61f6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:52.415318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dc1268f1-391d-4e94-b759-321bce2b61f6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:52.423391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dc1268f1-391d-4e94-b759-321bce2b61f6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:52.437424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dc1268f1-391d-4e94-b759-321bce2b61f6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:52.809234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dc1268f1-391d-4e94-b759-321bce2b61f6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:52.838590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-dc1268f1-391d-4e94-b759-321bce2b61f6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1513 microversion: 2.1 time: 0.447323 Aug 01 15:36:52.850931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 203/394] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:52 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1513 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:53.184540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eedd99c6-3c20-4319-a7dc-0aa37f4c98f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:53.185355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eedd99c6-3c20-4319-a7dc-0aa37f4c98f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:53.194689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eedd99c6-3c20-4319-a7dc-0aa37f4c98f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:53.195296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eedd99c6-3c20-4319-a7dc-0aa37f4c98f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:53.196306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eedd99c6-3c20-4319-a7dc-0aa37f4c98f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:53.197132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eedd99c6-3c20-4319-a7dc-0aa37f4c98f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:53.416119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7206fd15-feaa-41c8-8805-7ad00f3f1d50 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:53.417014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7206fd15-feaa-41c8-8805-7ad00f3f1d50 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:53.458930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7206fd15-feaa-41c8-8805-7ad00f3f1d50 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:53.460267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7206fd15-feaa-41c8-8805-7ad00f3f1d50 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:53.462655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7206fd15-feaa-41c8-8805-7ad00f3f1d50 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:53.465132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7206fd15-feaa-41c8-8805-7ad00f3f1d50 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:54.072481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7206fd15-feaa-41c8-8805-7ad00f3f1d50 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:54.092082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7206fd15-feaa-41c8-8805-7ad00f3f1d50 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.678388 Aug 01 15:36:54.094628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 204/395] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:53 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:54.108270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-834253589", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac89fec2-a975-42c8-b198-9fd04c31bc1f"}], "security_groups": [{"name": "tempest-securitygroup--68357683"}], "key_name": "tempest-keypair-1320122182", "user_data": "}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:54.159970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eedd99c6-3c20-4319-a7dc-0aa37f4c98f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:54.196541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eedd99c6-3c20-4319-a7dc-0aa37f4c98f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:54.203347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eedd99c6-3c20-4319-a7dc-0aa37f4c98f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:54.210952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eedd99c6-3c20-4319-a7dc-0aa37f4c98f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 1.032377 Aug 01 15:36:54.219591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 192/396] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:54.233365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-112c6e58-c381-4156-802d-eb8e6b4455df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:54.234634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-112c6e58-c381-4156-802d-eb8e6b4455df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:54.243892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-112c6e58-c381-4156-802d-eb8e6b4455df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:54.244815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-112c6e58-c381-4156-802d-eb8e6b4455df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:54.247783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-112c6e58-c381-4156-802d-eb8e6b4455df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:54.251221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-112c6e58-c381-4156-802d-eb8e6b4455df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:55.322367 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.network.neutron [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] validate_networks() for [('ac89fec2-a975-42c8-b198-9fd04c31bc1f', None, None, None, None, None)] {{(pid=124527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:36:55.701932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-112c6e58-c381-4156-802d-eb8e6b4455df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:55.721805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-112c6e58-c381-4156-802d-eb8e6b4455df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 200 len: 1513 microversion: 2.1 time: 1.499451 Aug 01 15:36:55.724650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 193/397] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:54 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 1513 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:55.735061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1566255494", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1101178689", "security_groups": [{"name": "tempest-secgroup-smoke-638099530"}], "networks": [{"uuid": "5220e324-3bee-41ec-bbdc-2fb987a4302d"}], "block_device_mapping_v2": [{"uuid": "eb291960-6ead-455a-b513-6a368a984c9b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:55.765151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:36:56.366414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.network.neutron [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] validate_networks() for [('5220e324-3bee-41ec-bbdc-2fb987a4302d', None, None, None, None, None)] {{(pid=124526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:36:57.987933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Flavor limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:36:57.989609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Image limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:36:57.990319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Flavor pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:36:57.991018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Image pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:36:57.991604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:36:58.004500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:58.005223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:58.006224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:58.006828 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:58.029799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Getting quotas for project 2d49f0b3378c42ada96c61586a38136e. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:36:58.034961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Getting quotas for user 5f0b12ba782244d7b44783c3f3532bfa and project 2d49f0b3378c42ada96c61586a38136e. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:36:58.057510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Going to run 1 instances... {{(pid=124527) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:36:58.068798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:36:58.133444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d7ec7af9-e884-485a-8e0b-29977780f26d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.037256 Aug 01 15:36:58.134342 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 205/398] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:36:54 2022] POST /compute/v2.1/servers => generated 407 bytes in 4039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:36:58.147753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-24421c6a-6db3-4050-9389-eb48f92faf88 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:58.149174 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-24421c6a-6db3-4050-9389-eb48f92faf88 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:58.160190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-24421c6a-6db3-4050-9389-eb48f92faf88 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:58.160942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-24421c6a-6db3-4050-9389-eb48f92faf88 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:58.162519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-24421c6a-6db3-4050-9389-eb48f92faf88 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:58.163180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-24421c6a-6db3-4050-9389-eb48f92faf88 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:58.301255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Flavor limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:36:58.301769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Image limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:36:58.302179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Flavor pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:36:58.302796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Image pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:36:58.303372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:36:58.334546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:58.335005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:58.337390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:58.337855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:58.371302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Getting quotas for project 63125418cd9949cdbf76099952b31950. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:36:58.377519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Getting quotas for user 6d903b4429664fceaa1344f1b99791dd and project 63125418cd9949cdbf76099952b31950. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:36:58.555824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Going to run 1 instances... {{(pid=124526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:36:58.558229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb291960-6ead-455a-b513-6a368a984c9b',volume_size=None,volume_type=None)] {{(pid=124526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:36:58.576934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-24421c6a-6db3-4050-9389-eb48f92faf88 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:58.586975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-24421c6a-6db3-4050-9389-eb48f92faf88 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.451349 Aug 01 15:36:58.587829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 206/399] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:58 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:58.646142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4e7377cd-23df-4225-9c58-24bb5f610487 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:58.684813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4e7377cd-23df-4225-9c58-24bb5f610487 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:58.762153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e7377cd-23df-4225-9c58-24bb5f610487 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:58.763666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e7377cd-23df-4225-9c58-24bb5f610487 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.047s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:58.767255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e7377cd-23df-4225-9c58-24bb5f610487 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:58.771329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e7377cd-23df-4225-9c58-24bb5f610487 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:59.245173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4e7377cd-23df-4225-9c58-24bb5f610487 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:59.256147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-05f93629-ab92-4008-a274-ec93cc808b76 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.516799 Aug 01 15:36:59.261706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 194/400] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:36:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 3536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:36:59.269454 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4e7377cd-23df-4225-9c58-24bb5f610487 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:59.275344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4e7377cd-23df-4225-9c58-24bb5f610487 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:59.280615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-3799f5ba-ad56-40d2-b802-aeed4282e211 req-45451f77-5000-49f7-bfe3-f70841a23383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac32bea-aa1d-4abf-bd69-332c15fa2ebf", "name": "network-vif-deleted", "tag": "12cd816a-227b-4146-9dfb-1360caef9173"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:59.287362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4e7377cd-23df-4225-9c58-24bb5f610487 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 0.692604 Aug 01 15:36:59.297736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 207/401] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:36:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:36:59.317014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bf7e69e5-2666-420e-977b-201b97610557 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:59.317650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bf7e69e5-2666-420e-977b-201b97610557 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: fac32bea-aa1d-4abf-bd69-332c15fa2ebf] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:59.327675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-3799f5ba-ad56-40d2-b802-aeed4282e211 req-45451f77-5000-49f7-bfe3-f70841a23383 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:59.328264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-3799f5ba-ad56-40d2-b802-aeed4282e211 req-45451f77-5000-49f7-bfe3-f70841a23383 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:59.339882 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf7e69e5-2666-420e-977b-201b97610557 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:59.341012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf7e69e5-2666-420e-977b-201b97610557 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:59.342001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf7e69e5-2666-420e-977b-201b97610557 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:59.342702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf7e69e5-2666-420e-977b-201b97610557 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:59.362948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-3799f5ba-ad56-40d2-b802-aeed4282e211 req-45451f77-5000-49f7-bfe3-f70841a23383 service nova] Creating event network-vif-deleted:12cd816a-227b-4146-9dfb-1360caef9173 for instance fac32bea-aa1d-4abf-bd69-332c15fa2ebf on hv-cinder-84753 Aug 01 15:36:59.377314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-3799f5ba-ad56-40d2-b802-aeed4282e211 req-45451f77-5000-49f7-bfe3-f70841a23383 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108496 Aug 01 15:36:59.378728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 195/402] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:36:59.388724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-24052ffa-2417-4003-a9cb-b03828cda7e7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:59.391344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-bf7e69e5-2666-420e-977b-201b97610557 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] HTTP exception thrown: Instance fac32bea-aa1d-4abf-bd69-332c15fa2ebf could not be found. Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bf7e69e5-2666-420e-977b-201b97610557 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Request method failure captured: Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf HTTP/1.1 Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_K53ddQWvF8bwwX7kPrpmXB-Ft4gpk37Z_xQqLmOiw7qzQc0ix5_nT8dQWyuY23pJ-Kp8DZ5Muml7xjPBHUc8LoO6PfskGPOrUZ9RKz2fqvze9FjRell81KUxGu4MHB1g-dHKhXvmVsu1ur8xU-2fAKxciMJycj3fu7Jp1bTJHl6wc Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:36:59.394569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:36:59.396273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/38f80d210cce4a41af527ac134deba93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_38f80d210cce4a41af527ac134deba93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}] Aug 01 15:36:59.396273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:36:59.396273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:36:59.396273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:36:59.396273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:36:59.396273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:36:59.396273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:36:59.396273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 77cb30fae1184064a8c4f822d4d31096 Aug 01 15:36:59.396273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:36:59.396273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 15:36:59.396273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance fac32bea-aa1d-4abf-bd69-332c15fa2ebf could not be found. Aug 01 15:36:59.396273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': 'fac32bea-aa1d-4abf-bd69-332c15fa2ebf'} Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac32bea-aa1d-4abf-bd69-332c15fa2ebf could not be found. Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:36:59.397347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac32bea-aa1d-4abf-bd69-332c15fa2ebf could not be found. Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac32bea-aa1d-4abf-bd69-332c15fa2ebf could not be found. Aug 01 15:36:59.398693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:36:59.402372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-24052ffa-2417-4003-a9cb-b03828cda7e7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:59.403557 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bf7e69e5-2666-420e-977b-201b97610557 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Returning 404 to user: Instance fac32bea-aa1d-4abf-bd69-332c15fa2ebf could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:36:59.404865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bf7e69e5-2666-420e-977b-201b97610557 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf" status: 404 len: 111 microversion: 2.1 time: 0.103439 Aug 01 15:36:59.415555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 208/403] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:59 2022] GET /compute/v2.1/servers/fac32bea-aa1d-4abf-bd69-332c15fa2ebf => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:36:59.476552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-11ee9f09-7c46-4e90-94b3-f78428401b15 req-9108c29b-d6e8-45e1-9767-bcab3ee67da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6675886-2e34-4d44-b8df-0d31d3b19c02", "name": "network-vif-plugged", "status": "completed", "tag": "6c6d11cc-7ba5-440d-b123-0214fb8dd8a2"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:36:59.500597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-11ee9f09-7c46-4e90-94b3-f78428401b15 req-9108c29b-d6e8-45e1-9767-bcab3ee67da5 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:59.501129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-11ee9f09-7c46-4e90-94b3-f78428401b15 req-9108c29b-d6e8-45e1-9767-bcab3ee67da5 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:59.567207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-11ee9f09-7c46-4e90-94b3-f78428401b15 req-9108c29b-d6e8-45e1-9767-bcab3ee67da5 service nova] Creating event network-vif-plugged:6c6d11cc-7ba5-440d-b123-0214fb8dd8a2 for instance d6675886-2e34-4d44-b8df-0d31d3b19c02 on hv-cinder-84753 Aug 01 15:36:59.576243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-24052ffa-2417-4003-a9cb-b03828cda7e7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:59.588743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-24052ffa-2417-4003-a9cb-b03828cda7e7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1245 microversion: 2.1 time: 0.204975 Aug 01 15:36:59.592849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 196/404] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:59 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1245 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:36:59.597575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-11ee9f09-7c46-4e90-94b3-f78428401b15 req-9108c29b-d6e8-45e1-9767-bcab3ee67da5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180509 Aug 01 15:36:59.599171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 209/405] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:36:59.599666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-451287c0-a478-402f-88a0-4642e3bd41cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:59.604655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-451287c0-a478-402f-88a0-4642e3bd41cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:59.658024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c67bbd42-295c-4ffb-88a4-2c0a58a0a8dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:36:59.659165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c67bbd42-295c-4ffb-88a4-2c0a58a0a8dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:36:59.698372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c67bbd42-295c-4ffb-88a4-2c0a58a0a8dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:59.699726 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c67bbd42-295c-4ffb-88a4-2c0a58a0a8dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:59.701006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c67bbd42-295c-4ffb-88a4-2c0a58a0a8dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:36:59.713170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c67bbd42-295c-4ffb-88a4-2c0a58a0a8dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:36:59.801135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-451287c0-a478-402f-88a0-4642e3bd41cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:36:59.821914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-451287c0-a478-402f-88a0-4642e3bd41cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1089 microversion: 2.1 time: 0.227528 Aug 01 15:36:59.823531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 197/406] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:59 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1089 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:00.321734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b36b39d3-aaa5-46e8-9261-15c21cc36b22 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:00.322684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b36b39d3-aaa5-46e8-9261-15c21cc36b22 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:00.354896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b36b39d3-aaa5-46e8-9261-15c21cc36b22 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:00.357675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b36b39d3-aaa5-46e8-9261-15c21cc36b22 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:00.359527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b36b39d3-aaa5-46e8-9261-15c21cc36b22 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:00.362211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b36b39d3-aaa5-46e8-9261-15c21cc36b22 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:00.981272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c67bbd42-295c-4ffb-88a4-2c0a58a0a8dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:00.995285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c67bbd42-295c-4ffb-88a4-2c0a58a0a8dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 1.342075 Aug 01 15:37:01.002559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 210/407] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:36:59 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:01.014711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2888bbd4-761e-48c7-a3c9-466aa8c36002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:01.021552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2888bbd4-761e-48c7-a3c9-466aa8c36002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:01.030709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:01.034880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2888bbd4-761e-48c7-a3c9-466aa8c36002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:01.035124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b36b39d3-aaa5-46e8-9261-15c21cc36b22 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:01.037595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2888bbd4-761e-48c7-a3c9-466aa8c36002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:01.041826 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2888bbd4-761e-48c7-a3c9-466aa8c36002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:01.056352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2888bbd4-761e-48c7-a3c9-466aa8c36002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:01.062843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b36b39d3-aaa5-46e8-9261-15c21cc36b22 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:01.064906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b36b39d3-aaa5-46e8-9261-15c21cc36b22 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:01.066840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b36b39d3-aaa5-46e8-9261-15c21cc36b22 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 0.749508 Aug 01 15:37:01.069408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 198/408] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:01.093688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3e4ae91f-5514-42c2-8fcf-0b9dcd81f59b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:01.095969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3e4ae91f-5514-42c2-8fcf-0b9dcd81f59b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:01.119938 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e4ae91f-5514-42c2-8fcf-0b9dcd81f59b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:01.121301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e4ae91f-5514-42c2-8fcf-0b9dcd81f59b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:01.124067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e4ae91f-5514-42c2-8fcf-0b9dcd81f59b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:01.124682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e4ae91f-5514-42c2-8fcf-0b9dcd81f59b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:01.325699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3e4ae91f-5514-42c2-8fcf-0b9dcd81f59b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:01.328449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2888bbd4-761e-48c7-a3c9-466aa8c36002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:01.338621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2888bbd4-761e-48c7-a3c9-466aa8c36002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1297 microversion: 2.1 time: 0.332624 Aug 01 15:37:01.341699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 211/409] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:01 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1297 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:01.353524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3e4ae91f-5514-42c2-8fcf-0b9dcd81f59b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1139 microversion: 2.1 time: 0.277935 Aug 01 15:37:01.373693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 199/410] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:01 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1139 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:02.034607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4fba0d52-a3ec-4824-abb6-2332f08c5a67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:02.036228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4fba0d52-a3ec-4824-abb6-2332f08c5a67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:02.065789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4fba0d52-a3ec-4824-abb6-2332f08c5a67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:02.066285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4fba0d52-a3ec-4824-abb6-2332f08c5a67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:02.076450 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4fba0d52-a3ec-4824-abb6-2332f08c5a67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:02.081348 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4fba0d52-a3ec-4824-abb6-2332f08c5a67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:02.095242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-48064aa4-311f-4e68-95bb-746c7708cbed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:02.096149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-48064aa4-311f-4e68-95bb-746c7708cbed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:02.111300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48064aa4-311f-4e68-95bb-746c7708cbed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:02.116190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48064aa4-311f-4e68-95bb-746c7708cbed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:02.117934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48064aa4-311f-4e68-95bb-746c7708cbed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:02.120347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48064aa4-311f-4e68-95bb-746c7708cbed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:02.145464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:02.568805 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4fba0d52-a3ec-4824-abb6-2332f08c5a67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:02.604123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4fba0d52-a3ec-4824-abb6-2332f08c5a67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.559711 Aug 01 15:37:02.605173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 212/411] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:02 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:02.617781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-565d299d-e0f9-47a4-96b1-4d05acd16624 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:02.624273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-565d299d-e0f9-47a4-96b1-4d05acd16624 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:02.628274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48064aa4-311f-4e68-95bb-746c7708cbed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:02.640480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-565d299d-e0f9-47a4-96b1-4d05acd16624 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:02.641601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-565d299d-e0f9-47a4-96b1-4d05acd16624 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:02.643168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-565d299d-e0f9-47a4-96b1-4d05acd16624 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:02.644068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48064aa4-311f-4e68-95bb-746c7708cbed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:02.644528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-565d299d-e0f9-47a4-96b1-4d05acd16624 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:02.646071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48064aa4-311f-4e68-95bb-746c7708cbed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:02.647975 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-48064aa4-311f-4e68-95bb-746c7708cbed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 0.556260 Aug 01 15:37:02.648554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 200/412] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:02.670118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-97d49aad-c472-43aa-9c2b-6b6431d3e838 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:02.673297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-97d49aad-c472-43aa-9c2b-6b6431d3e838 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:02.692395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-97d49aad-c472-43aa-9c2b-6b6431d3e838 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:02.692866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-97d49aad-c472-43aa-9c2b-6b6431d3e838 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:02.693834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-97d49aad-c472-43aa-9c2b-6b6431d3e838 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:02.694469 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-97d49aad-c472-43aa-9c2b-6b6431d3e838 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:02.769778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-565d299d-e0f9-47a4-96b1-4d05acd16624 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:02.780280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-565d299d-e0f9-47a4-96b1-4d05acd16624 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1297 microversion: 2.1 time: 0.174134 Aug 01 15:37:02.780876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 213/413] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:02 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1297 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:02.824588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-97d49aad-c472-43aa-9c2b-6b6431d3e838 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:02.833672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-97d49aad-c472-43aa-9c2b-6b6431d3e838 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1139 microversion: 2.1 time: 0.183450 Aug 01 15:37:02.834305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 201/414] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:02 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1139 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:03.626138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b70d73af-db0e-4ae0-8614-1bafb238ed65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:03.627638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b70d73af-db0e-4ae0-8614-1bafb238ed65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:03.642067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b70d73af-db0e-4ae0-8614-1bafb238ed65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:03.642067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b70d73af-db0e-4ae0-8614-1bafb238ed65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:03.642067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b70d73af-db0e-4ae0-8614-1bafb238ed65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:03.642067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b70d73af-db0e-4ae0-8614-1bafb238ed65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:03.672685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0c08449a-ad29-4834-a15c-fa0739ec6c7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:03.674230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0c08449a-ad29-4834-a15c-fa0739ec6c7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:03.682267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0c08449a-ad29-4834-a15c-fa0739ec6c7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:03.683035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0c08449a-ad29-4834-a15c-fa0739ec6c7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:03.683991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0c08449a-ad29-4834-a15c-fa0739ec6c7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:03.684607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0c08449a-ad29-4834-a15c-fa0739ec6c7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:04.190357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b70d73af-db0e-4ae0-8614-1bafb238ed65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:04.211831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b70d73af-db0e-4ae0-8614-1bafb238ed65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.590415 Aug 01 15:37:04.227709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 214/415] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:03 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:04.256399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-86c60ddd-5391-4eac-bae6-aed87b57e54e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:04.258510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-86c60ddd-5391-4eac-bae6-aed87b57e54e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:04.283206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-86c60ddd-5391-4eac-bae6-aed87b57e54e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:04.284228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0c08449a-ad29-4834-a15c-fa0739ec6c7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:04.286904 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-86c60ddd-5391-4eac-bae6-aed87b57e54e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:04.292196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-86c60ddd-5391-4eac-bae6-aed87b57e54e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:04.292196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-86c60ddd-5391-4eac-bae6-aed87b57e54e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:04.304262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0c08449a-ad29-4834-a15c-fa0739ec6c7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:04.314035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0c08449a-ad29-4834-a15c-fa0739ec6c7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:04.322505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0c08449a-ad29-4834-a15c-fa0739ec6c7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 0.652719 Aug 01 15:37:04.327870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 202/416] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:37:04.352979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4aba36d5-9e36-4488-a323-8861c239ed6e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:04.353912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4aba36d5-9e36-4488-a323-8861c239ed6e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:04.375872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4aba36d5-9e36-4488-a323-8861c239ed6e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:04.378562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4aba36d5-9e36-4488-a323-8861c239ed6e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:04.383384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4aba36d5-9e36-4488-a323-8861c239ed6e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:04.384103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4aba36d5-9e36-4488-a323-8861c239ed6e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:04.988088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-86c60ddd-5391-4eac-bae6-aed87b57e54e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:05.002045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-86c60ddd-5391-4eac-bae6-aed87b57e54e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1297 microversion: 2.1 time: 0.766366 Aug 01 15:37:05.004676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4aba36d5-9e36-4488-a323-8861c239ed6e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:05.015669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 215/417] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:04 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1297 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:05.027655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4aba36d5-9e36-4488-a323-8861c239ed6e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1139 microversion: 2.1 time: 0.694681 Aug 01 15:37:05.038321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 203/418] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:04 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1139 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:05.280295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-87d9fd2b-c4ec-4aa6-abb7-96cc9164f995 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:05.283689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-87d9fd2b-c4ec-4aa6-abb7-96cc9164f995 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:05.322878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87d9fd2b-c4ec-4aa6-abb7-96cc9164f995 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:05.327790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87d9fd2b-c4ec-4aa6-abb7-96cc9164f995 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:05.331647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87d9fd2b-c4ec-4aa6-abb7-96cc9164f995 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:05.339157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87d9fd2b-c4ec-4aa6-abb7-96cc9164f995 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:05.355319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-201c850a-c324-4374-8fdb-ebbb52715677 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:05.356221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-201c850a-c324-4374-8fdb-ebbb52715677 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:05.370459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-201c850a-c324-4374-8fdb-ebbb52715677 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:05.378649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-201c850a-c324-4374-8fdb-ebbb52715677 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:05.379767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-201c850a-c324-4374-8fdb-ebbb52715677 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:05.380374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-201c850a-c324-4374-8fdb-ebbb52715677 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:05.732363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-87d9fd2b-c4ec-4aa6-abb7-96cc9164f995 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:05.748788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-87d9fd2b-c4ec-4aa6-abb7-96cc9164f995 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1366 microversion: 2.1 time: 0.508008 Aug 01 15:37:05.749541 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 216/419] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:05 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1366 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:05.815382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-201c850a-c324-4374-8fdb-ebbb52715677 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:05.828880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-201c850a-c324-4374-8fdb-ebbb52715677 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:05.831066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-201c850a-c324-4374-8fdb-ebbb52715677 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:05.836505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-201c850a-c324-4374-8fdb-ebbb52715677 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 0.485679 Aug 01 15:37:05.840345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 204/420] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:37:06.029002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5ba83738-8879-4fa1-a5ef-270751c0adb2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:06.030328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5ba83738-8879-4fa1-a5ef-270751c0adb2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:06.042851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ba83738-8879-4fa1-a5ef-270751c0adb2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:06.050501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f6da802e-7288-49ee-ab5e-0b78ec5f017f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:06.051754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f6da802e-7288-49ee-ab5e-0b78ec5f017f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:06.059986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ba83738-8879-4fa1-a5ef-270751c0adb2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:06.061871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ba83738-8879-4fa1-a5ef-270751c0adb2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:06.063925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f6da802e-7288-49ee-ab5e-0b78ec5f017f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:06.064752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ba83738-8879-4fa1-a5ef-270751c0adb2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:06.070708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f6da802e-7288-49ee-ab5e-0b78ec5f017f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:06.071895 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f6da802e-7288-49ee-ab5e-0b78ec5f017f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:06.072538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f6da802e-7288-49ee-ab5e-0b78ec5f017f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:06.229856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5ba83738-8879-4fa1-a5ef-270751c0adb2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:06.238819 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5ba83738-8879-4fa1-a5ef-270751c0adb2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1303 microversion: 2.1 time: 0.214713 Aug 01 15:37:06.247497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 217/421] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:06 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1303 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:06.294694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f6da802e-7288-49ee-ab5e-0b78ec5f017f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:06.305165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f6da802e-7288-49ee-ab5e-0b78ec5f017f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1187 microversion: 2.1 time: 0.258087 Aug 01 15:37:06.325457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 205/422] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:06 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1187 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:06.787654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4b6465a4-173b-44f0-aa43-1a7f1fc42559 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:06.789503 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4b6465a4-173b-44f0-aa43-1a7f1fc42559 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:06.825779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b6465a4-173b-44f0-aa43-1a7f1fc42559 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:06.827048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b6465a4-173b-44f0-aa43-1a7f1fc42559 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:06.828984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b6465a4-173b-44f0-aa43-1a7f1fc42559 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:06.839403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b6465a4-173b-44f0-aa43-1a7f1fc42559 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:06.881725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c40adc50-cccb-4640-a688-714eb8db0004 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:06.882681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c40adc50-cccb-4640-a688-714eb8db0004 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:06.890330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c40adc50-cccb-4640-a688-714eb8db0004 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:06.891364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c40adc50-cccb-4640-a688-714eb8db0004 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:06.892337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c40adc50-cccb-4640-a688-714eb8db0004 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:06.892934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c40adc50-cccb-4640-a688-714eb8db0004 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:06.923459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:07.218138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c40adc50-cccb-4640-a688-714eb8db0004 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:07.224543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4b6465a4-173b-44f0-aa43-1a7f1fc42559 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:07.228114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c40adc50-cccb-4640-a688-714eb8db0004 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:07.230296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c40adc50-cccb-4640-a688-714eb8db0004 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:07.231481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c40adc50-cccb-4640-a688-714eb8db0004 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 0.354017 Aug 01 15:37:07.232050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 206/423] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:07.234467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4b6465a4-173b-44f0-aa43-1a7f1fc42559 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1556 microversion: 2.1 time: 0.459100 Aug 01 15:37:07.245660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 218/424] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:06 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1556 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:07.262143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-24bf2e5d-4f96-4002-bb9b-88d0501f19e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:07.266238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-24bf2e5d-4f96-4002-bb9b-88d0501f19e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:07.272721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bd0ca8f4-82ae-485c-b6dc-141b3886495b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:07.274773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bd0ca8f4-82ae-485c-b6dc-141b3886495b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:07.281147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24bf2e5d-4f96-4002-bb9b-88d0501f19e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:07.284835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24bf2e5d-4f96-4002-bb9b-88d0501f19e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:07.289771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24bf2e5d-4f96-4002-bb9b-88d0501f19e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:07.291488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24bf2e5d-4f96-4002-bb9b-88d0501f19e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:07.295564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd0ca8f4-82ae-485c-b6dc-141b3886495b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:07.298957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd0ca8f4-82ae-485c-b6dc-141b3886495b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:07.302444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd0ca8f4-82ae-485c-b6dc-141b3886495b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:07.305910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd0ca8f4-82ae-485c-b6dc-141b3886495b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:07.451289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-24bf2e5d-4f96-4002-bb9b-88d0501f19e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.194889 Aug 01 15:37:07.452320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 207/425] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 1 15:37:07 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:07.464026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bd0ca8f4-82ae-485c-b6dc-141b3886495b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:07.467451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-42a2bf93-8405-4641-868b-6322bca50207 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:07.468305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-42a2bf93-8405-4641-868b-6322bca50207 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:07.483328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bd0ca8f4-82ae-485c-b6dc-141b3886495b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1303 microversion: 2.1 time: 0.211460 Aug 01 15:37:07.484034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 219/426] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:07 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1303 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:07.501371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42a2bf93-8405-4641-868b-6322bca50207 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:07.501923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42a2bf93-8405-4641-868b-6322bca50207 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:07.502822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42a2bf93-8405-4641-868b-6322bca50207 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:07.503330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42a2bf93-8405-4641-868b-6322bca50207 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:07.623603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-42a2bf93-8405-4641-868b-6322bca50207 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:07.651462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-42a2bf93-8405-4641-868b-6322bca50207 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1187 microversion: 2.1 time: 0.189478 Aug 01 15:37:07.658681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 208/427] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:07 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1187 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:08.272943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5d79ae4d-12ef-4656-9754-031a2fdaa6bd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:08.275308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5d79ae4d-12ef-4656-9754-031a2fdaa6bd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:08.283003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=2 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:08.284094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=6 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:08.286872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d79ae4d-12ef-4656-9754-031a2fdaa6bd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:08.287629 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d79ae4d-12ef-4656-9754-031a2fdaa6bd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:08.289012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d79ae4d-12ef-4656-9754-031a2fdaa6bd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:08.289777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d79ae4d-12ef-4656-9754-031a2fdaa6bd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:08.502231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=2 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:08.523812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ce1fec82-1c2c-418d-81d6-d5f3df544cdd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:08.525748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ce1fec82-1c2c-418d-81d6-d5f3df544cdd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:08.568630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce1fec82-1c2c-418d-81d6-d5f3df544cdd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:08.572070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce1fec82-1c2c-418d-81d6-d5f3df544cdd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:08.575365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce1fec82-1c2c-418d-81d6-d5f3df544cdd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:08.575869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce1fec82-1c2c-418d-81d6-d5f3df544cdd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:08.803138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ce1fec82-1c2c-418d-81d6-d5f3df544cdd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:08.815976 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ce1fec82-1c2c-418d-81d6-d5f3df544cdd tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1303 microversion: 2.1 time: 0.314904 Aug 01 15:37:08.816986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 209/428] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:08 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1303 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:08.849706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f30bce77-331a-4915-9c65-cbeff19f9281 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:08.850610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f30bce77-331a-4915-9c65-cbeff19f9281 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:08.858506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f30bce77-331a-4915-9c65-cbeff19f9281 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:08.859848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f30bce77-331a-4915-9c65-cbeff19f9281 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:08.860067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f30bce77-331a-4915-9c65-cbeff19f9281 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:08.860515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f30bce77-331a-4915-9c65-cbeff19f9281 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:08.880417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d79ae4d-12ef-4656-9754-031a2fdaa6bd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:08.890009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d79ae4d-12ef-4656-9754-031a2fdaa6bd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:08.906822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d79ae4d-12ef-4656-9754-031a2fdaa6bd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:08.911591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5d79ae4d-12ef-4656-9754-031a2fdaa6bd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1740 microversion: 2.20 time: 0.643302 Aug 01 15:37:08.914253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 220/429] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1740 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:08.929305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-879077829", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "networks": [{"uuid": "fab1f7ba-00f0-40a4-91ee-a38e8bcf4d1b"}]}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:09.069992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.network.neutron [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] validate_networks() for [('fab1f7ba-00f0-40a4-91ee-a38e8bcf4d1b', None, None, None, None, None)] {{(pid=124527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:37:09.497738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f30bce77-331a-4915-9c65-cbeff19f9281 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:09.506985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f30bce77-331a-4915-9c65-cbeff19f9281 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1195 microversion: 2.1 time: 0.666943 Aug 01 15:37:09.507842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 210/430] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:08 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1195 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:09.845689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f3a3f9d7-319e-4bf4-8753-8d62caeffaf6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:09.847593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f3a3f9d7-319e-4bf4-8753-8d62caeffaf6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:09.859976 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=14 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:09.866676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f3a3f9d7-319e-4bf4-8753-8d62caeffaf6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:09.867383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f3a3f9d7-319e-4bf4-8753-8d62caeffaf6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:09.869100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f3a3f9d7-319e-4bf4-8753-8d62caeffaf6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:09.870320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f3a3f9d7-319e-4bf4-8753-8d62caeffaf6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:10.103939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f3a3f9d7-319e-4bf4-8753-8d62caeffaf6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:10.118337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f3a3f9d7-319e-4bf4-8753-8d62caeffaf6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1303 microversion: 2.1 time: 0.277705 Aug 01 15:37:10.136675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 211/431] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:09 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1303 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:10.143825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c9edc3aa-5bca-49a7-bb66-afe6d85b45a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:10.145436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c9edc3aa-5bca-49a7-bb66-afe6d85b45a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:10.156769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9edc3aa-5bca-49a7-bb66-afe6d85b45a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:10.157601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9edc3aa-5bca-49a7-bb66-afe6d85b45a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:10.158642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9edc3aa-5bca-49a7-bb66-afe6d85b45a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:10.159334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9edc3aa-5bca-49a7-bb66-afe6d85b45a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:11.006511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c9edc3aa-5bca-49a7-bb66-afe6d85b45a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:11.020177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c9edc3aa-5bca-49a7-bb66-afe6d85b45a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:11.022680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c9edc3aa-5bca-49a7-bb66-afe6d85b45a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:11.024601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c9edc3aa-5bca-49a7-bb66-afe6d85b45a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1722 microversion: 2.20 time: 0.886162 Aug 01 15:37:11.026094 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 212/432] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:10 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1722 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:11.050651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-28dce463-ab63-46ba-a8bf-5ea738469e01 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:11.051531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-28dce463-ab63-46ba-a8bf-5ea738469e01 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:11.059767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28dce463-ab63-46ba-a8bf-5ea738469e01 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:11.060407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28dce463-ab63-46ba-a8bf-5ea738469e01 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:11.061379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28dce463-ab63-46ba-a8bf-5ea738469e01 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:11.062106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28dce463-ab63-46ba-a8bf-5ea738469e01 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:11.477854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-28dce463-ab63-46ba-a8bf-5ea738469e01 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:11.499956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-28dce463-ab63-46ba-a8bf-5ea738469e01 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1193 microversion: 2.1 time: 0.459996 Aug 01 15:37:11.505043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 213/433] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:11 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1193 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:11.516169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-309113ae-67a3-4f0f-95f7-2ee858b1bc64 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:11.517945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-309113ae-67a3-4f0f-95f7-2ee858b1bc64 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:11.526057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-309113ae-67a3-4f0f-95f7-2ee858b1bc64 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:11.526968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-309113ae-67a3-4f0f-95f7-2ee858b1bc64 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:11.527975 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-309113ae-67a3-4f0f-95f7-2ee858b1bc64 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:11.528610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-309113ae-67a3-4f0f-95f7-2ee858b1bc64 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:12.043044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Flavor limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:37:12.043779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Image limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:37:12.044476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Flavor pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:37:12.045050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Image pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:37:12.045623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:37:12.093197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:12.094041 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:12.094867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:12.095314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:12.185170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Getting quotas for project 38f80d210cce4a41af527ac134deba93. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:37:12.198417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Getting quotas for user 77cb30fae1184064a8c4f822d4d31096 and project 38f80d210cce4a41af527ac134deba93. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:37:12.229444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Going to run 1 instances... {{(pid=124527) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:37:12.232696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:37:12.334654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-309113ae-67a3-4f0f-95f7-2ee858b1bc64 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:12.343625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-309113ae-67a3-4f0f-95f7-2ee858b1bc64 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.836978 Aug 01 15:37:12.355931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 214/434] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:11 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:12.364683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0591150c-6f48-4453-b259-8edb8ce4d813 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:12.366990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2490dbe1-a45b-44a7-8cdb-1b989e310d95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.451061 Aug 01 15:37:12.367813 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0591150c-6f48-4453-b259-8edb8ce4d813 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:12.370768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 221/435] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:37:12.383472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d2aeb577-72db-4202-be12-b478df6750b2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:12.384632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0591150c-6f48-4453-b259-8edb8ce4d813 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:12.385245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0591150c-6f48-4453-b259-8edb8ce4d813 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:12.390005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0591150c-6f48-4453-b259-8edb8ce4d813 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:12.390890 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0591150c-6f48-4453-b259-8edb8ce4d813 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:12.391223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d2aeb577-72db-4202-be12-b478df6750b2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:12.521731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d2aeb577-72db-4202-be12-b478df6750b2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:12.531691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d2aeb577-72db-4202-be12-b478df6750b2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1218 microversion: 2.1 time: 0.152379 Aug 01 15:37:12.532955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 222/436] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:12 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:12.537991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-1c993ad8-46dd-49b8-b00a-b6b81c78326e req-cbc540ff-d9c0-4c10-98e3-c78d26430239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6675886-2e34-4d44-b8df-0d31d3b19c02", "tag": "6c6d11cc-7ba5-440d-b123-0214fb8dd8a2"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:12.556117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-1c993ad8-46dd-49b8-b00a-b6b81c78326e req-cbc540ff-d9c0-4c10-98e3-c78d26430239 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:12.557161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-1c993ad8-46dd-49b8-b00a-b6b81c78326e req-cbc540ff-d9c0-4c10-98e3-c78d26430239 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:12.575222 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-1c993ad8-46dd-49b8-b00a-b6b81c78326e req-cbc540ff-d9c0-4c10-98e3-c78d26430239 service nova] Creating event network-changed:6c6d11cc-7ba5-440d-b123-0214fb8dd8a2 for instance d6675886-2e34-4d44-b8df-0d31d3b19c02 on hv-cinder-84753 Aug 01 15:37:12.584073 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-1c993ad8-46dd-49b8-b00a-b6b81c78326e req-cbc540ff-d9c0-4c10-98e3-c78d26430239 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049369 Aug 01 15:37:12.585496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 223/437] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:12.593373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c6442005-c509-4309-8aa6-50c4286795cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:12.594878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c6442005-c509-4309-8aa6-50c4286795cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:12.611282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c6442005-c509-4309-8aa6-50c4286795cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:12.611995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c6442005-c509-4309-8aa6-50c4286795cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:12.613478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c6442005-c509-4309-8aa6-50c4286795cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:12.614110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c6442005-c509-4309-8aa6-50c4286795cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:12.738658 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c6442005-c509-4309-8aa6-50c4286795cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:12.756925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0591150c-6f48-4453-b259-8edb8ce4d813 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:12.761182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c6442005-c509-4309-8aa6-50c4286795cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1193 microversion: 2.1 time: 0.173431 Aug 01 15:37:12.766496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 224/438] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:12 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1193 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:12.790720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0591150c-6f48-4453-b259-8edb8ce4d813 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:12.795233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0591150c-6f48-4453-b259-8edb8ce4d813 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:12.799061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0591150c-6f48-4453-b259-8edb8ce4d813 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1722 microversion: 2.20 time: 0.441605 Aug 01 15:37:12.813996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 215/439] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1722 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:13.378785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-13b695e4-45fe-4501-aede-59f38e8ad8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:13.380404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-13b695e4-45fe-4501-aede-59f38e8ad8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:13.400620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13b695e4-45fe-4501-aede-59f38e8ad8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:13.401389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13b695e4-45fe-4501-aede-59f38e8ad8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:13.403016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13b695e4-45fe-4501-aede-59f38e8ad8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:13.403639 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13b695e4-45fe-4501-aede-59f38e8ad8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:13.553286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-64c0d0fb-6b97-4ffc-bdf0-cdd82cd4266a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:13.554629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-64c0d0fb-6b97-4ffc-bdf0-cdd82cd4266a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:13.570832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64c0d0fb-6b97-4ffc-bdf0-cdd82cd4266a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:13.571330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64c0d0fb-6b97-4ffc-bdf0-cdd82cd4266a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:13.572117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64c0d0fb-6b97-4ffc-bdf0-cdd82cd4266a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:13.572543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64c0d0fb-6b97-4ffc-bdf0-cdd82cd4266a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:13.671716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-64c0d0fb-6b97-4ffc-bdf0-cdd82cd4266a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:13.692472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-13b695e4-45fe-4501-aede-59f38e8ad8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:13.698810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-64c0d0fb-6b97-4ffc-bdf0-cdd82cd4266a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1222 microversion: 2.1 time: 0.132892 Aug 01 15:37:13.699695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 216/440] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:13 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1222 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:13.722592 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-13b695e4-45fe-4501-aede-59f38e8ad8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.347694 Aug 01 15:37:13.738695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 225/441] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:13 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:13.791654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-680bf3c4-b7ee-4f1f-9c53-69d096e420f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:13.793269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-680bf3c4-b7ee-4f1f-9c53-69d096e420f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:13.800843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-680bf3c4-b7ee-4f1f-9c53-69d096e420f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:13.801540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-680bf3c4-b7ee-4f1f-9c53-69d096e420f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:13.802755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-680bf3c4-b7ee-4f1f-9c53-69d096e420f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:13.803359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-680bf3c4-b7ee-4f1f-9c53-69d096e420f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:13.838201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-405562b9-6a3d-484a-8fba-88c21954a349 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:13.838791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-405562b9-6a3d-484a-8fba-88c21954a349 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:13.852599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-405562b9-6a3d-484a-8fba-88c21954a349 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:13.853331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-405562b9-6a3d-484a-8fba-88c21954a349 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:13.854317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-405562b9-6a3d-484a-8fba-88c21954a349 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:13.855651 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-405562b9-6a3d-484a-8fba-88c21954a349 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:14.084081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-680bf3c4-b7ee-4f1f-9c53-69d096e420f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:14.086532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-405562b9-6a3d-484a-8fba-88c21954a349 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:14.094817 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-680bf3c4-b7ee-4f1f-9c53-69d096e420f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.307463 Aug 01 15:37:14.095423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 217/442] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:13 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:14.100999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-405562b9-6a3d-484a-8fba-88c21954a349 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:14.102725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-405562b9-6a3d-484a-8fba-88c21954a349 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:14.104113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-405562b9-6a3d-484a-8fba-88c21954a349 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1722 microversion: 2.20 time: 0.272367 Aug 01 15:37:14.108828 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 226/443] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:14.726532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2f8c38cc-ff74-4e70-bfe8-ad500a60f42b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:14.727163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2f8c38cc-ff74-4e70-bfe8-ad500a60f42b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:14.745027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6b90f7dc-bd1d-49ba-8311-2f70dce94161 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:14.745816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6b90f7dc-bd1d-49ba-8311-2f70dce94161 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:14.755795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f8c38cc-ff74-4e70-bfe8-ad500a60f42b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:14.756806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f8c38cc-ff74-4e70-bfe8-ad500a60f42b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:14.757060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f8c38cc-ff74-4e70-bfe8-ad500a60f42b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:14.757507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f8c38cc-ff74-4e70-bfe8-ad500a60f42b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:14.767999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6b90f7dc-bd1d-49ba-8311-2f70dce94161 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:14.768456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6b90f7dc-bd1d-49ba-8311-2f70dce94161 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:14.769273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6b90f7dc-bd1d-49ba-8311-2f70dce94161 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:14.769720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6b90f7dc-bd1d-49ba-8311-2f70dce94161 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:15.096681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2f8c38cc-ff74-4e70-bfe8-ad500a60f42b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:15.112795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2f8c38cc-ff74-4e70-bfe8-ad500a60f42b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1222 microversion: 2.1 time: 0.390356 Aug 01 15:37:15.166662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 218/444] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:14 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1222 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:15.184125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-3aa3fc34-d2d3-41fb-a826-aca38b334e4c req-7f1e63b3-ed5c-4acf-9cf5-478a728b3b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df", "name": "network-vif-unplugged", "status": "completed", "tag": "ce819b69-03c1-4584-9ef2-0228b13d3351"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:15.208387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-3aa3fc34-d2d3-41fb-a826-aca38b334e4c req-7f1e63b3-ed5c-4acf-9cf5-478a728b3b2f service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:15.209114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-3aa3fc34-d2d3-41fb-a826-aca38b334e4c req-7f1e63b3-ed5c-4acf-9cf5-478a728b3b2f service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:15.232936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-3aa3fc34-d2d3-41fb-a826-aca38b334e4c req-7f1e63b3-ed5c-4acf-9cf5-478a728b3b2f service nova] Creating event network-vif-unplugged:ce819b69-03c1-4584-9ef2-0228b13d3351 for instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df on hv-cinder-84753 Aug 01 15:37:15.241724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-3aa3fc34-d2d3-41fb-a826-aca38b334e4c req-7f1e63b3-ed5c-4acf-9cf5-478a728b3b2f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070224 Aug 01 15:37:15.242750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 219/445] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:15.250033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c53799c5-b89e-4706-87d1-3a03a3bd1028 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:15.251146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c53799c5-b89e-4706-87d1-3a03a3bd1028 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:15.258026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c53799c5-b89e-4706-87d1-3a03a3bd1028 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:15.258482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c53799c5-b89e-4706-87d1-3a03a3bd1028 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:15.259380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c53799c5-b89e-4706-87d1-3a03a3bd1028 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:15.259686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c53799c5-b89e-4706-87d1-3a03a3bd1028 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:15.387542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6b90f7dc-bd1d-49ba-8311-2f70dce94161 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:15.414003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6b90f7dc-bd1d-49ba-8311-2f70dce94161 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.667719 Aug 01 15:37:15.416325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 227/446] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:14 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:15.454930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3cec5d7d-3d00-49fb-9283-5fc3223b2644 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:15.457493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3cec5d7d-3d00-49fb-9283-5fc3223b2644 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:15.486270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3cec5d7d-3d00-49fb-9283-5fc3223b2644 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:15.486882 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3cec5d7d-3d00-49fb-9283-5fc3223b2644 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:15.487779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3cec5d7d-3d00-49fb-9283-5fc3223b2644 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:15.489113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3cec5d7d-3d00-49fb-9283-5fc3223b2644 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:16.151630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c53799c5-b89e-4706-87d1-3a03a3bd1028 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:16.160479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c53799c5-b89e-4706-87d1-3a03a3bd1028 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.916328 Aug 01 15:37:16.166579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 220/447] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:15 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:16.172171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c2e390d6-f1af-40c4-99a9-608fcf4ecf29 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:16.178663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c2e390d6-f1af-40c4-99a9-608fcf4ecf29 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:16.189577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c2e390d6-f1af-40c4-99a9-608fcf4ecf29 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:16.190391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c2e390d6-f1af-40c4-99a9-608fcf4ecf29 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:16.191400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c2e390d6-f1af-40c4-99a9-608fcf4ecf29 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:16.192651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c2e390d6-f1af-40c4-99a9-608fcf4ecf29 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:16.237765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3cec5d7d-3d00-49fb-9283-5fc3223b2644 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:16.247152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3cec5d7d-3d00-49fb-9283-5fc3223b2644 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:16.252619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3cec5d7d-3d00-49fb-9283-5fc3223b2644 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:16.259243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3cec5d7d-3d00-49fb-9283-5fc3223b2644 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1722 microversion: 2.20 time: 0.816045 Aug 01 15:37:16.259836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 228/448] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1722 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:16.327636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c2e390d6-f1af-40c4-99a9-608fcf4ecf29 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:16.343058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c2e390d6-f1af-40c4-99a9-608fcf4ecf29 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1276 microversion: 2.1 time: 0.174777 Aug 01 15:37:16.343643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 221/449] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:16 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:16.449693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0ed7aed4-a878-40e4-9c54-75875fc0d7cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:16.450344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0ed7aed4-a878-40e4-9c54-75875fc0d7cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:16.467036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ed7aed4-a878-40e4-9c54-75875fc0d7cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:16.467823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ed7aed4-a878-40e4-9c54-75875fc0d7cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:16.468844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ed7aed4-a878-40e4-9c54-75875fc0d7cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:16.469490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ed7aed4-a878-40e4-9c54-75875fc0d7cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:16.944304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0ed7aed4-a878-40e4-9c54-75875fc0d7cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:16.957256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0ed7aed4-a878-40e4-9c54-75875fc0d7cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.512228 Aug 01 15:37:16.985210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 229/450] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:16 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:17.150898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-70136d23-7c98-4a4a-9f20-424ce4296ebc req-38e7db1a-355d-48cb-a629-af2c8c1ef994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f0755f-45c5-4c98-96b7-9c4b6415d331", "tag": "6c507929-7001-4435-a0b5-2d19c503a391"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:17.162575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-70136d23-7c98-4a4a-9f20-424ce4296ebc req-38e7db1a-355d-48cb-a629-af2c8c1ef994 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:17.163926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-70136d23-7c98-4a4a-9f20-424ce4296ebc req-38e7db1a-355d-48cb-a629-af2c8c1ef994 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:17.177758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-70136d23-7c98-4a4a-9f20-424ce4296ebc req-38e7db1a-355d-48cb-a629-af2c8c1ef994 service nova] Creating event network-changed:6c507929-7001-4435-a0b5-2d19c503a391 for instance 58f0755f-45c5-4c98-96b7-9c4b6415d331 on hv-cinder-84753 Aug 01 15:37:17.185937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-70136d23-7c98-4a4a-9f20-424ce4296ebc req-38e7db1a-355d-48cb-a629-af2c8c1ef994 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038823 Aug 01 15:37:17.187292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 222/451] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:17.193495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5a3d2300-2884-41ae-8983-44dc35ce31b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:17.194450 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5a3d2300-2884-41ae-8983-44dc35ce31b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:17.208694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a3d2300-2884-41ae-8983-44dc35ce31b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:17.209783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a3d2300-2884-41ae-8983-44dc35ce31b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:17.211567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a3d2300-2884-41ae-8983-44dc35ce31b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:17.212043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a3d2300-2884-41ae-8983-44dc35ce31b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:17.296050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c3f5201f-71c6-41da-a63e-5744b9c4745d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:17.297191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c3f5201f-71c6-41da-a63e-5744b9c4745d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:17.324027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3f5201f-71c6-41da-a63e-5744b9c4745d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:17.324933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3f5201f-71c6-41da-a63e-5744b9c4745d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:17.325728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3f5201f-71c6-41da-a63e-5744b9c4745d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:17.326187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3f5201f-71c6-41da-a63e-5744b9c4745d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:17.460372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5a3d2300-2884-41ae-8983-44dc35ce31b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:17.469775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5a3d2300-2884-41ae-8983-44dc35ce31b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.283482 Aug 01 15:37:17.470735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 230/452] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:17 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:17.475963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0bf3f130-e15a-4693-9f20-af534c597b32 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:17.476796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0bf3f130-e15a-4693-9f20-af534c597b32 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:17.483967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0bf3f130-e15a-4693-9f20-af534c597b32 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:17.484648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0bf3f130-e15a-4693-9f20-af534c597b32 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:17.485741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0bf3f130-e15a-4693-9f20-af534c597b32 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:17.486365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0bf3f130-e15a-4693-9f20-af534c597b32 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:17.506872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:17.515517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c3f5201f-71c6-41da-a63e-5744b9c4745d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:17.525207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c3f5201f-71c6-41da-a63e-5744b9c4745d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:17.527553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c3f5201f-71c6-41da-a63e-5744b9c4745d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:17.529011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c3f5201f-71c6-41da-a63e-5744b9c4745d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1722 microversion: 2.20 time: 0.246298 Aug 01 15:37:17.529596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 223/453] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:37:17.555845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0bf3f130-e15a-4693-9f20-af534c597b32 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:17.563986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0bf3f130-e15a-4693-9f20-af534c597b32 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1276 microversion: 2.1 time: 0.092029 Aug 01 15:37:17.564556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 231/454] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:17 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:17.661631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a9c33e2a-4377-4f7c-966d-8c6ece906728 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Action: 'create', calling method: .version_select at 0x7feb169ca3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1779330007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE1ZYwDdmi2Ljp9/fiGEN4vVHP0oufWToE0s5e0wtEzOmsUj8K3ywS4Kl1og2FnrGtt8u7yz37wpG5+lp+gfZ2e2OrThMTnUKF2QOHqgG3FhVVDn7E/VhsaNOI3xNwchQ=="}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:17.680758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-a9c33e2a-4377-4f7c-966d-8c6ece906728 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Getting quotas for project 3762799522514a268a4c8b8069baa882. Resources: {'key_pairs'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:37:17.685243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-a9c33e2a-4377-4f7c-966d-8c6ece906728 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Getting quotas for user a26637889378427eb884eed624606fd5 and project 3762799522514a268a4c8b8069baa882. Resources: {'key_pairs'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:37:17.709987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a9c33e2a-4377-4f7c-966d-8c6ece906728 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052356 Aug 01 15:37:17.710610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 224/455] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 1 15:37:17 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:17.762214 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1815691153", "imageRef": "4b31868a-84c8-4aa6-a576-04428ef1e7b5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1779330007", "networks": [{"uuid": "4f510870-c278-475b-b8e6-76dfc149103a"}]}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:17.819693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.network.neutron [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] validate_networks() for [('4f510870-c278-475b-b8e6-76dfc149103a', None, None, None, None, None)] {{(pid=124527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:37:17.988639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-69d71f0d-31c7-4d0f-897e-cc8dee818cf7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:17.990062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-69d71f0d-31c7-4d0f-897e-cc8dee818cf7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:17.998283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-69d71f0d-31c7-4d0f-897e-cc8dee818cf7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:17.999002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-69d71f0d-31c7-4d0f-897e-cc8dee818cf7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:18.000412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-69d71f0d-31c7-4d0f-897e-cc8dee818cf7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:18.001118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-69d71f0d-31c7-4d0f-897e-cc8dee818cf7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:18.320674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-69d71f0d-31c7-4d0f-897e-cc8dee818cf7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:18.323896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:18.331163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-69d71f0d-31c7-4d0f-897e-cc8dee818cf7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.346343 Aug 01 15:37:18.338180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 225/456] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:17 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:18.442636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Flavor limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:37:18.443067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Image limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:37:18.443548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Flavor pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:37:18.444022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Image pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:37:18.444437 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:37:18.454187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:18.454638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:18.455645 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:18.456083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:18.473766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Getting quotas for project 3762799522514a268a4c8b8069baa882. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:37:18.478103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Getting quotas for user a26637889378427eb884eed624606fd5 and project 3762799522514a268a4c8b8069baa882. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:37:18.491145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Going to run 1 instances... {{(pid=124527) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:37:18.493469 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b31868a-84c8-4aa6-a576-04428ef1e7b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:37:18.494840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6b9ad115-c5da-4b52-936c-aee4ee1e437a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:18.496302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6b9ad115-c5da-4b52-936c-aee4ee1e437a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:18.504060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b9ad115-c5da-4b52-936c-aee4ee1e437a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:18.506301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b9ad115-c5da-4b52-936c-aee4ee1e437a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:18.507567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b9ad115-c5da-4b52-936c-aee4ee1e437a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:18.508250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b9ad115-c5da-4b52-936c-aee4ee1e437a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:18.574608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c8c73f0f-0aed-4d5f-a9c9-e1a58b464d21 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816090 Aug 01 15:37:18.575453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 232/457] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:37:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:37:18.585099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bb03d4ec-7580-4b5d-9fc8-c98d3d995b88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:18.586135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bb03d4ec-7580-4b5d-9fc8-c98d3d995b88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:18.595301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bb03d4ec-7580-4b5d-9fc8-c98d3d995b88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:18.596037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bb03d4ec-7580-4b5d-9fc8-c98d3d995b88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:18.596988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bb03d4ec-7580-4b5d-9fc8-c98d3d995b88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:18.597584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bb03d4ec-7580-4b5d-9fc8-c98d3d995b88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:19.334877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bb03d4ec-7580-4b5d-9fc8-c98d3d995b88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:19.349694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bb03d4ec-7580-4b5d-9fc8-c98d3d995b88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:19.356177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bb03d4ec-7580-4b5d-9fc8-c98d3d995b88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:19.357956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bb03d4ec-7580-4b5d-9fc8-c98d3d995b88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1665 microversion: 2.20 time: 0.781001 Aug 01 15:37:19.359139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 233/458] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1665 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:19.387947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6b9ad115-c5da-4b52-936c-aee4ee1e437a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:19.396523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-348c4a98-b2b4-4683-8910-a0e804678f2f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:19.397772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-348c4a98-b2b4-4683-8910-a0e804678f2f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:19.399774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6b9ad115-c5da-4b52-936c-aee4ee1e437a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.910287 Aug 01 15:37:19.401403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 226/459] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:18 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:19.410727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-348c4a98-b2b4-4683-8910-a0e804678f2f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:19.411173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-348c4a98-b2b4-4683-8910-a0e804678f2f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:19.411938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-348c4a98-b2b4-4683-8910-a0e804678f2f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:19.412674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-348c4a98-b2b4-4683-8910-a0e804678f2f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:19.429569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8cf21a22-2382-4e16-b299-3cf7328e12ef tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:19.430516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8cf21a22-2382-4e16-b299-3cf7328e12ef tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:19.441201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8cf21a22-2382-4e16-b299-3cf7328e12ef tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:19.441849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8cf21a22-2382-4e16-b299-3cf7328e12ef tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:19.442874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8cf21a22-2382-4e16-b299-3cf7328e12ef tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:19.443702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8cf21a22-2382-4e16-b299-3cf7328e12ef tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:19.552853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8cf21a22-2382-4e16-b299-3cf7328e12ef tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:19.562066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8cf21a22-2382-4e16-b299-3cf7328e12ef tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1311 microversion: 2.1 time: 0.158569 Aug 01 15:37:19.562651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 227/460] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:19 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1311 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:19.568010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-08708367-bdf2-4bc7-8f5d-24aedf190c7c req-85509730-1457-4c8b-8a36-dd07d3ec9fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "462946dd-1a7a-43ec-8d8f-ca88a2b90b13", "tag": "f498a708-36e0-44d2-bc24-58d436d77bf2"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:19.578391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-08708367-bdf2-4bc7-8f5d-24aedf190c7c req-85509730-1457-4c8b-8a36-dd07d3ec9fd6 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:19.578849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-08708367-bdf2-4bc7-8f5d-24aedf190c7c req-85509730-1457-4c8b-8a36-dd07d3ec9fd6 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:19.592315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-08708367-bdf2-4bc7-8f5d-24aedf190c7c req-85509730-1457-4c8b-8a36-dd07d3ec9fd6 service nova] Creating event network-changed:f498a708-36e0-44d2-bc24-58d436d77bf2 for instance 462946dd-1a7a-43ec-8d8f-ca88a2b90b13 on hv-cinder-84753 Aug 01 15:37:19.597165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-08708367-bdf2-4bc7-8f5d-24aedf190c7c req-85509730-1457-4c8b-8a36-dd07d3ec9fd6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033235 Aug 01 15:37:19.597997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 228/461] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:19.603066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-05819b1f-04e6-4857-a4ae-526eda07281b req-647f89ae-ec30-4ed9-a663-a52893acdd17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93144385-4cac-4970-9814-564a351af373", "tag": "70bc4d81-f8a1-4ace-a990-9c94674bb907"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:19.608514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:19.622702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-348c4a98-b2b4-4683-8910-a0e804678f2f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:19.633040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-348c4a98-b2b4-4683-8910-a0e804678f2f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.272289 Aug 01 15:37:19.634012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 234/462] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:19 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:19.637125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-05819b1f-04e6-4857-a4ae-526eda07281b req-647f89ae-ec30-4ed9-a663-a52893acdd17 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:19.637914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-05819b1f-04e6-4857-a4ae-526eda07281b req-647f89ae-ec30-4ed9-a663-a52893acdd17 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:19.657231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-05819b1f-04e6-4857-a4ae-526eda07281b req-647f89ae-ec30-4ed9-a663-a52893acdd17 service nova] Creating event network-changed:70bc4d81-f8a1-4ace-a990-9c94674bb907 for instance 93144385-4cac-4970-9814-564a351af373 on hv-cinder-84753 Aug 01 15:37:19.658950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1e264e81-28cf-4c44-b651-2ba07bc5c8f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:19.660258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1e264e81-28cf-4c44-b651-2ba07bc5c8f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:19.667861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-05819b1f-04e6-4857-a4ae-526eda07281b req-647f89ae-ec30-4ed9-a663-a52893acdd17 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067824 Aug 01 15:37:19.668614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 229/463] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:19.671689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e264e81-28cf-4c44-b651-2ba07bc5c8f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:19.672430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e264e81-28cf-4c44-b651-2ba07bc5c8f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:19.673559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e264e81-28cf-4c44-b651-2ba07bc5c8f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:19.674213 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e264e81-28cf-4c44-b651-2ba07bc5c8f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:19.675583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1fcee2cf-1702-466e-bd6e-6f4e2dad25e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9d194cf-178b-4b66-8943-721e91fa2995"}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:19.678460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1fcee2cf-1702-466e-bd6e-6f4e2dad25e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:19.686306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fcee2cf-1702-466e-bd6e-6f4e2dad25e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:19.686766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fcee2cf-1702-466e-bd6e-6f4e2dad25e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:19.687553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fcee2cf-1702-466e-bd6e-6f4e2dad25e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:19.688021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fcee2cf-1702-466e-bd6e-6f4e2dad25e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:20.005918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1e264e81-28cf-4c44-b651-2ba07bc5c8f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:20.019194 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1e264e81-28cf-4c44-b651-2ba07bc5c8f4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.382588 Aug 01 15:37:20.034357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 235/464] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:19 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:20.107297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1fcee2cf-1702-466e-bd6e-6f4e2dad25e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "POST /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.436153 Aug 01 15:37:20.108566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 230/465] 10.222.0.83 () {62 vars in 1364 bytes} [Mon Aug 1 15:37:19 2022] POST /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 188 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:37:20.282728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-33b97c91-927f-4e40-a57d-8b0783b32c54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:20.283341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-33b97c91-927f-4e40-a57d-8b0783b32c54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:20.291415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-33b97c91-927f-4e40-a57d-8b0783b32c54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:20.292182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-33b97c91-927f-4e40-a57d-8b0783b32c54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:20.293945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-33b97c91-927f-4e40-a57d-8b0783b32c54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:20.293945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-33b97c91-927f-4e40-a57d-8b0783b32c54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:20.352550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-33b97c91-927f-4e40-a57d-8b0783b32c54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124527) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 15:37:20.431230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8b45f10e-586c-4d3f-b9cc-d0b57dc1a94f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:20.432027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8b45f10e-586c-4d3f-b9cc-d0b57dc1a94f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:20.446852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b45f10e-586c-4d3f-b9cc-d0b57dc1a94f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:20.447308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b45f10e-586c-4d3f-b9cc-d0b57dc1a94f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:20.449841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b45f10e-586c-4d3f-b9cc-d0b57dc1a94f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:20.450744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b45f10e-586c-4d3f-b9cc-d0b57dc1a94f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:20.508734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-33b97c91-927f-4e40-a57d-8b0783b32c54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "POST /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/action" status: 202 len: 0 microversion: 2.20 time: 0.229531 Aug 01 15:37:20.515657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 236/466] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 1 15:37:20 2022] POST /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:37:20.525295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-911f1a7c-18a3-4b14-bbad-f9198e8c8e71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:20.526823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-911f1a7c-18a3-4b14-bbad-f9198e8c8e71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:20.540370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-911f1a7c-18a3-4b14-bbad-f9198e8c8e71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:20.541305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-911f1a7c-18a3-4b14-bbad-f9198e8c8e71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:20.544147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-911f1a7c-18a3-4b14-bbad-f9198e8c8e71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:20.545324 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-911f1a7c-18a3-4b14-bbad-f9198e8c8e71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:20.694342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8b45f10e-586c-4d3f-b9cc-d0b57dc1a94f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:20.702778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8b45f10e-586c-4d3f-b9cc-d0b57dc1a94f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.277662 Aug 01 15:37:20.703664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 231/467] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:20 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:20.738584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-04d6a8f3-1d99-45f8-bf80-bb4207f6b0df tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:20.739378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-04d6a8f3-1d99-45f8-bf80-bb4207f6b0df tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:20.749281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-04d6a8f3-1d99-45f8-bf80-bb4207f6b0df tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:20.749281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-04d6a8f3-1d99-45f8-bf80-bb4207f6b0df tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:20.750544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-04d6a8f3-1d99-45f8-bf80-bb4207f6b0df tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:20.751117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-04d6a8f3-1d99-45f8-bf80-bb4207f6b0df tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:20.831904 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-911f1a7c-18a3-4b14-bbad-f9198e8c8e71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:20.845858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-911f1a7c-18a3-4b14-bbad-f9198e8c8e71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:20.847830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-911f1a7c-18a3-4b14-bbad-f9198e8c8e71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:20.849767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-911f1a7c-18a3-4b14-bbad-f9198e8c8e71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1751 microversion: 2.20 time: 0.332098 Aug 01 15:37:20.850507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 237/468] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1751 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:20.857150 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7791e70f-695b-49ea-9a1e-be7bf7549887 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:20.858064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7791e70f-695b-49ea-9a1e-be7bf7549887 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:20.859770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-04d6a8f3-1d99-45f8-bf80-bb4207f6b0df tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:20.867630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7791e70f-695b-49ea-9a1e-be7bf7549887 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:20.868306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7791e70f-695b-49ea-9a1e-be7bf7549887 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:20.869542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7791e70f-695b-49ea-9a1e-be7bf7549887 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:20.870283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7791e70f-695b-49ea-9a1e-be7bf7549887 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:20.875921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-04d6a8f3-1d99-45f8-bf80-bb4207f6b0df tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1329 microversion: 2.1 time: 0.156474 Aug 01 15:37:20.876840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 232/469] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:20 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1329 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:21.044044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bbe632d8-783d-4d74-b14f-2e322e08525c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:21.044832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bbe632d8-783d-4d74-b14f-2e322e08525c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:21.050113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7791e70f-695b-49ea-9a1e-be7bf7549887 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:21.053209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bbe632d8-783d-4d74-b14f-2e322e08525c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:21.053666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bbe632d8-783d-4d74-b14f-2e322e08525c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:21.054536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bbe632d8-783d-4d74-b14f-2e322e08525c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:21.054971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bbe632d8-783d-4d74-b14f-2e322e08525c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:21.066823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7791e70f-695b-49ea-9a1e-be7bf7549887 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.214410 Aug 01 15:37:21.069056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 238/470] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:20 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:21.302230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bbe632d8-783d-4d74-b14f-2e322e08525c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:21.327462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bbe632d8-783d-4d74-b14f-2e322e08525c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.288138 Aug 01 15:37:21.328452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 233/471] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:21 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:21.724871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-190c1489-5c85-4c32-959f-b7f1014166aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:21.725851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-190c1489-5c85-4c32-959f-b7f1014166aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:21.734553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-190c1489-5c85-4c32-959f-b7f1014166aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:21.735155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-190c1489-5c85-4c32-959f-b7f1014166aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:21.736045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-190c1489-5c85-4c32-959f-b7f1014166aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:21.736547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-190c1489-5c85-4c32-959f-b7f1014166aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:21.891033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-42030dcc-9d8c-46ea-860f-9666cab1d36f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:21.893292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-42030dcc-9d8c-46ea-860f-9666cab1d36f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:21.906584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42030dcc-9d8c-46ea-860f-9666cab1d36f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:21.907064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42030dcc-9d8c-46ea-860f-9666cab1d36f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:21.908501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42030dcc-9d8c-46ea-860f-9666cab1d36f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:21.909374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42030dcc-9d8c-46ea-860f-9666cab1d36f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:21.944071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-190c1489-5c85-4c32-959f-b7f1014166aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:21.958230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-190c1489-5c85-4c32-959f-b7f1014166aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.237230 Aug 01 15:37:21.959274 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 239/472] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:21 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:21.966349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1afa3883-e263-48ab-a2ec-09c2b2fb567d tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:21.967349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1afa3883-e263-48ab-a2ec-09c2b2fb567d tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:21.975128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1afa3883-e263-48ab-a2ec-09c2b2fb567d tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:21.975829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1afa3883-e263-48ab-a2ec-09c2b2fb567d tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:21.977956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1afa3883-e263-48ab-a2ec-09c2b2fb567d tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:21.979111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1afa3883-e263-48ab-a2ec-09c2b2fb567d tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:22.169667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-42030dcc-9d8c-46ea-860f-9666cab1d36f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:22.179760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-42030dcc-9d8c-46ea-860f-9666cab1d36f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:22.181316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-42030dcc-9d8c-46ea-860f-9666cab1d36f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:22.182624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-42030dcc-9d8c-46ea-860f-9666cab1d36f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1751 microversion: 2.20 time: 0.296666 Aug 01 15:37:22.190705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 234/473] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1751 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:22.210221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-94375254-fc86-4b60-9d34-7bf7ebf6b303 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:22.210852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-94375254-fc86-4b60-9d34-7bf7ebf6b303 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:22.221141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-94375254-fc86-4b60-9d34-7bf7ebf6b303 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:22.221845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-94375254-fc86-4b60-9d34-7bf7ebf6b303 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:22.222907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-94375254-fc86-4b60-9d34-7bf7ebf6b303 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:22.223503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-94375254-fc86-4b60-9d34-7bf7ebf6b303 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:22.262399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1afa3883-e263-48ab-a2ec-09c2b2fb567d tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:22.274744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1afa3883-e263-48ab-a2ec-09c2b2fb567d tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.313778 Aug 01 15:37:22.275743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 240/474] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:21 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:22.353308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4080cf32-1e05-46b3-a25a-8c5061216c98 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:22.355563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4080cf32-1e05-46b3-a25a-8c5061216c98 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:22.364989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4080cf32-1e05-46b3-a25a-8c5061216c98 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:22.365973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4080cf32-1e05-46b3-a25a-8c5061216c98 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:22.367149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4080cf32-1e05-46b3-a25a-8c5061216c98 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:22.368559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4080cf32-1e05-46b3-a25a-8c5061216c98 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:22.399608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-94375254-fc86-4b60-9d34-7bf7ebf6b303 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:22.413797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-94375254-fc86-4b60-9d34-7bf7ebf6b303 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.221523 Aug 01 15:37:22.414858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 235/475] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:22 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:22.545255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4080cf32-1e05-46b3-a25a-8c5061216c98 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:22.554111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4080cf32-1e05-46b3-a25a-8c5061216c98 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.206314 Aug 01 15:37:22.554694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 241/476] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:22 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:23.002747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-953224ed-d61d-46a3-9c1f-38ae53d616f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:23.004431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-953224ed-d61d-46a3-9c1f-38ae53d616f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:23.020097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-953224ed-d61d-46a3-9c1f-38ae53d616f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:23.021740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-953224ed-d61d-46a3-9c1f-38ae53d616f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:23.023249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-953224ed-d61d-46a3-9c1f-38ae53d616f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:23.026672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-953224ed-d61d-46a3-9c1f-38ae53d616f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:23.216298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-eb06f603-e49e-44a2-8abf-f7bd46f91557 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:23.216924 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-eb06f603-e49e-44a2-8abf-f7bd46f91557 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:23.229356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:23.238354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eb06f603-e49e-44a2-8abf-f7bd46f91557 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:23.238856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eb06f603-e49e-44a2-8abf-f7bd46f91557 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:23.239694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eb06f603-e49e-44a2-8abf-f7bd46f91557 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:23.240138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eb06f603-e49e-44a2-8abf-f7bd46f91557 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:23.274765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-953224ed-d61d-46a3-9c1f-38ae53d616f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:23.283637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-953224ed-d61d-46a3-9c1f-38ae53d616f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.293636 Aug 01 15:37:23.284966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 236/477] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:22 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:23.311592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1976c762-05a5-47d9-8729-248ef31587e0 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:23.312908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1976c762-05a5-47d9-8729-248ef31587e0 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:23.324638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1976c762-05a5-47d9-8729-248ef31587e0 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:23.325430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1976c762-05a5-47d9-8729-248ef31587e0 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:23.326458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1976c762-05a5-47d9-8729-248ef31587e0 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:23.327081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1976c762-05a5-47d9-8729-248ef31587e0 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:23.698261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1976c762-05a5-47d9-8729-248ef31587e0 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:23.712349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1976c762-05a5-47d9-8729-248ef31587e0 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.406758 Aug 01 15:37:23.717987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 237/478] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:23 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:23.723492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-19250760-5006-43d3-b9d5-7f2e88fdd323 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:23.729383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-19250760-5006-43d3-b9d5-7f2e88fdd323 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:23.751409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19250760-5006-43d3-b9d5-7f2e88fdd323 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:23.758261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-eb06f603-e49e-44a2-8abf-f7bd46f91557 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:23.762808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19250760-5006-43d3-b9d5-7f2e88fdd323 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:23.768443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-eb06f603-e49e-44a2-8abf-f7bd46f91557 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:23.770028 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19250760-5006-43d3-b9d5-7f2e88fdd323 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:23.771447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19250760-5006-43d3-b9d5-7f2e88fdd323 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:23.780366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-eb06f603-e49e-44a2-8abf-f7bd46f91557 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:23.782221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-eb06f603-e49e-44a2-8abf-f7bd46f91557 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1753 microversion: 2.20 time: 0.570022 Aug 01 15:37:23.784039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 242/479] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1753 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:37:23.801877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-67bfa992-5d39-4067-8cb5-73bc96d0adf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:23.802902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-67bfa992-5d39-4067-8cb5-73bc96d0adf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:23.814543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67bfa992-5d39-4067-8cb5-73bc96d0adf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:23.818878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67bfa992-5d39-4067-8cb5-73bc96d0adf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:23.820087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67bfa992-5d39-4067-8cb5-73bc96d0adf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:23.820807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67bfa992-5d39-4067-8cb5-73bc96d0adf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:24.119003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-19250760-5006-43d3-b9d5-7f2e88fdd323 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:24.128350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-67bfa992-5d39-4067-8cb5-73bc96d0adf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:24.138308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-19250760-5006-43d3-b9d5-7f2e88fdd323 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.410428 Aug 01 15:37:24.139287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 238/480] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:23 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:24.142448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-67bfa992-5d39-4067-8cb5-73bc96d0adf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.352682 Aug 01 15:37:24.155794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 243/481] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:23 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:24.159065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-9d17ee04-1e75-4440-ae97-c678e68d99be req-af6369a0-eb0f-4443-bb3a-c7b41b070f96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7", "tag": "363ae4d1-ef88-47d5-a3fb-e1b35283078c"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:24.169454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-9d17ee04-1e75-4440-ae97-c678e68d99be req-af6369a0-eb0f-4443-bb3a-c7b41b070f96 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:24.170004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-9d17ee04-1e75-4440-ae97-c678e68d99be req-af6369a0-eb0f-4443-bb3a-c7b41b070f96 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:24.181760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-9d17ee04-1e75-4440-ae97-c678e68d99be req-af6369a0-eb0f-4443-bb3a-c7b41b070f96 service nova] Creating event network-changed:363ae4d1-ef88-47d5-a3fb-e1b35283078c for instance f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 on hv-cinder-84753 Aug 01 15:37:24.187586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-9d17ee04-1e75-4440-ae97-c678e68d99be req-af6369a0-eb0f-4443-bb3a-c7b41b070f96 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046815 Aug 01 15:37:24.188487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 239/482] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:24.320902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-750db3ad-17c8-4e63-8f83-5c23f791e96a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:24.321436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-750db3ad-17c8-4e63-8f83-5c23f791e96a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:24.328968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-750db3ad-17c8-4e63-8f83-5c23f791e96a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:24.329376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-750db3ad-17c8-4e63-8f83-5c23f791e96a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:24.330171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-750db3ad-17c8-4e63-8f83-5c23f791e96a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:24.330608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-750db3ad-17c8-4e63-8f83-5c23f791e96a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:24.509631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-750db3ad-17c8-4e63-8f83-5c23f791e96a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:24.518345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-750db3ad-17c8-4e63-8f83-5c23f791e96a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.201233 Aug 01 15:37:24.518918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 244/483] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:24 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:24.752505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0b9d7e99-8dfa-4d8c-8a2e-14b3b6a6643b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:24.753363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0b9d7e99-8dfa-4d8c-8a2e-14b3b6a6643b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:24.761614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b9d7e99-8dfa-4d8c-8a2e-14b3b6a6643b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:24.765162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b9d7e99-8dfa-4d8c-8a2e-14b3b6a6643b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:24.766394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b9d7e99-8dfa-4d8c-8a2e-14b3b6a6643b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:24.766848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b9d7e99-8dfa-4d8c-8a2e-14b3b6a6643b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:24.807821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-74fd531c-2550-465c-91c0-3f960a0769d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:24.808574 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-74fd531c-2550-465c-91c0-3f960a0769d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:24.832060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-74fd531c-2550-465c-91c0-3f960a0769d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:24.832701 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-74fd531c-2550-465c-91c0-3f960a0769d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:24.843202 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-74fd531c-2550-465c-91c0-3f960a0769d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:24.843796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-74fd531c-2550-465c-91c0-3f960a0769d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:25.055091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0b9d7e99-8dfa-4d8c-8a2e-14b3b6a6643b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:25.063049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0b9d7e99-8dfa-4d8c-8a2e-14b3b6a6643b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.317038 Aug 01 15:37:25.066234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 240/484] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:24 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:25.103499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-74fd531c-2550-465c-91c0-3f960a0769d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:25.127700 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-74fd531c-2550-465c-91c0-3f960a0769d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:25.137475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-74fd531c-2550-465c-91c0-3f960a0769d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:25.140295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-74fd531c-2550-465c-91c0-3f960a0769d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1753 microversion: 2.20 time: 0.335587 Aug 01 15:37:25.142032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 245/485] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1753 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:25.172071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f4bb5b20-e1ff-4551-b920-682e933a4708 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:25.173429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f4bb5b20-e1ff-4551-b920-682e933a4708 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:25.181121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4bb5b20-e1ff-4551-b920-682e933a4708 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:25.181859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4bb5b20-e1ff-4551-b920-682e933a4708 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:25.182851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4bb5b20-e1ff-4551-b920-682e933a4708 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:25.183956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4bb5b20-e1ff-4551-b920-682e933a4708 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:25.219639 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a7015f28-0723-48b8-ade1-7f0724f154df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:25.220933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a7015f28-0723-48b8-ade1-7f0724f154df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:25.255638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7015f28-0723-48b8-ade1-7f0724f154df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:25.256410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7015f28-0723-48b8-ade1-7f0724f154df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:25.257725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7015f28-0723-48b8-ade1-7f0724f154df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:25.258482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7015f28-0723-48b8-ade1-7f0724f154df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:25.504339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f4bb5b20-e1ff-4551-b920-682e933a4708 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:25.507431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:25.525088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f4bb5b20-e1ff-4551-b920-682e933a4708 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.357395 Aug 01 15:37:25.528453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 241/486] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:25 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:25.534457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-1cb2f766-53e5-4be8-959c-32ed9a1534d3 req-d0471984-2a0c-4ac7-bd54-76127732ed9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "462946dd-1a7a-43ec-8d8f-ca88a2b90b13", "name": "network-vif-plugged", "status": "completed", "tag": "f498a708-36e0-44d2-bc24-58d436d77bf2"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:25.548147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-1cb2f766-53e5-4be8-959c-32ed9a1534d3 req-d0471984-2a0c-4ac7-bd54-76127732ed9c service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:25.548687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-1cb2f766-53e5-4be8-959c-32ed9a1534d3 req-d0471984-2a0c-4ac7-bd54-76127732ed9c service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:25.567357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-1cb2f766-53e5-4be8-959c-32ed9a1534d3 req-d0471984-2a0c-4ac7-bd54-76127732ed9c service nova] Creating event network-vif-plugged:f498a708-36e0-44d2-bc24-58d436d77bf2 for instance 462946dd-1a7a-43ec-8d8f-ca88a2b90b13 on hv-cinder-84753 Aug 01 15:37:25.579990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-1cb2f766-53e5-4be8-959c-32ed9a1534d3 req-d0471984-2a0c-4ac7-bd54-76127732ed9c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050476 Aug 01 15:37:25.580794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 242/487] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:25.585823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8fbf5228-46e2-41fe-ab42-7a0ae01c1f46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:25.586575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8fbf5228-46e2-41fe-ab42-7a0ae01c1f46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:25.592735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a7015f28-0723-48b8-ade1-7f0724f154df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:25.608376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fbf5228-46e2-41fe-ab42-7a0ae01c1f46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:25.611288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fbf5228-46e2-41fe-ab42-7a0ae01c1f46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:25.613348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fbf5228-46e2-41fe-ab42-7a0ae01c1f46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:25.614927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fbf5228-46e2-41fe-ab42-7a0ae01c1f46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:25.624479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a7015f28-0723-48b8-ade1-7f0724f154df tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.436669 Aug 01 15:37:25.624889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 246/488] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:25 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:25.817857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8fbf5228-46e2-41fe-ab42-7a0ae01c1f46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:25.827296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8fbf5228-46e2-41fe-ab42-7a0ae01c1f46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.245505 Aug 01 15:37:25.830244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 243/489] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:25 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:26.114576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-977a9c87-1217-47a3-ac59-d7a847ed9f59 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:26.115103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-977a9c87-1217-47a3-ac59-d7a847ed9f59 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:26.122610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-977a9c87-1217-47a3-ac59-d7a847ed9f59 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:26.123072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-977a9c87-1217-47a3-ac59-d7a847ed9f59 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:26.123854 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-977a9c87-1217-47a3-ac59-d7a847ed9f59 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:26.124283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-977a9c87-1217-47a3-ac59-d7a847ed9f59 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:26.175199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b5116b2b-1f25-47e8-bc94-0f9ce73bad1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:26.176164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b5116b2b-1f25-47e8-bc94-0f9ce73bad1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:26.185053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5116b2b-1f25-47e8-bc94-0f9ce73bad1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:26.185531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5116b2b-1f25-47e8-bc94-0f9ce73bad1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:26.186480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5116b2b-1f25-47e8-bc94-0f9ce73bad1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:26.187365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5116b2b-1f25-47e8-bc94-0f9ce73bad1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:26.379147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-977a9c87-1217-47a3-ac59-d7a847ed9f59 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:26.393028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:26.425962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-977a9c87-1217-47a3-ac59-d7a847ed9f59 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.314897 Aug 01 15:37:26.428336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 247/490] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:26 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:26.441863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b5116b2b-1f25-47e8-bc94-0f9ce73bad1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:26.461086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b5116b2b-1f25-47e8-bc94-0f9ce73bad1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:26.463174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b5116b2b-1f25-47e8-bc94-0f9ce73bad1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:26.464073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b5116b2b-1f25-47e8-bc94-0f9ce73bad1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1753 microversion: 2.20 time: 0.293522 Aug 01 15:37:26.470019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 244/491] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1753 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:37:26.556060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-72fb895e-6fd7-4cd1-8030-e2cccb5d0b9a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:26.559463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-72fb895e-6fd7-4cd1-8030-e2cccb5d0b9a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:26.576541 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72fb895e-6fd7-4cd1-8030-e2cccb5d0b9a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:26.577201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72fb895e-6fd7-4cd1-8030-e2cccb5d0b9a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:26.578142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72fb895e-6fd7-4cd1-8030-e2cccb5d0b9a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:26.578660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72fb895e-6fd7-4cd1-8030-e2cccb5d0b9a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:26.654735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3e2bdb96-5aa9-4e46-acb6-e77845dcbf0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:26.655472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3e2bdb96-5aa9-4e46-acb6-e77845dcbf0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:26.673592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e2bdb96-5aa9-4e46-acb6-e77845dcbf0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:26.675117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e2bdb96-5aa9-4e46-acb6-e77845dcbf0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:26.676835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e2bdb96-5aa9-4e46-acb6-e77845dcbf0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:26.677345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e2bdb96-5aa9-4e46-acb6-e77845dcbf0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:26.784378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-72fb895e-6fd7-4cd1-8030-e2cccb5d0b9a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:26.794220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-72fb895e-6fd7-4cd1-8030-e2cccb5d0b9a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.243446 Aug 01 15:37:26.795212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 248/492] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:26 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:26.854527 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-39c17e8c-f365-4698-a77b-e2869d5cf1e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:26.855642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-39c17e8c-f365-4698-a77b-e2869d5cf1e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:26.862773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3e2bdb96-5aa9-4e46-acb6-e77845dcbf0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:26.875840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39c17e8c-f365-4698-a77b-e2869d5cf1e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:26.877987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3e2bdb96-5aa9-4e46-acb6-e77845dcbf0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.228671 Aug 01 15:37:26.878945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39c17e8c-f365-4698-a77b-e2869d5cf1e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:26.879862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 245/493] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:26 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:26.884639 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39c17e8c-f365-4698-a77b-e2869d5cf1e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:26.885485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39c17e8c-f365-4698-a77b-e2869d5cf1e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:27.058689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-39c17e8c-f365-4698-a77b-e2869d5cf1e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:27.072128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-39c17e8c-f365-4698-a77b-e2869d5cf1e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.225625 Aug 01 15:37:27.072750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 249/494] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:26 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:27.448810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6e04d3ae-e708-4735-bbef-d183f6b12438 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:27.449434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6e04d3ae-e708-4735-bbef-d183f6b12438 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:27.456513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e04d3ae-e708-4735-bbef-d183f6b12438 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:27.456962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e04d3ae-e708-4735-bbef-d183f6b12438 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:27.457755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e04d3ae-e708-4735-bbef-d183f6b12438 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:27.458489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e04d3ae-e708-4735-bbef-d183f6b12438 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:27.490738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-37c725d6-9025-4e61-a360-c009b9624cd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:27.492490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-37c725d6-9025-4e61-a360-c009b9624cd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:27.500365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37c725d6-9025-4e61-a360-c009b9624cd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:27.500815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37c725d6-9025-4e61-a360-c009b9624cd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:27.501595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37c725d6-9025-4e61-a360-c009b9624cd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:27.502116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37c725d6-9025-4e61-a360-c009b9624cd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:27.693568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=4 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:27.700503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6e04d3ae-e708-4735-bbef-d183f6b12438 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:27.704391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-37c725d6-9025-4e61-a360-c009b9624cd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:27.712584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6e04d3ae-e708-4735-bbef-d183f6b12438 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.267566 Aug 01 15:37:27.714089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 246/495] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:27 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:27.716934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-37c725d6-9025-4e61-a360-c009b9624cd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:27.719003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-37c725d6-9025-4e61-a360-c009b9624cd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:27.720727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-37c725d6-9025-4e61-a360-c009b9624cd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1753 microversion: 2.20 time: 0.236803 Aug 01 15:37:27.722112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 250/496] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1753 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:37:27.726127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-4785a9d2-bffd-4ff9-bd84-47236645f9fb req-19b48808-3c06-4bd9-8d63-093220588c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93144385-4cac-4970-9814-564a351af373", "name": "network-vif-plugged", "status": "completed", "tag": "70bc4d81-f8a1-4ace-a990-9c94674bb907"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:27.739603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-4785a9d2-bffd-4ff9-bd84-47236645f9fb req-19b48808-3c06-4bd9-8d63-093220588c46 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:27.740048 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-4785a9d2-bffd-4ff9-bd84-47236645f9fb req-19b48808-3c06-4bd9-8d63-093220588c46 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:27.753518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-4785a9d2-bffd-4ff9-bd84-47236645f9fb req-19b48808-3c06-4bd9-8d63-093220588c46 service nova] Creating event network-vif-plugged:70bc4d81-f8a1-4ace-a990-9c94674bb907 for instance 93144385-4cac-4970-9814-564a351af373 on hv-cinder-84753 Aug 01 15:37:27.760017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-4785a9d2-bffd-4ff9-bd84-47236645f9fb req-19b48808-3c06-4bd9-8d63-093220588c46 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043060 Aug 01 15:37:27.761046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 247/497] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:27.820205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fdde8383-5a45-46eb-9e1d-05d8e3d7b93d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:27.821195 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fdde8383-5a45-46eb-9e1d-05d8e3d7b93d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:27.828624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdde8383-5a45-46eb-9e1d-05d8e3d7b93d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:27.829087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdde8383-5a45-46eb-9e1d-05d8e3d7b93d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:27.829881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdde8383-5a45-46eb-9e1d-05d8e3d7b93d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:27.830349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdde8383-5a45-46eb-9e1d-05d8e3d7b93d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:27.903578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-db8907df-4415-4329-bcb8-15358ca6c571 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:27.904300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-db8907df-4415-4329-bcb8-15358ca6c571 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:27.913964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db8907df-4415-4329-bcb8-15358ca6c571 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:27.914509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db8907df-4415-4329-bcb8-15358ca6c571 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:27.915442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db8907df-4415-4329-bcb8-15358ca6c571 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:27.915883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db8907df-4415-4329-bcb8-15358ca6c571 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:28.063087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fdde8383-5a45-46eb-9e1d-05d8e3d7b93d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:28.076564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fdde8383-5a45-46eb-9e1d-05d8e3d7b93d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.264786 Aug 01 15:37:28.078090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 251/498] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:27 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:28.097230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-258c653e-8a0d-4984-8c72-72d8fafd803a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:28.097981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-258c653e-8a0d-4984-8c72-72d8fafd803a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:28.107828 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-258c653e-8a0d-4984-8c72-72d8fafd803a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:28.109030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-258c653e-8a0d-4984-8c72-72d8fafd803a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:28.110185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-258c653e-8a0d-4984-8c72-72d8fafd803a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:28.110632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-258c653e-8a0d-4984-8c72-72d8fafd803a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:28.136263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-db8907df-4415-4329-bcb8-15358ca6c571 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:28.146510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-db8907df-4415-4329-bcb8-15358ca6c571 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.248660 Aug 01 15:37:28.147139 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 248/499] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:27 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:28.273550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-258c653e-8a0d-4984-8c72-72d8fafd803a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:28.281624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-258c653e-8a0d-4984-8c72-72d8fafd803a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.188885 Aug 01 15:37:28.282279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 252/500] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:28 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:28.744173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2ce5538d-20ef-4788-8c93-39592c5af8a7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:28.745221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2ce5538d-20ef-4788-8c93-39592c5af8a7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:28.760778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ce5538d-20ef-4788-8c93-39592c5af8a7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:28.761422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ce5538d-20ef-4788-8c93-39592c5af8a7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:28.762894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ce5538d-20ef-4788-8c93-39592c5af8a7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:28.763317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ce5538d-20ef-4788-8c93-39592c5af8a7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:28.764938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-21f6f62a-2472-4135-86f6-275e81b761e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:28.765763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-21f6f62a-2472-4135-86f6-275e81b761e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:28.768743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=4 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:28.769513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=14 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:28.774806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21f6f62a-2472-4135-86f6-275e81b761e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:28.775253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21f6f62a-2472-4135-86f6-275e81b761e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:28.776028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21f6f62a-2472-4135-86f6-275e81b761e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:28.776464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21f6f62a-2472-4135-86f6-275e81b761e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:29.013818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2ce5538d-20ef-4788-8c93-39592c5af8a7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:29.022924 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-21f6f62a-2472-4135-86f6-275e81b761e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:29.026031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2ce5538d-20ef-4788-8c93-39592c5af8a7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.288973 Aug 01 15:37:29.027101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 249/501] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:28 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:29.033574 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-21f6f62a-2472-4135-86f6-275e81b761e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:29.035184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-21f6f62a-2472-4135-86f6-275e81b761e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:29.036468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-21f6f62a-2472-4135-86f6-275e81b761e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1753 microversion: 2.20 time: 0.279643 Aug 01 15:37:29.037124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 253/502] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1753 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:29.099793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9338f568-c88c-40ae-9456-623640ab1d74 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:29.100577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9338f568-c88c-40ae-9456-623640ab1d74 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:29.106974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9338f568-c88c-40ae-9456-623640ab1d74 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:29.107442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9338f568-c88c-40ae-9456-623640ab1d74 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:29.108200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9338f568-c88c-40ae-9456-623640ab1d74 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:29.108631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9338f568-c88c-40ae-9456-623640ab1d74 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:29.167977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ccac1ffb-b958-44b4-9953-186abcd81425 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:29.168592 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ccac1ffb-b958-44b4-9953-186abcd81425 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:29.175031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccac1ffb-b958-44b4-9953-186abcd81425 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:29.175482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccac1ffb-b958-44b4-9953-186abcd81425 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:29.176257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccac1ffb-b958-44b4-9953-186abcd81425 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:29.176699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccac1ffb-b958-44b4-9953-186abcd81425 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:29.313162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9338f568-c88c-40ae-9456-623640ab1d74 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:29.322663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9338f568-c88c-40ae-9456-623640ab1d74 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.227456 Aug 01 15:37:29.334559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 250/503] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:29 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:29.346180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1383919a-98b2-459c-bbb3-4c4aea85b00f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:29.347213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1383919a-98b2-459c-bbb3-4c4aea85b00f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:29.355960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1383919a-98b2-459c-bbb3-4c4aea85b00f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:29.356963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1383919a-98b2-459c-bbb3-4c4aea85b00f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:29.357836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1383919a-98b2-459c-bbb3-4c4aea85b00f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:29.358301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1383919a-98b2-459c-bbb3-4c4aea85b00f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:29.374508 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ccac1ffb-b958-44b4-9953-186abcd81425 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:29.382591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ccac1ffb-b958-44b4-9953-186abcd81425 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.218448 Aug 01 15:37:29.383589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 254/504] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:29 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:29.503460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1383919a-98b2-459c-bbb3-4c4aea85b00f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:29.511406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1383919a-98b2-459c-bbb3-4c4aea85b00f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.171962 Aug 01 15:37:29.512579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 251/505] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:29 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:30.049954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-aef835c2-aa27-48b6-a63a-451d457d18ea tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:30.051321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-aef835c2-aa27-48b6-a63a-451d457d18ea tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:30.064264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-816b4d79-aa0c-4a85-a87a-1cec951c9b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:30.067137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-816b4d79-aa0c-4a85-a87a-1cec951c9b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:30.075300 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aef835c2-aa27-48b6-a63a-451d457d18ea tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:30.076009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aef835c2-aa27-48b6-a63a-451d457d18ea tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:30.076981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-816b4d79-aa0c-4a85-a87a-1cec951c9b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:30.077142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aef835c2-aa27-48b6-a63a-451d457d18ea tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:30.077650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-816b4d79-aa0c-4a85-a87a-1cec951c9b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:30.078029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aef835c2-aa27-48b6-a63a-451d457d18ea tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:30.078738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-816b4d79-aa0c-4a85-a87a-1cec951c9b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:30.079314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-816b4d79-aa0c-4a85-a87a-1cec951c9b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:30.363827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-aef835c2-aa27-48b6-a63a-451d457d18ea tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:30.375205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-aef835c2-aa27-48b6-a63a-451d457d18ea tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.329473 Aug 01 15:37:30.376172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 255/506] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:30 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:30.380957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6023789e-3796-4433-9a4e-c3565d7c2649 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:30.381715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6023789e-3796-4433-9a4e-c3565d7c2649 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:30.384233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-816b4d79-aa0c-4a85-a87a-1cec951c9b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:30.391190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6023789e-3796-4433-9a4e-c3565d7c2649 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:30.391642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6023789e-3796-4433-9a4e-c3565d7c2649 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:30.392431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6023789e-3796-4433-9a4e-c3565d7c2649 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:30.392867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6023789e-3796-4433-9a4e-c3565d7c2649 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:30.405711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-816b4d79-aa0c-4a85-a87a-1cec951c9b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:30.407691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-816b4d79-aa0c-4a85-a87a-1cec951c9b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:30.409163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-816b4d79-aa0c-4a85-a87a-1cec951c9b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1753 microversion: 2.20 time: 0.352617 Aug 01 15:37:30.410063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 252/507] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1753 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:30.415866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5836c97f-fd2f-49a2-aa51-23ddf056e07d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:30.424348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5836c97f-fd2f-49a2-aa51-23ddf056e07d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:30.434555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5836c97f-fd2f-49a2-aa51-23ddf056e07d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:30.435001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5836c97f-fd2f-49a2-aa51-23ddf056e07d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:30.436444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5836c97f-fd2f-49a2-aa51-23ddf056e07d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:30.436852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5836c97f-fd2f-49a2-aa51-23ddf056e07d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:30.636002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6023789e-3796-4433-9a4e-c3565d7c2649 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:30.645962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6023789e-3796-4433-9a4e-c3565d7c2649 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.268710 Aug 01 15:37:30.647521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 256/508] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:30 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:30.650022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5836c97f-fd2f-49a2-aa51-23ddf056e07d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:30.651207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e8fa6cd8-4b66-4a84-8796-4a2340ee0f35 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:30.651819 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e8fa6cd8-4b66-4a84-8796-4a2340ee0f35 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:30.658784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8fa6cd8-4b66-4a84-8796-4a2340ee0f35 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:30.659228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8fa6cd8-4b66-4a84-8796-4a2340ee0f35 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:30.660109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8fa6cd8-4b66-4a84-8796-4a2340ee0f35 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:30.660745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8fa6cd8-4b66-4a84-8796-4a2340ee0f35 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:30.674805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5836c97f-fd2f-49a2-aa51-23ddf056e07d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.263341 Aug 01 15:37:30.675392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 253/509] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:30 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:30.858948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e8fa6cd8-4b66-4a84-8796-4a2340ee0f35 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:30.867652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e8fa6cd8-4b66-4a84-8796-4a2340ee0f35 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.219889 Aug 01 15:37:30.870177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 257/510] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:30 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:31.396781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a2a7eff7-9a89-46b8-b3c2-b820e1278ab6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:31.397554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a2a7eff7-9a89-46b8-b3c2-b820e1278ab6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:31.405323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2a7eff7-9a89-46b8-b3c2-b820e1278ab6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:31.405781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2a7eff7-9a89-46b8-b3c2-b820e1278ab6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:31.406740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2a7eff7-9a89-46b8-b3c2-b820e1278ab6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:31.407242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2a7eff7-9a89-46b8-b3c2-b820e1278ab6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:31.438232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a9854316-f616-4a60-b96a-327d44bb836b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:31.439145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a9854316-f616-4a60-b96a-327d44bb836b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:31.446380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9854316-f616-4a60-b96a-327d44bb836b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:31.446835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9854316-f616-4a60-b96a-327d44bb836b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:31.447615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9854316-f616-4a60-b96a-327d44bb836b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:31.448043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9854316-f616-4a60-b96a-327d44bb836b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:31.632483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a2a7eff7-9a89-46b8-b3c2-b820e1278ab6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:31.643940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a2a7eff7-9a89-46b8-b3c2-b820e1278ab6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.251410 Aug 01 15:37:31.644851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 254/511] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:31 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:31.657631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a9854316-f616-4a60-b96a-327d44bb836b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:31.667832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-62938dfc-f893-4cae-b067-bdb3fb7cb166 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:31.671005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-62938dfc-f893-4cae-b067-bdb3fb7cb166 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:31.672575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a9854316-f616-4a60-b96a-327d44bb836b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:31.674868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a9854316-f616-4a60-b96a-327d44bb836b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:31.677267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a9854316-f616-4a60-b96a-327d44bb836b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1753 microversion: 2.20 time: 0.242965 Aug 01 15:37:31.679080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-62938dfc-f893-4cae-b067-bdb3fb7cb166 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:31.689918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-62938dfc-f893-4cae-b067-bdb3fb7cb166 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:31.689918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-62938dfc-f893-4cae-b067-bdb3fb7cb166 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:31.689918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-62938dfc-f893-4cae-b067-bdb3fb7cb166 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:31.691358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 258/512] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1753 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:31.706798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e99f2d1e-f3bd-4b0e-8068-a0f144840852 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:31.707565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e99f2d1e-f3bd-4b0e-8068-a0f144840852 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:31.717250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e99f2d1e-f3bd-4b0e-8068-a0f144840852 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:31.717250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e99f2d1e-f3bd-4b0e-8068-a0f144840852 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:31.717719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e99f2d1e-f3bd-4b0e-8068-a0f144840852 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:31.718516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e99f2d1e-f3bd-4b0e-8068-a0f144840852 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:31.969907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-62938dfc-f893-4cae-b067-bdb3fb7cb166 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:31.972240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e99f2d1e-f3bd-4b0e-8068-a0f144840852 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:31.979683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-62938dfc-f893-4cae-b067-bdb3fb7cb166 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.316586 Aug 01 15:37:31.980548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 255/513] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:31 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:31.980673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e99f2d1e-f3bd-4b0e-8068-a0f144840852 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.280920 Aug 01 15:37:31.981109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 259/514] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:31 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:31.985349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-93b86f38-bfe0-4372-b412-ff55ff7771e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:31.985993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-93b86f38-bfe0-4372-b412-ff55ff7771e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:31.996938 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-93b86f38-bfe0-4372-b412-ff55ff7771e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:31.997525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-93b86f38-bfe0-4372-b412-ff55ff7771e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:31.998233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-93b86f38-bfe0-4372-b412-ff55ff7771e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:31.998673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-93b86f38-bfe0-4372-b412-ff55ff7771e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:32.175915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-93b86f38-bfe0-4372-b412-ff55ff7771e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:32.184342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-93b86f38-bfe0-4372-b412-ff55ff7771e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.202407 Aug 01 15:37:32.185127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 256/515] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:31 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:32.665275 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-028bc722-4a0a-464b-8b8b-a37e7e6c04be tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:32.665936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-028bc722-4a0a-464b-8b8b-a37e7e6c04be tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:32.673531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-028bc722-4a0a-464b-8b8b-a37e7e6c04be tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:32.673998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-028bc722-4a0a-464b-8b8b-a37e7e6c04be tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:32.674769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-028bc722-4a0a-464b-8b8b-a37e7e6c04be tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:32.675205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-028bc722-4a0a-464b-8b8b-a37e7e6c04be tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:32.711274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d07cb497-06f4-4d07-818d-6272544f94a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:32.711945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d07cb497-06f4-4d07-818d-6272544f94a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:32.719736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d07cb497-06f4-4d07-818d-6272544f94a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:32.720185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d07cb497-06f4-4d07-818d-6272544f94a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:32.720970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d07cb497-06f4-4d07-818d-6272544f94a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:32.721403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d07cb497-06f4-4d07-818d-6272544f94a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:32.957926 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-028bc722-4a0a-464b-8b8b-a37e7e6c04be tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:32.974823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-028bc722-4a0a-464b-8b8b-a37e7e6c04be tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.313854 Aug 01 15:37:32.975936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 260/516] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:32 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:33.000865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1db037f5-0ca0-4219-acd6-b1ad4cf08d5b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:33.001642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1db037f5-0ca0-4219-acd6-b1ad4cf08d5b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:33.009048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1db037f5-0ca0-4219-acd6-b1ad4cf08d5b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:33.009492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1db037f5-0ca0-4219-acd6-b1ad4cf08d5b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:33.010304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1db037f5-0ca0-4219-acd6-b1ad4cf08d5b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:33.010735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1db037f5-0ca0-4219-acd6-b1ad4cf08d5b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:33.262368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d07cb497-06f4-4d07-818d-6272544f94a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:33.271278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d07cb497-06f4-4d07-818d-6272544f94a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:33.272795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d07cb497-06f4-4d07-818d-6272544f94a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:33.274085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d07cb497-06f4-4d07-818d-6272544f94a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1753 microversion: 2.20 time: 0.566737 Aug 01 15:37:33.274652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 257/517] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1753 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:33.296907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4fe07f15-4a5e-4064-ac5c-d9ab629fb7d7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:33.297537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4fe07f15-4a5e-4064-ac5c-d9ab629fb7d7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:33.303828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4fe07f15-4a5e-4064-ac5c-d9ab629fb7d7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:33.304283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4fe07f15-4a5e-4064-ac5c-d9ab629fb7d7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:33.305189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4fe07f15-4a5e-4064-ac5c-d9ab629fb7d7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:33.305501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4fe07f15-4a5e-4064-ac5c-d9ab629fb7d7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:33.345797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1db037f5-0ca0-4219-acd6-b1ad4cf08d5b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:33.354165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1db037f5-0ca0-4219-acd6-b1ad4cf08d5b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.356969 Aug 01 15:37:33.354750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 261/518] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:32 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:33.359678 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-70f2afc4-8313-4edc-9020-4ffe42b317b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:33.360381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-70f2afc4-8313-4edc-9020-4ffe42b317b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:33.366583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70f2afc4-8313-4edc-9020-4ffe42b317b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:33.367103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70f2afc4-8313-4edc-9020-4ffe42b317b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:33.367934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70f2afc4-8313-4edc-9020-4ffe42b317b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:33.368366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70f2afc4-8313-4edc-9020-4ffe42b317b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:33.488399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4fe07f15-4a5e-4064-ac5c-d9ab629fb7d7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:33.496719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4fe07f15-4a5e-4064-ac5c-d9ab629fb7d7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.210968 Aug 01 15:37:33.497390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 258/519] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:33 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:33.542291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-70f2afc4-8313-4edc-9020-4ffe42b317b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:33.550095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-70f2afc4-8313-4edc-9020-4ffe42b317b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.194217 Aug 01 15:37:33.550699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 262/520] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:33 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:34.007836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-66ecbef3-9f7b-4277-bf6e-305e17103ad2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:34.008920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-66ecbef3-9f7b-4277-bf6e-305e17103ad2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:34.019827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-66ecbef3-9f7b-4277-bf6e-305e17103ad2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:34.019827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-66ecbef3-9f7b-4277-bf6e-305e17103ad2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:34.020596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-66ecbef3-9f7b-4277-bf6e-305e17103ad2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:34.021141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-66ecbef3-9f7b-4277-bf6e-305e17103ad2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:34.267734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-66ecbef3-9f7b-4277-bf6e-305e17103ad2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:34.271230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:34.282920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-66ecbef3-9f7b-4277-bf6e-305e17103ad2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.278477 Aug 01 15:37:34.283930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 259/521] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:34 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:34.303208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b6531f1a-bf60-4681-a30b-3acef40213be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:34.304284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b6531f1a-bf60-4681-a30b-3acef40213be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:34.313709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6531f1a-bf60-4681-a30b-3acef40213be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:34.314326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6531f1a-bf60-4681-a30b-3acef40213be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:34.315396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6531f1a-bf60-4681-a30b-3acef40213be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:34.316068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6531f1a-bf60-4681-a30b-3acef40213be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:34.375381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0275fc4a-2139-4e5d-9574-8505e62a9840 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:34.376003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0275fc4a-2139-4e5d-9574-8505e62a9840 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:34.382383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0275fc4a-2139-4e5d-9574-8505e62a9840 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:34.382937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0275fc4a-2139-4e5d-9574-8505e62a9840 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:34.383618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0275fc4a-2139-4e5d-9574-8505e62a9840 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:34.384051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0275fc4a-2139-4e5d-9574-8505e62a9840 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:34.751718 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b6531f1a-bf60-4681-a30b-3acef40213be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:34.772470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b6531f1a-bf60-4681-a30b-3acef40213be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:34.782771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b6531f1a-bf60-4681-a30b-3acef40213be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:34.784841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b6531f1a-bf60-4681-a30b-3acef40213be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1753 microversion: 2.20 time: 0.487762 Aug 01 15:37:34.798152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 263/522] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1753 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:34.809664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0852d742-b7c8-41c9-8eab-b68f90f6eb49 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:34.810627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0852d742-b7c8-41c9-8eab-b68f90f6eb49 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:34.814904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0275fc4a-2139-4e5d-9574-8505e62a9840 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:34.816991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0852d742-b7c8-41c9-8eab-b68f90f6eb49 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:34.817509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0852d742-b7c8-41c9-8eab-b68f90f6eb49 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:34.818537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0852d742-b7c8-41c9-8eab-b68f90f6eb49 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:34.819029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0852d742-b7c8-41c9-8eab-b68f90f6eb49 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:34.828671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0275fc4a-2139-4e5d-9574-8505e62a9840 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.457354 Aug 01 15:37:34.842118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 260/523] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:34 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:34.842118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d9434258-286c-4453-9906-290507237006 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:34.842118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d9434258-286c-4453-9906-290507237006 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:34.846227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9434258-286c-4453-9906-290507237006 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:34.846747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9434258-286c-4453-9906-290507237006 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:34.847936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9434258-286c-4453-9906-290507237006 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:34.848558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9434258-286c-4453-9906-290507237006 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:34.854521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:35.049658 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0852d742-b7c8-41c9-8eab-b68f90f6eb49 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:35.057750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0852d742-b7c8-41c9-8eab-b68f90f6eb49 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.256042 Aug 01 15:37:35.058391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 264/524] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:34 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:35.068848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d9434258-286c-4453-9906-290507237006 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:35.068848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d9434258-286c-4453-9906-290507237006 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.238475 Aug 01 15:37:35.069640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 261/525] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:34 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:35.305562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-43194c9f-eb41-46ad-93eb-5bb9703ade3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:35.306446 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-43194c9f-eb41-46ad-93eb-5bb9703ade3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:35.314416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43194c9f-eb41-46ad-93eb-5bb9703ade3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:35.314969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43194c9f-eb41-46ad-93eb-5bb9703ade3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:35.315824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43194c9f-eb41-46ad-93eb-5bb9703ade3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:35.316336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43194c9f-eb41-46ad-93eb-5bb9703ade3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:35.465002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-43194c9f-eb41-46ad-93eb-5bb9703ade3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:35.472918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-43194c9f-eb41-46ad-93eb-5bb9703ade3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.171964 Aug 01 15:37:35.473495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 265/526] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:35 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:35.809133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7e5bd16b-f3a1-48e0-85cb-42a961cbac55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:35.809782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7e5bd16b-f3a1-48e0-85cb-42a961cbac55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:35.816084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e5bd16b-f3a1-48e0-85cb-42a961cbac55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:35.816534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e5bd16b-f3a1-48e0-85cb-42a961cbac55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:35.817309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e5bd16b-f3a1-48e0-85cb-42a961cbac55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:35.817748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e5bd16b-f3a1-48e0-85cb-42a961cbac55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:35.854244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-36c12f4a-01eb-467b-80c4-0f4c1567fe84 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:35.854943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-36c12f4a-01eb-467b-80c4-0f4c1567fe84 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:35.862052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-36c12f4a-01eb-467b-80c4-0f4c1567fe84 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:35.862593 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-36c12f4a-01eb-467b-80c4-0f4c1567fe84 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:35.863445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-36c12f4a-01eb-467b-80c4-0f4c1567fe84 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:35.863887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-36c12f4a-01eb-467b-80c4-0f4c1567fe84 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:36.007707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7e5bd16b-f3a1-48e0-85cb-42a961cbac55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:36.018209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7e5bd16b-f3a1-48e0-85cb-42a961cbac55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:36.019844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7e5bd16b-f3a1-48e0-85cb-42a961cbac55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:36.021144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7e5bd16b-f3a1-48e0-85cb-42a961cbac55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1753 microversion: 2.20 time: 0.216514 Aug 01 15:37:36.021703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 262/527] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1753 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:36.038010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-36c12f4a-01eb-467b-80c4-0f4c1567fe84 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:36.046226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-36c12f4a-01eb-467b-80c4-0f4c1567fe84 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.195980 Aug 01 15:37:36.046787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 266/528] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:35 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:36.079630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ebbbd635-b1dd-4a93-88d5-6900f8a3e396 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:36.080247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ebbbd635-b1dd-4a93-88d5-6900f8a3e396 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:36.086407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebbbd635-b1dd-4a93-88d5-6900f8a3e396 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:36.086858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebbbd635-b1dd-4a93-88d5-6900f8a3e396 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:36.087632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebbbd635-b1dd-4a93-88d5-6900f8a3e396 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:36.088337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebbbd635-b1dd-4a93-88d5-6900f8a3e396 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:36.090545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ee995fd2-52aa-4fe0-928d-8ad1d20c3e9b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:36.091204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ee995fd2-52aa-4fe0-928d-8ad1d20c3e9b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:36.097159 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ee995fd2-52aa-4fe0-928d-8ad1d20c3e9b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:36.097606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ee995fd2-52aa-4fe0-928d-8ad1d20c3e9b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:36.098393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ee995fd2-52aa-4fe0-928d-8ad1d20c3e9b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:36.098828 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ee995fd2-52aa-4fe0-928d-8ad1d20c3e9b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:36.291271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ebbbd635-b1dd-4a93-88d5-6900f8a3e396 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:36.295393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ee995fd2-52aa-4fe0-928d-8ad1d20c3e9b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:36.299608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ebbbd635-b1dd-4a93-88d5-6900f8a3e396 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1318 microversion: 2.1 time: 0.223769 Aug 01 15:37:36.300187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 263/529] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:36 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:36.303019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ee995fd2-52aa-4fe0-928d-8ad1d20c3e9b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.216519 Aug 01 15:37:36.303575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 267/530] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:36 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:36.492762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ea31b7b5-4d1b-448e-9a28-4dd2001c4dd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:36.493379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ea31b7b5-4d1b-448e-9a28-4dd2001c4dd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:36.500080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea31b7b5-4d1b-448e-9a28-4dd2001c4dd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:36.500531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea31b7b5-4d1b-448e-9a28-4dd2001c4dd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:36.501323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea31b7b5-4d1b-448e-9a28-4dd2001c4dd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:36.501748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea31b7b5-4d1b-448e-9a28-4dd2001c4dd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:36.657262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ea31b7b5-4d1b-448e-9a28-4dd2001c4dd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:36.667250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ea31b7b5-4d1b-448e-9a28-4dd2001c4dd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.178333 Aug 01 15:37:36.668299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 264/531] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:36 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:37.043462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1aebccec-c41a-4e4f-a632-7eabb6b88ae4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:37.044317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1aebccec-c41a-4e4f-a632-7eabb6b88ae4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:37.051461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1aebccec-c41a-4e4f-a632-7eabb6b88ae4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:37.051919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1aebccec-c41a-4e4f-a632-7eabb6b88ae4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:37.052824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1aebccec-c41a-4e4f-a632-7eabb6b88ae4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:37.053276 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1aebccec-c41a-4e4f-a632-7eabb6b88ae4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:37.070892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-99f119e7-92c5-497b-8883-5530868db4bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:37.071511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-99f119e7-92c5-497b-8883-5530868db4bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:37.079686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99f119e7-92c5-497b-8883-5530868db4bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:37.080363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99f119e7-92c5-497b-8883-5530868db4bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:37.080951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99f119e7-92c5-497b-8883-5530868db4bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:37.081491 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99f119e7-92c5-497b-8883-5530868db4bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:37.267389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1aebccec-c41a-4e4f-a632-7eabb6b88ae4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:37.276540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1aebccec-c41a-4e4f-a632-7eabb6b88ae4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:37.278124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1aebccec-c41a-4e4f-a632-7eabb6b88ae4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:37.279312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1aebccec-c41a-4e4f-a632-7eabb6b88ae4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.239763 Aug 01 15:37:37.279884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 268/532] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:37.282241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-99f119e7-92c5-497b-8883-5530868db4bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:37.291303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-99f119e7-92c5-497b-8883-5530868db4bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1369 microversion: 2.1 time: 0.226779 Aug 01 15:37:37.292123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 265/533] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:37 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:37.321248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-93d7f7f4-61a3-42bc-b1e5-dac3fed92c87 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:37.322090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-93d7f7f4-61a3-42bc-b1e5-dac3fed92c87 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:37.323661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7275056b-01bb-4721-a93b-09d74aa52e02 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:37.324936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7275056b-01bb-4721-a93b-09d74aa52e02 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:37.329714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93d7f7f4-61a3-42bc-b1e5-dac3fed92c87 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:37.330193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93d7f7f4-61a3-42bc-b1e5-dac3fed92c87 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:37.331475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7275056b-01bb-4721-a93b-09d74aa52e02 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:37.331818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93d7f7f4-61a3-42bc-b1e5-dac3fed92c87 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:37.332064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7275056b-01bb-4721-a93b-09d74aa52e02 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:37.332443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93d7f7f4-61a3-42bc-b1e5-dac3fed92c87 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:37.333054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7275056b-01bb-4721-a93b-09d74aa52e02 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:37.333568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7275056b-01bb-4721-a93b-09d74aa52e02 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:37.545881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-93d7f7f4-61a3-42bc-b1e5-dac3fed92c87 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:37.555596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-93d7f7f4-61a3-42bc-b1e5-dac3fed92c87 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1507 microversion: 2.1 time: 0.238106 Aug 01 15:37:37.557039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 269/534] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:37 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:37.559221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7275056b-01bb-4721-a93b-09d74aa52e02 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:37.567071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7275056b-01bb-4721-a93b-09d74aa52e02 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.247382 Aug 01 15:37:37.567666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 266/535] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:37 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:37.577285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c7327f9e-aa2c-4ea4-9e1d-ec33b9978bf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f418e61d-d2e6-4530-844c-fab840a592cf", "device": "/dev/sdb"}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:37.579884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c7327f9e-aa2c-4ea4-9e1d-ec33b9978bf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:37.585904 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c7327f9e-aa2c-4ea4-9e1d-ec33b9978bf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:37.586417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c7327f9e-aa2c-4ea4-9e1d-ec33b9978bf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:37.587183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c7327f9e-aa2c-4ea4-9e1d-ec33b9978bf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:37.587613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c7327f9e-aa2c-4ea4-9e1d-ec33b9978bf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:37.690139 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c09f3659-d0cf-4b4f-9181-ff902fcb3302 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:37.690765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c09f3659-d0cf-4b4f-9181-ff902fcb3302 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:37.698530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c09f3659-d0cf-4b4f-9181-ff902fcb3302 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:37.699110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c09f3659-d0cf-4b4f-9181-ff902fcb3302 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:37.699894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c09f3659-d0cf-4b4f-9181-ff902fcb3302 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:37.700369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c09f3659-d0cf-4b4f-9181-ff902fcb3302 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:37.844142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c09f3659-d0cf-4b4f-9181-ff902fcb3302 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:37.852155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c09f3659-d0cf-4b4f-9181-ff902fcb3302 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.166063 Aug 01 15:37:37.852733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 267/536] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:37 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:38.306499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4de264fe-fdd5-4840-a437-50676cb1a93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:38.307268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4de264fe-fdd5-4840-a437-50676cb1a93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:38.314129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4de264fe-fdd5-4840-a437-50676cb1a93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:38.314398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4de264fe-fdd5-4840-a437-50676cb1a93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:38.315173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4de264fe-fdd5-4840-a437-50676cb1a93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:38.315608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4de264fe-fdd5-4840-a437-50676cb1a93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:38.448944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4de264fe-fdd5-4840-a437-50676cb1a93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:38.459329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4de264fe-fdd5-4840-a437-50676cb1a93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:38.461074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4de264fe-fdd5-4840-a437-50676cb1a93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:38.462287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4de264fe-fdd5-4840-a437-50676cb1a93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.159712 Aug 01 15:37:38.462844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 268/537] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:37:38.467565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-68ffffbd-5ed3-4d64-97f1-899e18f63788 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:38.468167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-68ffffbd-5ed3-4d64-97f1-899e18f63788 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:38.474286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68ffffbd-5ed3-4d64-97f1-899e18f63788 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:38.474742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68ffffbd-5ed3-4d64-97f1-899e18f63788 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:38.475503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68ffffbd-5ed3-4d64-97f1-899e18f63788 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:38.475936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68ffffbd-5ed3-4d64-97f1-899e18f63788 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:38.608266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-68ffffbd-5ed3-4d64-97f1-899e18f63788 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:38.615816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-68ffffbd-5ed3-4d64-97f1-899e18f63788 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1563 microversion: 2.1 time: 0.151731 Aug 01 15:37:38.616393 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 269/538] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:38 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:38.621335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-61df2daf-379e-4928-8923-88b902593170 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:38.621986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-61df2daf-379e-4928-8923-88b902593170 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:38.628300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-61df2daf-379e-4928-8923-88b902593170 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:38.628755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-61df2daf-379e-4928-8923-88b902593170 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:38.629529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-61df2daf-379e-4928-8923-88b902593170 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:38.629998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-61df2daf-379e-4928-8923-88b902593170 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:38.766128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-61df2daf-379e-4928-8923-88b902593170 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:38.773957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-61df2daf-379e-4928-8923-88b902593170 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.156584 Aug 01 15:37:38.774527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 270/539] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:38 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:38.779004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8e5cdd0e-643f-4808-afff-dd34a7896145 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:38.779496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8e5cdd0e-643f-4808-afff-dd34a7896145 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:38.785839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e5cdd0e-643f-4808-afff-dd34a7896145 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:38.786322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e5cdd0e-643f-4808-afff-dd34a7896145 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:38.787095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e5cdd0e-643f-4808-afff-dd34a7896145 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:38.787529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e5cdd0e-643f-4808-afff-dd34a7896145 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:38.865542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8e5cdd0e-643f-4808-afff-dd34a7896145 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089933 Aug 01 15:37:38.866201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 271/540] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 1 15:37:38 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:38.875362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c9b4e6be-26c9-4fb0-b772-24b154b6ba60 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:38.875982 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c9b4e6be-26c9-4fb0-b772-24b154b6ba60 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:38.885112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9b4e6be-26c9-4fb0-b772-24b154b6ba60 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:38.885564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9b4e6be-26c9-4fb0-b772-24b154b6ba60 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:38.886384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9b4e6be-26c9-4fb0-b772-24b154b6ba60 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:38.886822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9b4e6be-26c9-4fb0-b772-24b154b6ba60 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:39.158797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c9b4e6be-26c9-4fb0-b772-24b154b6ba60 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:39.167014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c9b4e6be-26c9-4fb0-b772-24b154b6ba60 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.298012 Aug 01 15:37:39.168666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 272/541] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:38 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:39.488188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0c8b746a-4522-4efb-a664-3810a2f15f2e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:39.489013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0c8b746a-4522-4efb-a664-3810a2f15f2e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:39.495507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0c8b746a-4522-4efb-a664-3810a2f15f2e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:39.496067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0c8b746a-4522-4efb-a664-3810a2f15f2e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:39.496913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0c8b746a-4522-4efb-a664-3810a2f15f2e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:39.497429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0c8b746a-4522-4efb-a664-3810a2f15f2e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:39.737150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0c8b746a-4522-4efb-a664-3810a2f15f2e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:39.748803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0c8b746a-4522-4efb-a664-3810a2f15f2e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:39.750585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0c8b746a-4522-4efb-a664-3810a2f15f2e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:39.752275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0c8b746a-4522-4efb-a664-3810a2f15f2e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.269332 Aug 01 15:37:39.752930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 273/542] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:39.801582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-56612bcc-edc4-440e-90c1-99daf809f7f3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:39.802648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-56612bcc-edc4-440e-90c1-99daf809f7f3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:39.809465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56612bcc-edc4-440e-90c1-99daf809f7f3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:39.810106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56612bcc-edc4-440e-90c1-99daf809f7f3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:39.810968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56612bcc-edc4-440e-90c1-99daf809f7f3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:39.811407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56612bcc-edc4-440e-90c1-99daf809f7f3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:40.268158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-56612bcc-edc4-440e-90c1-99daf809f7f3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:40.276090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-56612bcc-edc4-440e-90c1-99daf809f7f3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.484405 Aug 01 15:37:40.276673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 274/543] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:39 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:40.294155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a4ce9b7e-b4aa-44b4-8751-4eacc9908ce9 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:40.294799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a4ce9b7e-b4aa-44b4-8751-4eacc9908ce9 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:40.300883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4ce9b7e-b4aa-44b4-8751-4eacc9908ce9 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:40.301333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4ce9b7e-b4aa-44b4-8751-4eacc9908ce9 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:40.302146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4ce9b7e-b4aa-44b4-8751-4eacc9908ce9 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:40.302619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4ce9b7e-b4aa-44b4-8751-4eacc9908ce9 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:40.464329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a4ce9b7e-b4aa-44b4-8751-4eacc9908ce9 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:40.473565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a4ce9b7e-b4aa-44b4-8751-4eacc9908ce9 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.183243 Aug 01 15:37:40.474213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 275/544] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:40 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:40.479735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-bfc08992-46e1-42a9-a8e4-1238257a02d1 req-af675806-1952-464a-adf1-c97aa5fe2ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "462946dd-1a7a-43ec-8d8f-ca88a2b90b13", "tag": "f498a708-36e0-44d2-bc24-58d436d77bf2"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:40.499923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-bfc08992-46e1-42a9-a8e4-1238257a02d1 req-af675806-1952-464a-adf1-c97aa5fe2ab0 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:40.501022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-bfc08992-46e1-42a9-a8e4-1238257a02d1 req-af675806-1952-464a-adf1-c97aa5fe2ab0 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:40.513824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-bfc08992-46e1-42a9-a8e4-1238257a02d1 req-af675806-1952-464a-adf1-c97aa5fe2ab0 service nova] Creating event network-changed:f498a708-36e0-44d2-bc24-58d436d77bf2 for instance 462946dd-1a7a-43ec-8d8f-ca88a2b90b13 on hv-cinder-84753 Aug 01 15:37:40.519734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-bfc08992-46e1-42a9-a8e4-1238257a02d1 req-af675806-1952-464a-adf1-c97aa5fe2ab0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044207 Aug 01 15:37:40.522414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 276/545] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:40.779231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5669b369-ef27-41b6-a900-35a849b6c6b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:40.779974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5669b369-ef27-41b6-a900-35a849b6c6b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:40.786985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5669b369-ef27-41b6-a900-35a849b6c6b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:40.788600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5669b369-ef27-41b6-a900-35a849b6c6b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:40.789507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5669b369-ef27-41b6-a900-35a849b6c6b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:40.790113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5669b369-ef27-41b6-a900-35a849b6c6b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:40.807315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:40.962598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5669b369-ef27-41b6-a900-35a849b6c6b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:40.972582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5669b369-ef27-41b6-a900-35a849b6c6b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:40.974126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5669b369-ef27-41b6-a900-35a849b6c6b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:40.975331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5669b369-ef27-41b6-a900-35a849b6c6b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.200684 Aug 01 15:37:40.975893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 277/546] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:41.297533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a4106581-f282-4167-a1d1-aa94d23e7909 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:41.298247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a4106581-f282-4167-a1d1-aa94d23e7909 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:41.305137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4106581-f282-4167-a1d1-aa94d23e7909 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:41.305583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4106581-f282-4167-a1d1-aa94d23e7909 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:41.306386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4106581-f282-4167-a1d1-aa94d23e7909 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:41.306818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4106581-f282-4167-a1d1-aa94d23e7909 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:41.453371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a4106581-f282-4167-a1d1-aa94d23e7909 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:41.461298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a4106581-f282-4167-a1d1-aa94d23e7909 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.168391 Aug 01 15:37:41.462241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 278/547] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:41 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:41.499879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-78b7fcae-5198-45b9-84d8-fb1f7d0a4c0b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:41.500530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-78b7fcae-5198-45b9-84d8-fb1f7d0a4c0b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:41.502925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:41.508903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78b7fcae-5198-45b9-84d8-fb1f7d0a4c0b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:41.509347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78b7fcae-5198-45b9-84d8-fb1f7d0a4c0b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:41.510150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78b7fcae-5198-45b9-84d8-fb1f7d0a4c0b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:41.510591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78b7fcae-5198-45b9-84d8-fb1f7d0a4c0b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:41.701621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-78b7fcae-5198-45b9-84d8-fb1f7d0a4c0b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:41.716941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-78b7fcae-5198-45b9-84d8-fb1f7d0a4c0b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.220807 Aug 01 15:37:41.717511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 279/548] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:41 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:41.840434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c7327f9e-aa2c-4ea4-9e1d-ec33b9978bf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "POST /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.266304 Aug 01 15:37:41.842443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 270/549] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 1 15:37:37 2022] POST /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments => generated 194 bytes in 4270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:42.004862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-43502d5f-bff3-470f-89ff-f1bc20f2e159 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:42.006025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-43502d5f-bff3-470f-89ff-f1bc20f2e159 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:42.017446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43502d5f-bff3-470f-89ff-f1bc20f2e159 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:42.018411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43502d5f-bff3-470f-89ff-f1bc20f2e159 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:42.019480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43502d5f-bff3-470f-89ff-f1bc20f2e159 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:42.020870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43502d5f-bff3-470f-89ff-f1bc20f2e159 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:42.228630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-43502d5f-bff3-470f-89ff-f1bc20f2e159 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:42.238800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-43502d5f-bff3-470f-89ff-f1bc20f2e159 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:42.240316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-43502d5f-bff3-470f-89ff-f1bc20f2e159 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:42.241648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-43502d5f-bff3-470f-89ff-f1bc20f2e159 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.242964 Aug 01 15:37:42.242301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 280/550] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:42.484837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1fdf2b31-7807-451d-9184-ea4929eef65d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:42.485542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1fdf2b31-7807-451d-9184-ea4929eef65d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:42.492343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1fdf2b31-7807-451d-9184-ea4929eef65d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:42.492791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1fdf2b31-7807-451d-9184-ea4929eef65d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:42.493567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1fdf2b31-7807-451d-9184-ea4929eef65d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:42.494086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1fdf2b31-7807-451d-9184-ea4929eef65d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:42.655011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1fdf2b31-7807-451d-9184-ea4929eef65d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:42.666637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1fdf2b31-7807-451d-9184-ea4929eef65d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.186049 Aug 01 15:37:42.668680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 271/551] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:42 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:42.739405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-37f9458e-1c2c-423b-8fe8-570d902a0edd tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:42.740027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-37f9458e-1c2c-423b-8fe8-570d902a0edd tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:42.747827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-37f9458e-1c2c-423b-8fe8-570d902a0edd tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:42.748279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-37f9458e-1c2c-423b-8fe8-570d902a0edd tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:42.749061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-37f9458e-1c2c-423b-8fe8-570d902a0edd tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:42.749499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-37f9458e-1c2c-423b-8fe8-570d902a0edd tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:42.902417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-37f9458e-1c2c-423b-8fe8-570d902a0edd tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:42.911084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-37f9458e-1c2c-423b-8fe8-570d902a0edd tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.175477 Aug 01 15:37:42.911668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 281/552] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:42 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:43.266242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-62796882-43f5-4577-be77-f7f8adbfe7d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:43.267042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-62796882-43f5-4577-be77-f7f8adbfe7d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:43.276215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62796882-43f5-4577-be77-f7f8adbfe7d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:43.276215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62796882-43f5-4577-be77-f7f8adbfe7d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:43.276833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62796882-43f5-4577-be77-f7f8adbfe7d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:43.277868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62796882-43f5-4577-be77-f7f8adbfe7d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:43.454066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-62796882-43f5-4577-be77-f7f8adbfe7d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:43.480248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-62796882-43f5-4577-be77-f7f8adbfe7d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:43.485062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-62796882-43f5-4577-be77-f7f8adbfe7d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:43.488058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-62796882-43f5-4577-be77-f7f8adbfe7d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.225694 Aug 01 15:37:43.514151 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 272/553] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:43.551357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-b9adec93-dbc7-48db-8f19-adce8d033ee0 req-4671ef32-aeb1-4f79-9212-3b63c497f6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7", "name": "network-vif-plugged", "status": "completed", "tag": "363ae4d1-ef88-47d5-a3fb-e1b35283078c"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:43.566336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-b9adec93-dbc7-48db-8f19-adce8d033ee0 req-4671ef32-aeb1-4f79-9212-3b63c497f6f9 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:43.567107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-b9adec93-dbc7-48db-8f19-adce8d033ee0 req-4671ef32-aeb1-4f79-9212-3b63c497f6f9 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:43.580592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-b9adec93-dbc7-48db-8f19-adce8d033ee0 req-4671ef32-aeb1-4f79-9212-3b63c497f6f9 service nova] Creating event network-vif-plugged:363ae4d1-ef88-47d5-a3fb-e1b35283078c for instance f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 on hv-cinder-84753 Aug 01 15:37:43.585969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-b9adec93-dbc7-48db-8f19-adce8d033ee0 req-4671ef32-aeb1-4f79-9212-3b63c497f6f9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039672 Aug 01 15:37:43.587521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 282/554] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:37:43.701802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ccca65d1-53bc-4f98-8530-8a43e40e57fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:43.702464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ccca65d1-53bc-4f98-8530-8a43e40e57fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:43.716137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccca65d1-53bc-4f98-8530-8a43e40e57fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:43.716663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccca65d1-53bc-4f98-8530-8a43e40e57fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:43.717443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccca65d1-53bc-4f98-8530-8a43e40e57fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:43.717905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccca65d1-53bc-4f98-8530-8a43e40e57fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:43.962281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3bc623e0-4fe6-4d8f-af75-b3ac323c7a77 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:43.964108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3bc623e0-4fe6-4d8f-af75-b3ac323c7a77 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:43.979813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ccca65d1-53bc-4f98-8530-8a43e40e57fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:43.986573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ccca65d1-53bc-4f98-8530-8a43e40e57fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.297699 Aug 01 15:37:43.989320 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 273/555] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:43 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:43.991480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3bc623e0-4fe6-4d8f-af75-b3ac323c7a77 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:43.992266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3bc623e0-4fe6-4d8f-af75-b3ac323c7a77 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:43.993218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3bc623e0-4fe6-4d8f-af75-b3ac323c7a77 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:43.993983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3bc623e0-4fe6-4d8f-af75-b3ac323c7a77 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:44.197239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3bc623e0-4fe6-4d8f-af75-b3ac323c7a77 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:44.204935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3bc623e0-4fe6-4d8f-af75-b3ac323c7a77 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.275985 Aug 01 15:37:44.205811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 283/556] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:43 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:44.530890 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-df9667d4-ceb9-4812-a6b3-9496077a4a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:44.532247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-df9667d4-ceb9-4812-a6b3-9496077a4a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:44.539056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df9667d4-ceb9-4812-a6b3-9496077a4a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:44.539499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df9667d4-ceb9-4812-a6b3-9496077a4a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:44.540504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df9667d4-ceb9-4812-a6b3-9496077a4a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:44.540922 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df9667d4-ceb9-4812-a6b3-9496077a4a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:44.714155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-df9667d4-ceb9-4812-a6b3-9496077a4a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:44.723628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-df9667d4-ceb9-4812-a6b3-9496077a4a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:44.725314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-df9667d4-ceb9-4812-a6b3-9496077a4a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:44.726760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-df9667d4-ceb9-4812-a6b3-9496077a4a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.202636 Aug 01 15:37:44.727396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 274/557] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:45.012140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-56a5d545-de26-459f-9527-e24991f5a4c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:45.012884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-56a5d545-de26-459f-9527-e24991f5a4c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:45.021439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56a5d545-de26-459f-9527-e24991f5a4c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:45.022632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56a5d545-de26-459f-9527-e24991f5a4c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:45.024219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56a5d545-de26-459f-9527-e24991f5a4c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:45.025452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56a5d545-de26-459f-9527-e24991f5a4c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:45.227532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a356b22a-f2ca-46c6-9379-47d1d87f7105 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:45.228802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a356b22a-f2ca-46c6-9379-47d1d87f7105 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:45.251813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a356b22a-f2ca-46c6-9379-47d1d87f7105 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:45.252280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a356b22a-f2ca-46c6-9379-47d1d87f7105 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:45.253129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a356b22a-f2ca-46c6-9379-47d1d87f7105 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:45.253751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a356b22a-f2ca-46c6-9379-47d1d87f7105 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:45.276985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-56a5d545-de26-459f-9527-e24991f5a4c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:45.285588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-56a5d545-de26-459f-9527-e24991f5a4c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.277778 Aug 01 15:37:45.286461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 284/558] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:45 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:45.440750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a356b22a-f2ca-46c6-9379-47d1d87f7105 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:45.451538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a356b22a-f2ca-46c6-9379-47d1d87f7105 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.228331 Aug 01 15:37:45.465310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 275/559] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:45 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:45.752678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-33d72c30-12d4-4168-893a-5f14494bf015 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:45.753568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-33d72c30-12d4-4168-893a-5f14494bf015 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:45.760381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33d72c30-12d4-4168-893a-5f14494bf015 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:45.764542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33d72c30-12d4-4168-893a-5f14494bf015 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:45.766077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33d72c30-12d4-4168-893a-5f14494bf015 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:45.766886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33d72c30-12d4-4168-893a-5f14494bf015 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:45.929961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-7acb1e00-48dd-4d41-bb74-47279da84bb1 req-b8319614-0ec0-4122-9a3d-618e28690c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f0755f-45c5-4c98-96b7-9c4b6415d331", "name": "network-vif-plugged", "status": "completed", "tag": "6c507929-7001-4435-a0b5-2d19c503a391"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:37:45.942231 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-7acb1e00-48dd-4d41-bb74-47279da84bb1 req-b8319614-0ec0-4122-9a3d-618e28690c8e service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:45.942899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-7acb1e00-48dd-4d41-bb74-47279da84bb1 req-b8319614-0ec0-4122-9a3d-618e28690c8e service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:45.955767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-7acb1e00-48dd-4d41-bb74-47279da84bb1 req-b8319614-0ec0-4122-9a3d-618e28690c8e service nova] Creating event network-vif-plugged:6c507929-7001-4435-a0b5-2d19c503a391 for instance 58f0755f-45c5-4c98-96b7-9c4b6415d331 on hv-cinder-84753 Aug 01 15:37:45.962448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-7acb1e00-48dd-4d41-bb74-47279da84bb1 req-b8319614-0ec0-4122-9a3d-618e28690c8e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035862 Aug 01 15:37:45.963927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 276/560] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:37:45.969878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-33d72c30-12d4-4168-893a-5f14494bf015 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:46.005016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-33d72c30-12d4-4168-893a-5f14494bf015 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:46.006659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-33d72c30-12d4-4168-893a-5f14494bf015 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:46.007859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-33d72c30-12d4-4168-893a-5f14494bf015 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.260418 Aug 01 15:37:46.008431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 285/561] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:46.307977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-87c1384e-89d9-4e92-a14c-ea060b307e90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:46.309006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-87c1384e-89d9-4e92-a14c-ea060b307e90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:46.315831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87c1384e-89d9-4e92-a14c-ea060b307e90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:46.316412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87c1384e-89d9-4e92-a14c-ea060b307e90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:46.317390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87c1384e-89d9-4e92-a14c-ea060b307e90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:46.317833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87c1384e-89d9-4e92-a14c-ea060b307e90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:46.473437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a8f1df5a-5cda-481d-9e49-068b53c9123e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:46.474170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a8f1df5a-5cda-481d-9e49-068b53c9123e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:46.479369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-87c1384e-89d9-4e92-a14c-ea060b307e90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:46.480686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8f1df5a-5cda-481d-9e49-068b53c9123e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:46.481147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8f1df5a-5cda-481d-9e49-068b53c9123e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:46.482126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8f1df5a-5cda-481d-9e49-068b53c9123e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:46.482758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8f1df5a-5cda-481d-9e49-068b53c9123e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:46.488340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-87c1384e-89d9-4e92-a14c-ea060b307e90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.184973 Aug 01 15:37:46.489926 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 277/562] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:46 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:46.645588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a8f1df5a-5cda-481d-9e49-068b53c9123e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:46.654618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a8f1df5a-5cda-481d-9e49-068b53c9123e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.185395 Aug 01 15:37:46.662400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 286/563] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:46 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:47.034551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d81f3753-5905-421e-b9a6-bed730e5c221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:47.036785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d81f3753-5905-421e-b9a6-bed730e5c221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:47.043338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d81f3753-5905-421e-b9a6-bed730e5c221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:47.044086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d81f3753-5905-421e-b9a6-bed730e5c221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:47.045392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d81f3753-5905-421e-b9a6-bed730e5c221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:47.046154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d81f3753-5905-421e-b9a6-bed730e5c221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:47.288085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d81f3753-5905-421e-b9a6-bed730e5c221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:47.306296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d81f3753-5905-421e-b9a6-bed730e5c221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:47.310434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d81f3753-5905-421e-b9a6-bed730e5c221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:47.311958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d81f3753-5905-421e-b9a6-bed730e5c221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.282297 Aug 01 15:37:47.312539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 278/564] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:47.511324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-83bc33b0-e71b-4342-b220-85c220ea3137 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:47.511973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-83bc33b0-e71b-4342-b220-85c220ea3137 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:47.518709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83bc33b0-e71b-4342-b220-85c220ea3137 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:47.519241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83bc33b0-e71b-4342-b220-85c220ea3137 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:47.520012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83bc33b0-e71b-4342-b220-85c220ea3137 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:47.520635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83bc33b0-e71b-4342-b220-85c220ea3137 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:47.686059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1fef0063-43d1-4f9f-994c-e580e3944402 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:47.687024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1fef0063-43d1-4f9f-994c-e580e3944402 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:47.708334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1fef0063-43d1-4f9f-994c-e580e3944402 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:47.709182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1fef0063-43d1-4f9f-994c-e580e3944402 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:47.710051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1fef0063-43d1-4f9f-994c-e580e3944402 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:47.712165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1fef0063-43d1-4f9f-994c-e580e3944402 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:47.742828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-83bc33b0-e71b-4342-b220-85c220ea3137 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:47.759275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-83bc33b0-e71b-4342-b220-85c220ea3137 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.251588 Aug 01 15:37:47.761523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 287/565] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:47 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:47.901122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1fef0063-43d1-4f9f-994c-e580e3944402 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:47.914209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1fef0063-43d1-4f9f-994c-e580e3944402 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.232949 Aug 01 15:37:47.914796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 279/566] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:47 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:48.338845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f43c0498-c0a0-45ee-9d7c-5128c4de1e1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:48.339862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f43c0498-c0a0-45ee-9d7c-5128c4de1e1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:48.348523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f43c0498-c0a0-45ee-9d7c-5128c4de1e1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:48.349006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f43c0498-c0a0-45ee-9d7c-5128c4de1e1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:48.349801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f43c0498-c0a0-45ee-9d7c-5128c4de1e1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:48.350285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f43c0498-c0a0-45ee-9d7c-5128c4de1e1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:48.535204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f43c0498-c0a0-45ee-9d7c-5128c4de1e1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:48.544965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f43c0498-c0a0-45ee-9d7c-5128c4de1e1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:48.546712 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f43c0498-c0a0-45ee-9d7c-5128c4de1e1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:48.548384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f43c0498-c0a0-45ee-9d7c-5128c4de1e1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.215458 Aug 01 15:37:48.549451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 288/567] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:48.783519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f4276878-749a-4a11-9ced-d769f1e6cd82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:48.785311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f4276878-749a-4a11-9ced-d769f1e6cd82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:48.796703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4276878-749a-4a11-9ced-d769f1e6cd82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:48.797038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4276878-749a-4a11-9ced-d769f1e6cd82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:48.798039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4276878-749a-4a11-9ced-d769f1e6cd82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:48.798781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4276878-749a-4a11-9ced-d769f1e6cd82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:48.820627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:48.936840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-91f04676-3f56-4f63-a5af-b5877eeb5ea6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:48.937766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-91f04676-3f56-4f63-a5af-b5877eeb5ea6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:48.945198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91f04676-3f56-4f63-a5af-b5877eeb5ea6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:48.945653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91f04676-3f56-4f63-a5af-b5877eeb5ea6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:48.946466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91f04676-3f56-4f63-a5af-b5877eeb5ea6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:48.946904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91f04676-3f56-4f63-a5af-b5877eeb5ea6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:48.951132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f4276878-749a-4a11-9ced-d769f1e6cd82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:48.958710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f4276878-749a-4a11-9ced-d769f1e6cd82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.179498 Aug 01 15:37:48.959508 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 280/568] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:48 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:49.099713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-91f04676-3f56-4f63-a5af-b5877eeb5ea6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:49.107832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-91f04676-3f56-4f63-a5af-b5877eeb5ea6 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.176514 Aug 01 15:37:49.108406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 289/569] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:48 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:49.576948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-66a155d8-f7c1-4dfc-af5b-94f656989b73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:49.577554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-66a155d8-f7c1-4dfc-af5b-94f656989b73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:49.583815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66a155d8-f7c1-4dfc-af5b-94f656989b73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:49.584255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66a155d8-f7c1-4dfc-af5b-94f656989b73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:49.585012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66a155d8-f7c1-4dfc-af5b-94f656989b73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:49.585439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66a155d8-f7c1-4dfc-af5b-94f656989b73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:49.765312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-66a155d8-f7c1-4dfc-af5b-94f656989b73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:49.784319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-66a155d8-f7c1-4dfc-af5b-94f656989b73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:49.786937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-66a155d8-f7c1-4dfc-af5b-94f656989b73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:49.788261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-66a155d8-f7c1-4dfc-af5b-94f656989b73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.215788 Aug 01 15:37:49.789247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 281/570] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:49.981167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f7449b17-aaae-4b88-9eb8-67d295686bff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:49.981756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f7449b17-aaae-4b88-9eb8-67d295686bff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:49.987969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7449b17-aaae-4b88-9eb8-67d295686bff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:49.988414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7449b17-aaae-4b88-9eb8-67d295686bff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:49.989175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7449b17-aaae-4b88-9eb8-67d295686bff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:49.989604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7449b17-aaae-4b88-9eb8-67d295686bff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:50.130587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-95052fb0-e4c3-4131-ac60-f7f48c71416f tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:50.132416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-95052fb0-e4c3-4131-ac60-f7f48c71416f tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:50.141060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95052fb0-e4c3-4131-ac60-f7f48c71416f tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:50.141513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95052fb0-e4c3-4131-ac60-f7f48c71416f tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:50.142382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95052fb0-e4c3-4131-ac60-f7f48c71416f tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:50.142767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95052fb0-e4c3-4131-ac60-f7f48c71416f tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:50.162917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f7449b17-aaae-4b88-9eb8-67d295686bff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:50.173769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f7449b17-aaae-4b88-9eb8-67d295686bff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.196456 Aug 01 15:37:50.174777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 290/571] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:49 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:50.312415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-95052fb0-e4c3-4131-ac60-f7f48c71416f tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:50.320272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-95052fb0-e4c3-4131-ac60-f7f48c71416f tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.194591 Aug 01 15:37:50.320851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 282/572] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:50 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:50.811647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d945e90f-955a-4136-a5e7-7a18fade6e34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:50.813051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d945e90f-955a-4136-a5e7-7a18fade6e34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:50.819460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d945e90f-955a-4136-a5e7-7a18fade6e34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:50.819901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d945e90f-955a-4136-a5e7-7a18fade6e34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:50.820668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d945e90f-955a-4136-a5e7-7a18fade6e34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:50.821096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d945e90f-955a-4136-a5e7-7a18fade6e34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:50.998875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d945e90f-955a-4136-a5e7-7a18fade6e34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:51.008083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d945e90f-955a-4136-a5e7-7a18fade6e34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:51.009728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d945e90f-955a-4136-a5e7-7a18fade6e34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:51.011733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d945e90f-955a-4136-a5e7-7a18fade6e34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.203650 Aug 01 15:37:51.012332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 291/573] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:51.195620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b6868250-27f0-4f8a-9ccb-6c13b0a5f1dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:51.196259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b6868250-27f0-4f8a-9ccb-6c13b0a5f1dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:51.203614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6868250-27f0-4f8a-9ccb-6c13b0a5f1dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:51.204063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6868250-27f0-4f8a-9ccb-6c13b0a5f1dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:51.204833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6868250-27f0-4f8a-9ccb-6c13b0a5f1dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:51.205265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6868250-27f0-4f8a-9ccb-6c13b0a5f1dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:51.342177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7f51861b-8289-43e4-8a09-64d9bc8b5cff tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:51.342804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7f51861b-8289-43e4-8a09-64d9bc8b5cff tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:51.348411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b6868250-27f0-4f8a-9ccb-6c13b0a5f1dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:51.349039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f51861b-8289-43e4-8a09-64d9bc8b5cff tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:51.349497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f51861b-8289-43e4-8a09-64d9bc8b5cff tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:51.350305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f51861b-8289-43e4-8a09-64d9bc8b5cff tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:51.350750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f51861b-8289-43e4-8a09-64d9bc8b5cff tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:51.356379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b6868250-27f0-4f8a-9ccb-6c13b0a5f1dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.164800 Aug 01 15:37:51.356955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 283/574] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:51 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:51.504846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7f51861b-8289-43e4-8a09-64d9bc8b5cff tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:51.513638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7f51861b-8289-43e4-8a09-64d9bc8b5cff tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.176640 Aug 01 15:37:51.514558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 292/575] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:51 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:52.037426 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5ecfca5b-ee9b-4a45-ac55-cbb4ef34fe18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:52.038326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5ecfca5b-ee9b-4a45-ac55-cbb4ef34fe18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:52.045955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ecfca5b-ee9b-4a45-ac55-cbb4ef34fe18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:52.046419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ecfca5b-ee9b-4a45-ac55-cbb4ef34fe18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:52.047200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ecfca5b-ee9b-4a45-ac55-cbb4ef34fe18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:52.047649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ecfca5b-ee9b-4a45-ac55-cbb4ef34fe18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:52.256584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5ecfca5b-ee9b-4a45-ac55-cbb4ef34fe18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:52.266892 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5ecfca5b-ee9b-4a45-ac55-cbb4ef34fe18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:52.268341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5ecfca5b-ee9b-4a45-ac55-cbb4ef34fe18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:52.269561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5ecfca5b-ee9b-4a45-ac55-cbb4ef34fe18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.236924 Aug 01 15:37:52.270216 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 284/576] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:52.376930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-85222029-e133-45fb-b337-c9d16676199d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:52.377538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-85222029-e133-45fb-b337-c9d16676199d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:52.385164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85222029-e133-45fb-b337-c9d16676199d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:52.385615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85222029-e133-45fb-b337-c9d16676199d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:52.387186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85222029-e133-45fb-b337-c9d16676199d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:52.387622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85222029-e133-45fb-b337-c9d16676199d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:52.536255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a372f2ff-b574-489b-878b-861a5b768dab tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:52.536928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a372f2ff-b574-489b-878b-861a5b768dab tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:52.540276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-85222029-e133-45fb-b337-c9d16676199d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:52.550944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-85222029-e133-45fb-b337-c9d16676199d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.177765 Aug 01 15:37:52.560902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a372f2ff-b574-489b-878b-861a5b768dab tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:52.561356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a372f2ff-b574-489b-878b-861a5b768dab tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:52.562352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a372f2ff-b574-489b-878b-861a5b768dab tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:52.562942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a372f2ff-b574-489b-878b-861a5b768dab tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:52.564601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 293/577] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:52 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:52.708045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a372f2ff-b574-489b-878b-861a5b768dab tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:52.717543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a372f2ff-b574-489b-878b-861a5b768dab tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.185606 Aug 01 15:37:52.721973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 285/578] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:52 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:53.295364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-19f14217-a4a4-4d66-a8a9-aa517ef7e15e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:53.296276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-19f14217-a4a4-4d66-a8a9-aa517ef7e15e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:53.303615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19f14217-a4a4-4d66-a8a9-aa517ef7e15e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:53.304197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19f14217-a4a4-4d66-a8a9-aa517ef7e15e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:53.305254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19f14217-a4a4-4d66-a8a9-aa517ef7e15e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:53.305692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19f14217-a4a4-4d66-a8a9-aa517ef7e15e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:53.456378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-19f14217-a4a4-4d66-a8a9-aa517ef7e15e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:53.458827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:53.467236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-19f14217-a4a4-4d66-a8a9-aa517ef7e15e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:53.468741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-19f14217-a4a4-4d66-a8a9-aa517ef7e15e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:53.469880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-19f14217-a4a4-4d66-a8a9-aa517ef7e15e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.180096 Aug 01 15:37:53.470462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 294/579] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:53.572453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a029adcf-6f3d-4698-992c-16ab63298351 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:53.573855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a029adcf-6f3d-4698-992c-16ab63298351 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:53.576334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=87 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:37:53.582473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a029adcf-6f3d-4698-992c-16ab63298351 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:53.583181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a029adcf-6f3d-4698-992c-16ab63298351 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:53.584144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a029adcf-6f3d-4698-992c-16ab63298351 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:53.584581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a029adcf-6f3d-4698-992c-16ab63298351 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:53.731363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a029adcf-6f3d-4698-992c-16ab63298351 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:53.739354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a029adcf-6f3d-4698-992c-16ab63298351 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.170736 Aug 01 15:37:53.739802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 286/580] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:53 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:53.743577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3f4a647d-1353-48b0-9bdf-7fd5b289a564 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:53.744394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3f4a647d-1353-48b0-9bdf-7fd5b289a564 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:53.750697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f4a647d-1353-48b0-9bdf-7fd5b289a564 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:53.751220 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f4a647d-1353-48b0-9bdf-7fd5b289a564 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:53.752077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f4a647d-1353-48b0-9bdf-7fd5b289a564 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:53.752570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f4a647d-1353-48b0-9bdf-7fd5b289a564 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:53.893526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3f4a647d-1353-48b0-9bdf-7fd5b289a564 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:53.902892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3f4a647d-1353-48b0-9bdf-7fd5b289a564 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.163863 Aug 01 15:37:53.904346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 295/581] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:53 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:54.494797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1c700da8-4a3d-4ad7-9763-edddf46bd71d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:54.495412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1c700da8-4a3d-4ad7-9763-edddf46bd71d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:54.502362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c700da8-4a3d-4ad7-9763-edddf46bd71d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:54.502832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c700da8-4a3d-4ad7-9763-edddf46bd71d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:54.503605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c700da8-4a3d-4ad7-9763-edddf46bd71d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:54.504043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c700da8-4a3d-4ad7-9763-edddf46bd71d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:54.637008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c700da8-4a3d-4ad7-9763-edddf46bd71d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:54.645528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c700da8-4a3d-4ad7-9763-edddf46bd71d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:54.647076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c700da8-4a3d-4ad7-9763-edddf46bd71d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:54.648241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1c700da8-4a3d-4ad7-9763-edddf46bd71d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.157439 Aug 01 15:37:54.648800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 287/582] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:54.760627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f1c4818c-1d5d-4f33-9b53-d252da76ef8f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:54.761331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f1c4818c-1d5d-4f33-9b53-d252da76ef8f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:54.767829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1c4818c-1d5d-4f33-9b53-d252da76ef8f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:54.768281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1c4818c-1d5d-4f33-9b53-d252da76ef8f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:54.769055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1c4818c-1d5d-4f33-9b53-d252da76ef8f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:54.769496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1c4818c-1d5d-4f33-9b53-d252da76ef8f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:54.910451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f1c4818c-1d5d-4f33-9b53-d252da76ef8f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:54.919973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f1c4818c-1d5d-4f33-9b53-d252da76ef8f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.163458 Aug 01 15:37:54.920656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 296/583] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:54 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:54.926510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3bb0052c-2711-4a4e-9044-8fdf972c1c3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:54.927142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3bb0052c-2711-4a4e-9044-8fdf972c1c3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:54.938525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3bb0052c-2711-4a4e-9044-8fdf972c1c3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:54.938978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3bb0052c-2711-4a4e-9044-8fdf972c1c3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:54.939754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3bb0052c-2711-4a4e-9044-8fdf972c1c3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:54.940193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3bb0052c-2711-4a4e-9044-8fdf972c1c3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:55.074689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3bb0052c-2711-4a4e-9044-8fdf972c1c3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:55.082777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3bb0052c-2711-4a4e-9044-8fdf972c1c3c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.160217 Aug 01 15:37:55.083355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 288/584] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:54 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:55.672143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-84949a9c-dcf1-4c9a-a61a-9ac26cb568fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:55.672763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-84949a9c-dcf1-4c9a-a61a-9ac26cb568fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:55.679450 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84949a9c-dcf1-4c9a-a61a-9ac26cb568fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:55.679848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84949a9c-dcf1-4c9a-a61a-9ac26cb568fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:55.680620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84949a9c-dcf1-4c9a-a61a-9ac26cb568fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:55.681063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84949a9c-dcf1-4c9a-a61a-9ac26cb568fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:55.829926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-84949a9c-dcf1-4c9a-a61a-9ac26cb568fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:55.840992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-84949a9c-dcf1-4c9a-a61a-9ac26cb568fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:55.842532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-84949a9c-dcf1-4c9a-a61a-9ac26cb568fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:55.843885 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-84949a9c-dcf1-4c9a-a61a-9ac26cb568fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.176052 Aug 01 15:37:55.844444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 297/585] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:55.941933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e647fb3c-eca0-48b6-888d-594ac990d160 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:55.942516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e647fb3c-eca0-48b6-888d-594ac990d160 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:55.949692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e647fb3c-eca0-48b6-888d-594ac990d160 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:55.950165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e647fb3c-eca0-48b6-888d-594ac990d160 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:55.950936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e647fb3c-eca0-48b6-888d-594ac990d160 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:55.951371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e647fb3c-eca0-48b6-888d-594ac990d160 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:56.088871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e647fb3c-eca0-48b6-888d-594ac990d160 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:56.096674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e647fb3c-eca0-48b6-888d-594ac990d160 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.158638 Aug 01 15:37:56.097244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 289/586] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:55 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:56.104339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3b03adec-4748-40fb-b1e6-715d214c4885 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:56.106004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3b03adec-4748-40fb-b1e6-715d214c4885 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:56.112651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3b03adec-4748-40fb-b1e6-715d214c4885 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:56.113091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3b03adec-4748-40fb-b1e6-715d214c4885 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:56.113985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3b03adec-4748-40fb-b1e6-715d214c4885 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:56.114414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3b03adec-4748-40fb-b1e6-715d214c4885 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:56.254499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3b03adec-4748-40fb-b1e6-715d214c4885 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:56.261876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3b03adec-4748-40fb-b1e6-715d214c4885 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.161259 Aug 01 15:37:56.262458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 298/587] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:56 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:56.866472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1b24fd42-f1c6-4ed1-8a15-2fed6c495211 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:56.867106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1b24fd42-f1c6-4ed1-8a15-2fed6c495211 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:56.873147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b24fd42-f1c6-4ed1-8a15-2fed6c495211 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:56.873591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b24fd42-f1c6-4ed1-8a15-2fed6c495211 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:56.874423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b24fd42-f1c6-4ed1-8a15-2fed6c495211 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:56.874858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b24fd42-f1c6-4ed1-8a15-2fed6c495211 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:57.010869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1b24fd42-f1c6-4ed1-8a15-2fed6c495211 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:57.020105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1b24fd42-f1c6-4ed1-8a15-2fed6c495211 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:57.021616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1b24fd42-f1c6-4ed1-8a15-2fed6c495211 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:57.022807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1b24fd42-f1c6-4ed1-8a15-2fed6c495211 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.160282 Aug 01 15:37:57.023368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 290/588] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:57.118049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-330b7dca-ff21-4cb1-98d4-bc32f69f4142 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:57.118699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-330b7dca-ff21-4cb1-98d4-bc32f69f4142 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:57.125614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-330b7dca-ff21-4cb1-98d4-bc32f69f4142 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:57.126106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-330b7dca-ff21-4cb1-98d4-bc32f69f4142 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:57.126886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-330b7dca-ff21-4cb1-98d4-bc32f69f4142 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:57.127324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-330b7dca-ff21-4cb1-98d4-bc32f69f4142 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:57.263407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-330b7dca-ff21-4cb1-98d4-bc32f69f4142 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:57.271047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-330b7dca-ff21-4cb1-98d4-bc32f69f4142 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.156917 Aug 01 15:37:57.271620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 299/589] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:57 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:57.281544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2008be15-19a4-4686-9822-c259a20392bb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:57.282240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2008be15-19a4-4686-9822-c259a20392bb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:57.288566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2008be15-19a4-4686-9822-c259a20392bb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:57.289014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2008be15-19a4-4686-9822-c259a20392bb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:57.289770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2008be15-19a4-4686-9822-c259a20392bb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:57.290234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2008be15-19a4-4686-9822-c259a20392bb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:57.437686 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2008be15-19a4-4686-9822-c259a20392bb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:57.449614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2008be15-19a4-4686-9822-c259a20392bb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.171020 Aug 01 15:37:57.450590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 291/590] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:57 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:58.046919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b410c1b9-f238-4399-87f2-e298f6e77914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:58.047438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b410c1b9-f238-4399-87f2-e298f6e77914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:58.053876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b410c1b9-f238-4399-87f2-e298f6e77914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:58.054340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b410c1b9-f238-4399-87f2-e298f6e77914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:58.055104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b410c1b9-f238-4399-87f2-e298f6e77914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:58.055529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b410c1b9-f238-4399-87f2-e298f6e77914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:58.191143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b410c1b9-f238-4399-87f2-e298f6e77914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:58.200336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b410c1b9-f238-4399-87f2-e298f6e77914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:58.201875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b410c1b9-f238-4399-87f2-e298f6e77914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:58.203076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b410c1b9-f238-4399-87f2-e298f6e77914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.160801 Aug 01 15:37:58.203631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 300/591] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:58.292401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d8c3c301-3a6b-41d9-ac18-6b4f6118b984 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:58.293030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d8c3c301-3a6b-41d9-ac18-6b4f6118b984 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:58.300379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d8c3c301-3a6b-41d9-ac18-6b4f6118b984 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:58.300756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d8c3c301-3a6b-41d9-ac18-6b4f6118b984 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:58.301539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d8c3c301-3a6b-41d9-ac18-6b4f6118b984 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:58.302002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d8c3c301-3a6b-41d9-ac18-6b4f6118b984 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:58.443711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d8c3c301-3a6b-41d9-ac18-6b4f6118b984 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:58.451827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d8c3c301-3a6b-41d9-ac18-6b4f6118b984 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.163414 Aug 01 15:37:58.452393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 292/592] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:58 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:58.472584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-23ebe81b-109f-49e8-83d2-6496b860e6b4 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:58.473194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-23ebe81b-109f-49e8-83d2-6496b860e6b4 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:58.479323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23ebe81b-109f-49e8-83d2-6496b860e6b4 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:58.479846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23ebe81b-109f-49e8-83d2-6496b860e6b4 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:58.480580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23ebe81b-109f-49e8-83d2-6496b860e6b4 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:58.480996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23ebe81b-109f-49e8-83d2-6496b860e6b4 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:58.619451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-23ebe81b-109f-49e8-83d2-6496b860e6b4 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:58.633401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-23ebe81b-109f-49e8-83d2-6496b860e6b4 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.164545 Aug 01 15:37:58.634008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 301/593] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:58 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:37:59.226644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-be7cc752-309b-4a15-9f73-d81e8654b221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:59.227281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-be7cc752-309b-4a15-9f73-d81e8654b221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:59.234074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-be7cc752-309b-4a15-9f73-d81e8654b221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:59.234518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-be7cc752-309b-4a15-9f73-d81e8654b221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:59.235282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-be7cc752-309b-4a15-9f73-d81e8654b221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:59.235710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-be7cc752-309b-4a15-9f73-d81e8654b221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:59.364790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-be7cc752-309b-4a15-9f73-d81e8654b221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:59.373877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-be7cc752-309b-4a15-9f73-d81e8654b221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:59.375378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-be7cc752-309b-4a15-9f73-d81e8654b221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:59.376523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-be7cc752-309b-4a15-9f73-d81e8654b221 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.153836 Aug 01 15:37:59.377072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 293/594] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:37:59 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:37:59.472607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-20ed033d-25ba-4cce-9955-9bc10bc61c51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:59.473221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-20ed033d-25ba-4cce-9955-9bc10bc61c51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:59.480537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-20ed033d-25ba-4cce-9955-9bc10bc61c51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:59.481076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-20ed033d-25ba-4cce-9955-9bc10bc61c51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:59.481855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-20ed033d-25ba-4cce-9955-9bc10bc61c51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:59.482316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-20ed033d-25ba-4cce-9955-9bc10bc61c51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:59.569659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7b967adc-ded2-450d-bf6f-a76727c8dd5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:59.570293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7b967adc-ded2-450d-bf6f-a76727c8dd5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:59.590258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7b967adc-ded2-450d-bf6f-a76727c8dd5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:59.591001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7b967adc-ded2-450d-bf6f-a76727c8dd5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:59.594096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7b967adc-ded2-450d-bf6f-a76727c8dd5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:59.595027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7b967adc-ded2-450d-bf6f-a76727c8dd5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:59.628908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-20ed033d-25ba-4cce-9955-9bc10bc61c51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:59.639407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-20ed033d-25ba-4cce-9955-9bc10bc61c51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.170485 Aug 01 15:37:59.640099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 302/595] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:59 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:37:59.656290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4e851e04-16b4-4ed2-bdef-1473931de2b5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:37:59.657197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4e851e04-16b4-4ed2-bdef-1473931de2b5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:37:59.663411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e851e04-16b4-4ed2-bdef-1473931de2b5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:59.663899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e851e04-16b4-4ed2-bdef-1473931de2b5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:59.664672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e851e04-16b4-4ed2-bdef-1473931de2b5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:37:59.665107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e851e04-16b4-4ed2-bdef-1473931de2b5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:37:59.687465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-7b967adc-ded2-450d-bf6f-a76727c8dd5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lazy-loading 'services' on Instance uuid c377fe1d-1c49-46de-87e3-4a70f1253e63 {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:37:59.775359 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7b967adc-ded2-450d-bf6f-a76727c8dd5a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments/fc44b8e2-1395-40e5-8b00-562391bb4313" status: 202 len: 0 microversion: 2.1 time: 0.210533 Aug 01 15:37:59.775994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 294/596] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 1 15:37:59 2022] DELETE /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments/fc44b8e2-1395-40e5-8b00-562391bb4313 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:37:59.828788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4e851e04-16b4-4ed2-bdef-1473931de2b5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:37:59.837066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4e851e04-16b4-4ed2-bdef-1473931de2b5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.185095 Aug 01 15:37:59.837656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 303/597] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:37:59 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:00.402504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ee1fad1a-d149-49d0-b17f-da6510aa16ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:00.403344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ee1fad1a-d149-49d0-b17f-da6510aa16ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:00.410943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ee1fad1a-d149-49d0-b17f-da6510aa16ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:00.411544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ee1fad1a-d149-49d0-b17f-da6510aa16ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:00.412359 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ee1fad1a-d149-49d0-b17f-da6510aa16ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:00.412797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ee1fad1a-d149-49d0-b17f-da6510aa16ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:00.562517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ee1fad1a-d149-49d0-b17f-da6510aa16ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:00.571419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ee1fad1a-d149-49d0-b17f-da6510aa16ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:00.572929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ee1fad1a-d149-49d0-b17f-da6510aa16ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:00.574643 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ee1fad1a-d149-49d0-b17f-da6510aa16ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.178911 Aug 01 15:38:00.575197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 295/598] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:00.663433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-79a2e91b-3fd3-4e1f-b2c7-b4c0e4551057 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:00.664307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-79a2e91b-3fd3-4e1f-b2c7-b4c0e4551057 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:00.672145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-79a2e91b-3fd3-4e1f-b2c7-b4c0e4551057 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:00.672832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-79a2e91b-3fd3-4e1f-b2c7-b4c0e4551057 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:00.673726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-79a2e91b-3fd3-4e1f-b2c7-b4c0e4551057 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:00.674278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-79a2e91b-3fd3-4e1f-b2c7-b4c0e4551057 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:00.825711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-79a2e91b-3fd3-4e1f-b2c7-b4c0e4551057 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:00.834155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-79a2e91b-3fd3-4e1f-b2c7-b4c0e4551057 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.176579 Aug 01 15:38:00.834749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 304/599] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:00 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:00.858551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-62dc99fc-fbef-4dca-803f-ce51d3773bd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:00.859185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-62dc99fc-fbef-4dca-803f-ce51d3773bd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:00.865304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62dc99fc-fbef-4dca-803f-ce51d3773bd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:00.865757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62dc99fc-fbef-4dca-803f-ce51d3773bd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:00.866558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62dc99fc-fbef-4dca-803f-ce51d3773bd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:00.866993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62dc99fc-fbef-4dca-803f-ce51d3773bd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:00.889409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:01.025716 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-62dc99fc-fbef-4dca-803f-ce51d3773bd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:01.035954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-62dc99fc-fbef-4dca-803f-ce51d3773bd1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.181129 Aug 01 15:38:01.036539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 296/600] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:00 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:01.597833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b427ddfc-6117-47bd-ac23-72beb36e70f0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:01.598593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b427ddfc-6117-47bd-ac23-72beb36e70f0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:01.605365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b427ddfc-6117-47bd-ac23-72beb36e70f0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:01.605819 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b427ddfc-6117-47bd-ac23-72beb36e70f0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:01.606633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b427ddfc-6117-47bd-ac23-72beb36e70f0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:01.607066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b427ddfc-6117-47bd-ac23-72beb36e70f0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:01.764374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b427ddfc-6117-47bd-ac23-72beb36e70f0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:01.776332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b427ddfc-6117-47bd-ac23-72beb36e70f0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:01.778377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b427ddfc-6117-47bd-ac23-72beb36e70f0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:01.779556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b427ddfc-6117-47bd-ac23-72beb36e70f0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.185952 Aug 01 15:38:01.780396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 305/601] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:01.858481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9365ecb8-7333-441a-bfc2-9367298388a4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:01.859138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9365ecb8-7333-441a-bfc2-9367298388a4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:01.865718 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9365ecb8-7333-441a-bfc2-9367298388a4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:01.866189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9365ecb8-7333-441a-bfc2-9367298388a4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:01.866949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9365ecb8-7333-441a-bfc2-9367298388a4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:01.867377 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9365ecb8-7333-441a-bfc2-9367298388a4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:02.010566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9365ecb8-7333-441a-bfc2-9367298388a4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:02.018310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9365ecb8-7333-441a-bfc2-9367298388a4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.164360 Aug 01 15:38:02.018884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 297/602] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:01 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:02.056653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c8928cc6-2963-475a-a335-88bb93e0f445 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:02.057274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c8928cc6-2963-475a-a335-88bb93e0f445 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:02.063473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c8928cc6-2963-475a-a335-88bb93e0f445 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:02.063924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c8928cc6-2963-475a-a335-88bb93e0f445 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:02.064696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c8928cc6-2963-475a-a335-88bb93e0f445 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:02.065133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c8928cc6-2963-475a-a335-88bb93e0f445 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:02.210974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c8928cc6-2963-475a-a335-88bb93e0f445 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:02.219710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c8928cc6-2963-475a-a335-88bb93e0f445 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.166864 Aug 01 15:38:02.220288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 306/603] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:02 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:02.807000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0950018b-69f6-401d-9d03-2879d887ce41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:02.807610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0950018b-69f6-401d-9d03-2879d887ce41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:02.814312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0950018b-69f6-401d-9d03-2879d887ce41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:02.814762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0950018b-69f6-401d-9d03-2879d887ce41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:02.815526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0950018b-69f6-401d-9d03-2879d887ce41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:02.815962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0950018b-69f6-401d-9d03-2879d887ce41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:02.951877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0950018b-69f6-401d-9d03-2879d887ce41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:02.961585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0950018b-69f6-401d-9d03-2879d887ce41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:02.963145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0950018b-69f6-401d-9d03-2879d887ce41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:02.965340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0950018b-69f6-401d-9d03-2879d887ce41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.162151 Aug 01 15:38:02.973344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 298/604] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:03.043317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-91b99703-fc99-40d9-a5e8-0d30ee9a6221 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:03.044656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-91b99703-fc99-40d9-a5e8-0d30ee9a6221 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:03.055861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91b99703-fc99-40d9-a5e8-0d30ee9a6221 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:03.059615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91b99703-fc99-40d9-a5e8-0d30ee9a6221 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:03.064267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91b99703-fc99-40d9-a5e8-0d30ee9a6221 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:03.066054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91b99703-fc99-40d9-a5e8-0d30ee9a6221 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:03.239889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-91b99703-fc99-40d9-a5e8-0d30ee9a6221 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:03.242227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4e0971e5-bee4-421d-b258-1b2476866a24 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:03.242846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4e0971e5-bee4-421d-b258-1b2476866a24 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:03.248749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-91b99703-fc99-40d9-a5e8-0d30ee9a6221 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.212438 Aug 01 15:38:03.250869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e0971e5-bee4-421d-b258-1b2476866a24 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:03.251321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e0971e5-bee4-421d-b258-1b2476866a24 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:03.252096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e0971e5-bee4-421d-b258-1b2476866a24 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:03.252532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e0971e5-bee4-421d-b258-1b2476866a24 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:03.258446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 307/605] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:03 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:03.396401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4e0971e5-bee4-421d-b258-1b2476866a24 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:03.404767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4e0971e5-bee4-421d-b258-1b2476866a24 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.168351 Aug 01 15:38:03.405442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 299/606] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:03 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:03.988759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-41aa316d-6735-45f9-acb4-b52dc4b39036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:03.990489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-41aa316d-6735-45f9-acb4-b52dc4b39036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:03.997474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41aa316d-6735-45f9-acb4-b52dc4b39036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:03.997950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41aa316d-6735-45f9-acb4-b52dc4b39036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:03.998793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41aa316d-6735-45f9-acb4-b52dc4b39036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:03.999121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41aa316d-6735-45f9-acb4-b52dc4b39036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:04.149604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-41aa316d-6735-45f9-acb4-b52dc4b39036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:04.158150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-41aa316d-6735-45f9-acb4-b52dc4b39036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:04.159759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-41aa316d-6735-45f9-acb4-b52dc4b39036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:04.161065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-41aa316d-6735-45f9-acb4-b52dc4b39036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.176244 Aug 01 15:38:04.161620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 308/607] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:04.270076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b536808b-e4ba-4c96-b2ad-959c614eb060 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:04.270711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b536808b-e4ba-4c96-b2ad-959c614eb060 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:04.277467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b536808b-e4ba-4c96-b2ad-959c614eb060 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:04.278017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b536808b-e4ba-4c96-b2ad-959c614eb060 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:04.278851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b536808b-e4ba-4c96-b2ad-959c614eb060 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:04.279349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b536808b-e4ba-4c96-b2ad-959c614eb060 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:04.421474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b536808b-e4ba-4c96-b2ad-959c614eb060 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:04.425924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-78c277f7-552d-40d4-8f33-90107657bca8 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:04.426751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-78c277f7-552d-40d4-8f33-90107657bca8 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:04.429865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b536808b-e4ba-4c96-b2ad-959c614eb060 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.163507 Aug 01 15:38:04.430558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 300/608] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:04 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:04.434187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78c277f7-552d-40d4-8f33-90107657bca8 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:04.434643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78c277f7-552d-40d4-8f33-90107657bca8 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:04.435420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78c277f7-552d-40d4-8f33-90107657bca8 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:04.435854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78c277f7-552d-40d4-8f33-90107657bca8 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:04.570963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-78c277f7-552d-40d4-8f33-90107657bca8 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:04.578454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-78c277f7-552d-40d4-8f33-90107657bca8 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.156361 Aug 01 15:38:04.579019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 309/609] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:04 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:05.185112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9c4efc0b-6f4d-448f-b84b-ffe5e14ceb7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:05.185720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9c4efc0b-6f4d-448f-b84b-ffe5e14ceb7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:05.193547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c4efc0b-6f4d-448f-b84b-ffe5e14ceb7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:05.194170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c4efc0b-6f4d-448f-b84b-ffe5e14ceb7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:05.194972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c4efc0b-6f4d-448f-b84b-ffe5e14ceb7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:05.195411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c4efc0b-6f4d-448f-b84b-ffe5e14ceb7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:05.327940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9c4efc0b-6f4d-448f-b84b-ffe5e14ceb7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:05.336361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9c4efc0b-6f4d-448f-b84b-ffe5e14ceb7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:05.337910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9c4efc0b-6f4d-448f-b84b-ffe5e14ceb7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:05.339338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9c4efc0b-6f4d-448f-b84b-ffe5e14ceb7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.158836 Aug 01 15:38:05.339895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 301/610] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:05.452219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-06270564-7fed-4d73-b173-259c0c9c36a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:05.452837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-06270564-7fed-4d73-b173-259c0c9c36a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:05.459503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06270564-7fed-4d73-b173-259c0c9c36a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:05.459948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06270564-7fed-4d73-b173-259c0c9c36a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:05.460714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06270564-7fed-4d73-b173-259c0c9c36a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:05.461155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06270564-7fed-4d73-b173-259c0c9c36a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:05.593411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-06270564-7fed-4d73-b173-259c0c9c36a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:05.599766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ed3cc1c8-70ae-4899-9776-2ea937c3ef0a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:05.600550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ed3cc1c8-70ae-4899-9776-2ea937c3ef0a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:05.600972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-06270564-7fed-4d73-b173-259c0c9c36a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.152661 Aug 01 15:38:05.601541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 310/611] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:05 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:05.607329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed3cc1c8-70ae-4899-9776-2ea937c3ef0a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:05.607781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed3cc1c8-70ae-4899-9776-2ea937c3ef0a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:05.608555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed3cc1c8-70ae-4899-9776-2ea937c3ef0a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:05.608990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed3cc1c8-70ae-4899-9776-2ea937c3ef0a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:05.740850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ed3cc1c8-70ae-4899-9776-2ea937c3ef0a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:05.748404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ed3cc1c8-70ae-4899-9776-2ea937c3ef0a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.152403 Aug 01 15:38:05.748975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 302/612] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:05 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:06.362816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-48de3bcc-9033-4fd7-b441-5978b9902489 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:06.363345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-48de3bcc-9033-4fd7-b441-5978b9902489 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:06.369672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48de3bcc-9033-4fd7-b441-5978b9902489 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:06.370161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48de3bcc-9033-4fd7-b441-5978b9902489 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:06.370925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48de3bcc-9033-4fd7-b441-5978b9902489 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:06.371362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48de3bcc-9033-4fd7-b441-5978b9902489 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:06.386138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:06.503890 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48de3bcc-9033-4fd7-b441-5978b9902489 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:06.512244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48de3bcc-9033-4fd7-b441-5978b9902489 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:06.513754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48de3bcc-9033-4fd7-b441-5978b9902489 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:06.514956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-48de3bcc-9033-4fd7-b441-5978b9902489 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.156427 Aug 01 15:38:06.515515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 311/613] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:06.622192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2273bf98-59d7-4f11-a932-21ecf401555b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:06.622803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2273bf98-59d7-4f11-a932-21ecf401555b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:06.629211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2273bf98-59d7-4f11-a932-21ecf401555b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:06.629654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2273bf98-59d7-4f11-a932-21ecf401555b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:06.630438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2273bf98-59d7-4f11-a932-21ecf401555b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:06.630868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2273bf98-59d7-4f11-a932-21ecf401555b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:06.770383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7904a099-3dfe-4f13-a3e3-a0bcc3b521bf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:06.771057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7904a099-3dfe-4f13-a3e3-a0bcc3b521bf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:06.777959 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7904a099-3dfe-4f13-a3e3-a0bcc3b521bf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:06.778404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7904a099-3dfe-4f13-a3e3-a0bcc3b521bf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:06.779354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7904a099-3dfe-4f13-a3e3-a0bcc3b521bf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:06.779618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7904a099-3dfe-4f13-a3e3-a0bcc3b521bf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:06.781756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2273bf98-59d7-4f11-a932-21ecf401555b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:06.789211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2273bf98-59d7-4f11-a932-21ecf401555b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.170860 Aug 01 15:38:06.789779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 303/614] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:06 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:06.912893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7904a099-3dfe-4f13-a3e3-a0bcc3b521bf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:06.920231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7904a099-3dfe-4f13-a3e3-a0bcc3b521bf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.154201 Aug 01 15:38:06.920796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 312/615] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:06 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:07.538609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5b733c42-8186-4b71-bb3c-16e815f4cffd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:07.539138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5b733c42-8186-4b71-bb3c-16e815f4cffd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:07.545447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b733c42-8186-4b71-bb3c-16e815f4cffd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:07.545915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b733c42-8186-4b71-bb3c-16e815f4cffd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:07.546666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b733c42-8186-4b71-bb3c-16e815f4cffd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:07.547094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b733c42-8186-4b71-bb3c-16e815f4cffd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:07.694807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5b733c42-8186-4b71-bb3c-16e815f4cffd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:07.704098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5b733c42-8186-4b71-bb3c-16e815f4cffd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:07.705586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5b733c42-8186-4b71-bb3c-16e815f4cffd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:07.706776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5b733c42-8186-4b71-bb3c-16e815f4cffd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.172244 Aug 01 15:38:07.707334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 304/616] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:07 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:07.810506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5b057425-fd01-4348-814f-5ec6c602bfad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:07.811123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5b057425-fd01-4348-814f-5ec6c602bfad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:07.817534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b057425-fd01-4348-814f-5ec6c602bfad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:07.818017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b057425-fd01-4348-814f-5ec6c602bfad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:07.818768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b057425-fd01-4348-814f-5ec6c602bfad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:07.819195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b057425-fd01-4348-814f-5ec6c602bfad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:07.941289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-04d52572-f08c-47d3-a9b6-4af3a3a6bec7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:07.942033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-04d52572-f08c-47d3-a9b6-4af3a3a6bec7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:07.951679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04d52572-f08c-47d3-a9b6-4af3a3a6bec7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:07.951679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04d52572-f08c-47d3-a9b6-4af3a3a6bec7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:07.952223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04d52572-f08c-47d3-a9b6-4af3a3a6bec7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:07.952663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04d52572-f08c-47d3-a9b6-4af3a3a6bec7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:07.962059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5b057425-fd01-4348-814f-5ec6c602bfad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:07.969996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5b057425-fd01-4348-814f-5ec6c602bfad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.164011 Aug 01 15:38:07.970781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 313/617] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:07 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:08.087183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-04d52572-f08c-47d3-a9b6-4af3a3a6bec7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:08.095435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-04d52572-f08c-47d3-a9b6-4af3a3a6bec7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.158458 Aug 01 15:38:08.095994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 305/618] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:07 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:08.730622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-29f1d2fe-1cf3-4bf3-a96d-e5ed8b01dfcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:08.731238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-29f1d2fe-1cf3-4bf3-a96d-e5ed8b01dfcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:08.737324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29f1d2fe-1cf3-4bf3-a96d-e5ed8b01dfcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:08.737767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29f1d2fe-1cf3-4bf3-a96d-e5ed8b01dfcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:08.738572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29f1d2fe-1cf3-4bf3-a96d-e5ed8b01dfcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:08.739005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29f1d2fe-1cf3-4bf3-a96d-e5ed8b01dfcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:08.866020 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-29f1d2fe-1cf3-4bf3-a96d-e5ed8b01dfcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:08.874574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-29f1d2fe-1cf3-4bf3-a96d-e5ed8b01dfcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:08.876080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-29f1d2fe-1cf3-4bf3-a96d-e5ed8b01dfcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:08.877245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-29f1d2fe-1cf3-4bf3-a96d-e5ed8b01dfcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.151381 Aug 01 15:38:08.877803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 314/619] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:08.991030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8ad7f6ab-cecd-4da7-acad-b8bb6de8ffc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:08.991648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8ad7f6ab-cecd-4da7-acad-b8bb6de8ffc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:08.998500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ad7f6ab-cecd-4da7-acad-b8bb6de8ffc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:08.998952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ad7f6ab-cecd-4da7-acad-b8bb6de8ffc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:08.999719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ad7f6ab-cecd-4da7-acad-b8bb6de8ffc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:09.000160 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ad7f6ab-cecd-4da7-acad-b8bb6de8ffc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:09.116604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1e5cdab9-2046-45ca-a6ff-95461213faad tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:09.117232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1e5cdab9-2046-45ca-a6ff-95461213faad tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:09.123427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e5cdab9-2046-45ca-a6ff-95461213faad tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:09.123882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e5cdab9-2046-45ca-a6ff-95461213faad tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:09.124690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e5cdab9-2046-45ca-a6ff-95461213faad tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:09.125130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e5cdab9-2046-45ca-a6ff-95461213faad tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:09.134071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8ad7f6ab-cecd-4da7-acad-b8bb6de8ffc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:09.142087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8ad7f6ab-cecd-4da7-acad-b8bb6de8ffc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.154863 Aug 01 15:38:09.142658 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 306/620] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:08 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:09.254085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1e5cdab9-2046-45ca-a6ff-95461213faad tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:09.261581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1e5cdab9-2046-45ca-a6ff-95461213faad tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.148858 Aug 01 15:38:09.262181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 315/621] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:09 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:09.900650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-001b987f-80cf-429e-888c-fb67a353cde0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:09.901166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-001b987f-80cf-429e-888c-fb67a353cde0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:09.907934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-001b987f-80cf-429e-888c-fb67a353cde0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:09.908378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-001b987f-80cf-429e-888c-fb67a353cde0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:09.909159 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-001b987f-80cf-429e-888c-fb67a353cde0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:09.909595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-001b987f-80cf-429e-888c-fb67a353cde0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:10.046632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-001b987f-80cf-429e-888c-fb67a353cde0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:10.055545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-001b987f-80cf-429e-888c-fb67a353cde0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:10.057040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-001b987f-80cf-429e-888c-fb67a353cde0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:10.058469 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-001b987f-80cf-429e-888c-fb67a353cde0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.161994 Aug 01 15:38:10.059022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 307/622] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:10.162875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-06e319ba-b38c-47c5-8271-250212e84c3b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:10.163436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-06e319ba-b38c-47c5-8271-250212e84c3b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:10.170840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06e319ba-b38c-47c5-8271-250212e84c3b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:10.171318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06e319ba-b38c-47c5-8271-250212e84c3b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:10.172067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06e319ba-b38c-47c5-8271-250212e84c3b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:10.172503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06e319ba-b38c-47c5-8271-250212e84c3b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:10.282346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2a022823-2405-48ef-acd0-cce77c515066 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:10.283113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2a022823-2405-48ef-acd0-cce77c515066 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:10.288998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a022823-2405-48ef-acd0-cce77c515066 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:10.289441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a022823-2405-48ef-acd0-cce77c515066 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:10.290228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a022823-2405-48ef-acd0-cce77c515066 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:10.290659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a022823-2405-48ef-acd0-cce77c515066 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:10.304948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-06e319ba-b38c-47c5-8271-250212e84c3b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:10.312519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-06e319ba-b38c-47c5-8271-250212e84c3b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.153527 Aug 01 15:38:10.313097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 316/623] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:10 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:10.431553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2a022823-2405-48ef-acd0-cce77c515066 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:10.439420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2a022823-2405-48ef-acd0-cce77c515066 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.160796 Aug 01 15:38:10.441459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 308/624] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:10 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:11.080935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8f8d1a83-a4bb-458b-aed0-ab03157e48dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:11.081548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8f8d1a83-a4bb-458b-aed0-ab03157e48dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:11.087859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f8d1a83-a4bb-458b-aed0-ab03157e48dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:11.088307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f8d1a83-a4bb-458b-aed0-ab03157e48dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:11.089434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f8d1a83-a4bb-458b-aed0-ab03157e48dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:11.089874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f8d1a83-a4bb-458b-aed0-ab03157e48dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:11.225917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f8d1a83-a4bb-458b-aed0-ab03157e48dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:11.234920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f8d1a83-a4bb-458b-aed0-ab03157e48dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:11.236426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f8d1a83-a4bb-458b-aed0-ab03157e48dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:11.237597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8f8d1a83-a4bb-458b-aed0-ab03157e48dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.160639 Aug 01 15:38:11.238191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 317/625] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:11 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:11.334544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8cbcf32e-1d29-4423-b153-62b02c864900 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:11.335161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8cbcf32e-1d29-4423-b153-62b02c864900 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:11.342000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8cbcf32e-1d29-4423-b153-62b02c864900 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:11.342587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8cbcf32e-1d29-4423-b153-62b02c864900 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:11.343235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8cbcf32e-1d29-4423-b153-62b02c864900 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:11.343677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8cbcf32e-1d29-4423-b153-62b02c864900 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:11.461669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3c7b0470-6685-48db-b91e-1d050f38fecb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:11.462348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3c7b0470-6685-48db-b91e-1d050f38fecb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:11.471045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3c7b0470-6685-48db-b91e-1d050f38fecb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:11.471907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3c7b0470-6685-48db-b91e-1d050f38fecb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:11.473152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3c7b0470-6685-48db-b91e-1d050f38fecb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:11.473530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3c7b0470-6685-48db-b91e-1d050f38fecb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:11.479470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8cbcf32e-1d29-4423-b153-62b02c864900 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:11.487866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8cbcf32e-1d29-4423-b153-62b02c864900 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.157627 Aug 01 15:38:11.488647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 309/626] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:11 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:11.626917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3c7b0470-6685-48db-b91e-1d050f38fecb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:11.642195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3c7b0470-6685-48db-b91e-1d050f38fecb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.184327 Aug 01 15:38:11.642787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 318/627] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:11 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:12.260524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9a5a9112-4d90-4040-9705-49c030732124 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:12.261176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9a5a9112-4d90-4040-9705-49c030732124 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:12.267881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9a5a9112-4d90-4040-9705-49c030732124 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:12.268328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9a5a9112-4d90-4040-9705-49c030732124 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:12.269298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9a5a9112-4d90-4040-9705-49c030732124 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:12.269964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9a5a9112-4d90-4040-9705-49c030732124 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:12.433135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9a5a9112-4d90-4040-9705-49c030732124 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:12.442432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9a5a9112-4d90-4040-9705-49c030732124 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:12.443948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9a5a9112-4d90-4040-9705-49c030732124 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:12.445134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9a5a9112-4d90-4040-9705-49c030732124 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.188616 Aug 01 15:38:12.445689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 310/628] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:12.512703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-da202090-0d83-43b4-bc75-c0d3c77ad035 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:12.513862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-da202090-0d83-43b4-bc75-c0d3c77ad035 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:12.517932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=80 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:12.527388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da202090-0d83-43b4-bc75-c0d3c77ad035 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:12.528104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da202090-0d83-43b4-bc75-c0d3c77ad035 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:12.529299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da202090-0d83-43b4-bc75-c0d3c77ad035 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:12.529867 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da202090-0d83-43b4-bc75-c0d3c77ad035 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:12.662129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bbc3c320-baa3-4c0e-8ca9-41c2a8091bec tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:12.662776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bbc3c320-baa3-4c0e-8ca9-41c2a8091bec tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:12.669470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bbc3c320-baa3-4c0e-8ca9-41c2a8091bec tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:12.669943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bbc3c320-baa3-4c0e-8ca9-41c2a8091bec tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:12.670737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bbc3c320-baa3-4c0e-8ca9-41c2a8091bec tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:12.671180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bbc3c320-baa3-4c0e-8ca9-41c2a8091bec tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:12.679265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-da202090-0d83-43b4-bc75-c0d3c77ad035 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:12.698634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-da202090-0d83-43b4-bc75-c0d3c77ad035 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.180605 Aug 01 15:38:12.699282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 319/629] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:12 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:12.821361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bbc3c320-baa3-4c0e-8ca9-41c2a8091bec tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:12.829349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bbc3c320-baa3-4c0e-8ca9-41c2a8091bec tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.171064 Aug 01 15:38:12.829968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 311/630] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:12 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:13.469755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7920e6a0-6622-4639-888f-5777269df9ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:13.470392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7920e6a0-6622-4639-888f-5777269df9ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:13.476516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7920e6a0-6622-4639-888f-5777269df9ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:13.476967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7920e6a0-6622-4639-888f-5777269df9ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:13.477734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7920e6a0-6622-4639-888f-5777269df9ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:13.478219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7920e6a0-6622-4639-888f-5777269df9ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:13.609205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7920e6a0-6622-4639-888f-5777269df9ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:13.617793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7920e6a0-6622-4639-888f-5777269df9ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:13.619332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7920e6a0-6622-4639-888f-5777269df9ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:13.620507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7920e6a0-6622-4639-888f-5777269df9ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.154673 Aug 01 15:38:13.621070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 320/631] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:13.721329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e3d5c81f-3f3b-4660-ab8a-d78c5a9966d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:13.721916 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e3d5c81f-3f3b-4660-ab8a-d78c5a9966d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:13.729445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e3d5c81f-3f3b-4660-ab8a-d78c5a9966d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:13.734181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e3d5c81f-3f3b-4660-ab8a-d78c5a9966d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:13.735019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e3d5c81f-3f3b-4660-ab8a-d78c5a9966d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:13.735466 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e3d5c81f-3f3b-4660-ab8a-d78c5a9966d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:13.850417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a04c7499-70b9-4fe4-ac2b-7df28ed6fbda tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:13.851130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a04c7499-70b9-4fe4-ac2b-7df28ed6fbda tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:13.858093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a04c7499-70b9-4fe4-ac2b-7df28ed6fbda tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:13.858632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a04c7499-70b9-4fe4-ac2b-7df28ed6fbda tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:13.859488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a04c7499-70b9-4fe4-ac2b-7df28ed6fbda tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:13.860055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a04c7499-70b9-4fe4-ac2b-7df28ed6fbda tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:13.895156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e3d5c81f-3f3b-4660-ab8a-d78c5a9966d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:13.906953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e3d5c81f-3f3b-4660-ab8a-d78c5a9966d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.189451 Aug 01 15:38:13.907543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 312/632] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:13 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:13.994299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a04c7499-70b9-4fe4-ac2b-7df28ed6fbda tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:14.002715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a04c7499-70b9-4fe4-ac2b-7df28ed6fbda tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.156045 Aug 01 15:38:14.003298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 321/633] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:13 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:14.644479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ef86054a-4011-4754-87d3-62ac02094a8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:14.645108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ef86054a-4011-4754-87d3-62ac02094a8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:14.651444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef86054a-4011-4754-87d3-62ac02094a8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:14.651880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef86054a-4011-4754-87d3-62ac02094a8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:14.652652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef86054a-4011-4754-87d3-62ac02094a8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:14.653090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef86054a-4011-4754-87d3-62ac02094a8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:14.657453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:14.790463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ef86054a-4011-4754-87d3-62ac02094a8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:14.798867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ef86054a-4011-4754-87d3-62ac02094a8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:14.800440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ef86054a-4011-4754-87d3-62ac02094a8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:14.801582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ef86054a-4011-4754-87d3-62ac02094a8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.161098 Aug 01 15:38:14.802431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 313/634] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:14.928408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-667bf9bc-4352-4418-83c2-42c2112bcaf2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:14.928998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-667bf9bc-4352-4418-83c2-42c2112bcaf2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:14.936280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-667bf9bc-4352-4418-83c2-42c2112bcaf2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:14.936734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-667bf9bc-4352-4418-83c2-42c2112bcaf2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:14.937604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-667bf9bc-4352-4418-83c2-42c2112bcaf2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:14.938144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-667bf9bc-4352-4418-83c2-42c2112bcaf2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:15.023638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1c104390-4a0d-4c7c-9cb0-ff4b09fa1012 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:15.024247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1c104390-4a0d-4c7c-9cb0-ff4b09fa1012 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:15.031146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c104390-4a0d-4c7c-9cb0-ff4b09fa1012 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:15.031594 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c104390-4a0d-4c7c-9cb0-ff4b09fa1012 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:15.032368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c104390-4a0d-4c7c-9cb0-ff4b09fa1012 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:15.032799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c104390-4a0d-4c7c-9cb0-ff4b09fa1012 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:15.081226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-667bf9bc-4352-4418-83c2-42c2112bcaf2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:15.090282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-667bf9bc-4352-4418-83c2-42c2112bcaf2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.165074 Aug 01 15:38:15.090860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 322/635] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:14 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:15.169000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c104390-4a0d-4c7c-9cb0-ff4b09fa1012 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:15.176410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1c104390-4a0d-4c7c-9cb0-ff4b09fa1012 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.156912 Aug 01 15:38:15.177033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 314/636] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:15 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:15.825115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-75167d03-8549-45db-8d55-a2d735ddfc62 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:15.825297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-75167d03-8549-45db-8d55-a2d735ddfc62 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:15.833181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75167d03-8549-45db-8d55-a2d735ddfc62 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:15.833634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75167d03-8549-45db-8d55-a2d735ddfc62 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:15.834441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75167d03-8549-45db-8d55-a2d735ddfc62 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:15.834884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75167d03-8549-45db-8d55-a2d735ddfc62 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:15.964619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-75167d03-8549-45db-8d55-a2d735ddfc62 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:15.973302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-75167d03-8549-45db-8d55-a2d735ddfc62 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:15.974826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-75167d03-8549-45db-8d55-a2d735ddfc62 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:15.975970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-75167d03-8549-45db-8d55-a2d735ddfc62 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.155163 Aug 01 15:38:15.976525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 323/637] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:16.111423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-302a63bd-60c5-417c-add5-f2ef8b6a8355 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:16.112038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-302a63bd-60c5-417c-add5-f2ef8b6a8355 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:16.118253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-302a63bd-60c5-417c-add5-f2ef8b6a8355 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:16.118754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-302a63bd-60c5-417c-add5-f2ef8b6a8355 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:16.119515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-302a63bd-60c5-417c-add5-f2ef8b6a8355 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:16.119956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-302a63bd-60c5-417c-add5-f2ef8b6a8355 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:16.197790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e153d575-2082-4735-a5e8-d85c2eb72f66 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:16.199076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e153d575-2082-4735-a5e8-d85c2eb72f66 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:16.205215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e153d575-2082-4735-a5e8-d85c2eb72f66 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:16.205653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e153d575-2082-4735-a5e8-d85c2eb72f66 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:16.206475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e153d575-2082-4735-a5e8-d85c2eb72f66 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:16.206890 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e153d575-2082-4735-a5e8-d85c2eb72f66 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:16.260847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-302a63bd-60c5-417c-add5-f2ef8b6a8355 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:16.269196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-302a63bd-60c5-417c-add5-f2ef8b6a8355 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.161809 Aug 01 15:38:16.269787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 315/638] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:16 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:16.348113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e153d575-2082-4735-a5e8-d85c2eb72f66 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:16.356339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e153d575-2082-4735-a5e8-d85c2eb72f66 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.162454 Aug 01 15:38:16.357101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 324/639] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:16 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:17.000663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0af0027f-2848-4087-9a34-5ea465aaa5a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:17.001175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0af0027f-2848-4087-9a34-5ea465aaa5a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:17.007286 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0af0027f-2848-4087-9a34-5ea465aaa5a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:17.007734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0af0027f-2848-4087-9a34-5ea465aaa5a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:17.008493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0af0027f-2848-4087-9a34-5ea465aaa5a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:17.008931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0af0027f-2848-4087-9a34-5ea465aaa5a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:17.141800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0af0027f-2848-4087-9a34-5ea465aaa5a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:17.151213 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0af0027f-2848-4087-9a34-5ea465aaa5a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:17.152908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0af0027f-2848-4087-9a34-5ea465aaa5a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:17.154126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0af0027f-2848-4087-9a34-5ea465aaa5a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.157819 Aug 01 15:38:17.154694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 316/640] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:16 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:17.293930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ffdc8b72-ea01-465e-97ba-e188590a6a74 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:17.294473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ffdc8b72-ea01-465e-97ba-e188590a6a74 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:17.301352 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ffdc8b72-ea01-465e-97ba-e188590a6a74 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:17.301797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ffdc8b72-ea01-465e-97ba-e188590a6a74 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:17.302619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ffdc8b72-ea01-465e-97ba-e188590a6a74 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:17.303056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ffdc8b72-ea01-465e-97ba-e188590a6a74 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:17.380751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-adaaa18e-e016-4687-93a8-798339aa1241 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:17.381516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-adaaa18e-e016-4687-93a8-798339aa1241 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:17.388199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-adaaa18e-e016-4687-93a8-798339aa1241 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:17.388646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-adaaa18e-e016-4687-93a8-798339aa1241 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:17.389427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-adaaa18e-e016-4687-93a8-798339aa1241 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:17.389862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-adaaa18e-e016-4687-93a8-798339aa1241 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:17.485210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ffdc8b72-ea01-465e-97ba-e188590a6a74 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:17.493644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ffdc8b72-ea01-465e-97ba-e188590a6a74 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.206528 Aug 01 15:38:17.494267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 325/641] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:17 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:17.549023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-adaaa18e-e016-4687-93a8-798339aa1241 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:17.557232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-adaaa18e-e016-4687-93a8-798339aa1241 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.180974 Aug 01 15:38:17.557748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 317/642] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:17 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:17.786412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-02308c89-9d34-42db-8ccc-2f324b15231b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:17.786913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-02308c89-9d34-42db-8ccc-2f324b15231b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:17.793814 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02308c89-9d34-42db-8ccc-2f324b15231b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:17.794295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02308c89-9d34-42db-8ccc-2f324b15231b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:17.795074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02308c89-9d34-42db-8ccc-2f324b15231b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:17.795513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02308c89-9d34-42db-8ccc-2f324b15231b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:17.819639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-02308c89-9d34-42db-8ccc-2f324b15231b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02/ips" status: 200 len: 149 microversion: 2.1 time: 0.037163 Aug 01 15:38:17.820222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 326/643] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 1 15:38:17 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:38:17.834310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-84e2b284-31b5-4ceb-9e80-9b9880251cff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3a8e36e-425b-4e66-aa20-f5f4927c91e4"}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:38:17.837036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-84e2b284-31b5-4ceb-9e80-9b9880251cff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:17.844374 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84e2b284-31b5-4ceb-9e80-9b9880251cff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:17.844868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84e2b284-31b5-4ceb-9e80-9b9880251cff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:17.845650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84e2b284-31b5-4ceb-9e80-9b9880251cff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:17.846125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84e2b284-31b5-4ceb-9e80-9b9880251cff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:17.955151 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-84e2b284-31b5-4ceb-9e80-9b9880251cff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] HTTP exception thrown: Invalid volume: volume a3a8e36e-425b-4e66-aa20-f5f4927c91e4 is already attached to instances: 2122c9a8-db75-40b5-bbbe-9c83c983d961 Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-84e2b284-31b5-4ceb-9e80-9b9880251cff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Request method failure captured: Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: POST /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02/os-volume_attachments HTTP/1.1 Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 74 Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_Jxd-2ufNMN6bINeUmVCl_C9neMK8VdVzqFhqxrGaNIW-B6K_BKgRY4QYs-OcVvyfk27GiPKwGgK9Vq2wAaDj7GUJJEXHP3a9XGW-l3GNaaACveTa98UrKY44ovMddLQPKJR39OU0WJEqLcH2PIF975xCsK1INaNMVRtS4ciRy7eWQ Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:38:17.956899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:38:17.958582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}] Aug 01 15:38:17.958582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeNegativeTest-358638272 Aug 01 15:38:17.958582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 15:38:17.958582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 15:38:17.958582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 15:38:17.958582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:38:17.958582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:38:17.958582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 4001e8ec57b34f57aae1654fad9217f8 Aug 01 15:38:17.958582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 15:38:17.958582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Aug 01 15:38:17.958582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {"volumeAttachment": {"volumeId": "a3a8e36e-425b-4e66-aa20-f5f4927c91e4"}} Aug 01 15:38:17.958582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Invalid volume: volume a3a8e36e-425b-4e66-aa20-f5f4927c91e4 is already attached to instances: 2122c9a8-db75-40b5-bbbe-9c83c983d961 Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'server_id': 'd6675886-2e34-4d44-b8df-0d31d3b19c02', 'body': {'volumeAttachment': {'volumeId': 'a3a8e36e-425b-4e66-aa20-f5f4927c91e4'}}} Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a3a8e36e-425b-4e66-aa20-f5f4927c91e4 is already attached to instances: 2122c9a8-db75-40b5-bbbe-9c83c983d961 Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:38:17.959471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a3a8e36e-425b-4e66-aa20-f5f4927c91e4 is already attached to instances: 2122c9a8-db75-40b5-bbbe-9c83c983d961 Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:38:17.960831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:38:17.962291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:38:17.962291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:38:17.962291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:38:17.962291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a3a8e36e-425b-4e66-aa20-f5f4927c91e4 is already attached to instances: 2122c9a8-db75-40b5-bbbe-9c83c983d961 Aug 01 15:38:17.962291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:38:17.962291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-84e2b284-31b5-4ceb-9e80-9b9880251cff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Returning 400 to user: Invalid volume: volume a3a8e36e-425b-4e66-aa20-f5f4927c91e4 is already attached to instances: 2122c9a8-db75-40b5-bbbe-9c83c983d961 {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:38:17.962291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-84e2b284-31b5-4ceb-9e80-9b9880251cff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "POST /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.128354 Aug 01 15:38:17.962291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 318/644] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 1 15:38:17 2022] POST /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:38:17.968341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-46aad92f-e811-49a3-a248-9bff1c100096 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:17.968837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-46aad92f-e811-49a3-a248-9bff1c100096 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:17.975072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-46aad92f-e811-49a3-a248-9bff1c100096 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:17.975512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-46aad92f-e811-49a3-a248-9bff1c100096 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:17.976282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-46aad92f-e811-49a3-a248-9bff1c100096 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:17.976711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-46aad92f-e811-49a3-a248-9bff1c100096 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:18.001668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-46aad92f-e811-49a3-a248-9bff1c100096 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:38:18.026137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:18.083594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-46aad92f-e811-49a3-a248-9bff1c100096 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 204 len: 0 microversion: 2.1 time: 0.119622 Aug 01 15:38:18.084100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 327/645] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 15:38:17 2022] DELETE /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:38:18.093099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-766d00fb-695c-4b51-9ab3-9b78fcd52e9f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:18.093742 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-766d00fb-695c-4b51-9ab3-9b78fcd52e9f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:18.100036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-766d00fb-695c-4b51-9ab3-9b78fcd52e9f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:18.100492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-766d00fb-695c-4b51-9ab3-9b78fcd52e9f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:18.101270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-766d00fb-695c-4b51-9ab3-9b78fcd52e9f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:18.101710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-766d00fb-695c-4b51-9ab3-9b78fcd52e9f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:18.179050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7309b412-c115-46e8-a9eb-9e5f0903ec99 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:18.179748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7309b412-c115-46e8-a9eb-9e5f0903ec99 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:18.186734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7309b412-c115-46e8-a9eb-9e5f0903ec99 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:18.187187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7309b412-c115-46e8-a9eb-9e5f0903ec99 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:18.187954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7309b412-c115-46e8-a9eb-9e5f0903ec99 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:18.188389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7309b412-c115-46e8-a9eb-9e5f0903ec99 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:18.246230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-766d00fb-695c-4b51-9ab3-9b78fcd52e9f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:18.254099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-766d00fb-695c-4b51-9ab3-9b78fcd52e9f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.165435 Aug 01 15:38:18.254726 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 319/646] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:18 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:18.334513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7309b412-c115-46e8-a9eb-9e5f0903ec99 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:18.343836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7309b412-c115-46e8-a9eb-9e5f0903ec99 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:18.345330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7309b412-c115-46e8-a9eb-9e5f0903ec99 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:18.346564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7309b412-c115-46e8-a9eb-9e5f0903ec99 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.172888 Aug 01 15:38:18.347138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 328/647] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:18.517476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bed39bca-69c9-4cad-a5c8-ce2083262cf7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:18.518170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bed39bca-69c9-4cad-a5c8-ce2083262cf7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:18.526198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bed39bca-69c9-4cad-a5c8-ce2083262cf7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:18.526678 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bed39bca-69c9-4cad-a5c8-ce2083262cf7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:18.527473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bed39bca-69c9-4cad-a5c8-ce2083262cf7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:18.527915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bed39bca-69c9-4cad-a5c8-ce2083262cf7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:18.579149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a9658c84-ef7b-4680-8be5-2095251b744b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:18.579774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a9658c84-ef7b-4680-8be5-2095251b744b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:18.586278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a9658c84-ef7b-4680-8be5-2095251b744b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:18.586661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a9658c84-ef7b-4680-8be5-2095251b744b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:18.587443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a9658c84-ef7b-4680-8be5-2095251b744b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:18.587882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a9658c84-ef7b-4680-8be5-2095251b744b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:18.707864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bed39bca-69c9-4cad-a5c8-ce2083262cf7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:18.716867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bed39bca-69c9-4cad-a5c8-ce2083262cf7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.204479 Aug 01 15:38:18.717449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 320/648] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:18 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:18.758081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a9658c84-ef7b-4680-8be5-2095251b744b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:18.765948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a9658c84-ef7b-4680-8be5-2095251b744b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.190636 Aug 01 15:38:18.766525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 329/649] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:18 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:19.276044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c3e17b23-536f-4da9-8995-e49c91006d0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:19.276653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c3e17b23-536f-4da9-8995-e49c91006d0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:19.283547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3e17b23-536f-4da9-8995-e49c91006d0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:19.283999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3e17b23-536f-4da9-8995-e49c91006d0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:19.284765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3e17b23-536f-4da9-8995-e49c91006d0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:19.285201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3e17b23-536f-4da9-8995-e49c91006d0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:19.371421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ddb9f345-bb66-4f5f-92ee-543299dc5311 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:19.372099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ddb9f345-bb66-4f5f-92ee-543299dc5311 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:19.378549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ddb9f345-bb66-4f5f-92ee-543299dc5311 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:19.379095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ddb9f345-bb66-4f5f-92ee-543299dc5311 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:19.379926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ddb9f345-bb66-4f5f-92ee-543299dc5311 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:19.380420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ddb9f345-bb66-4f5f-92ee-543299dc5311 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:19.428211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c3e17b23-536f-4da9-8995-e49c91006d0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:19.436550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c3e17b23-536f-4da9-8995-e49c91006d0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.164641 Aug 01 15:38:19.437121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 321/650] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:19 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:19.517422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ddb9f345-bb66-4f5f-92ee-543299dc5311 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:19.525983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ddb9f345-bb66-4f5f-92ee-543299dc5311 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:19.527609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ddb9f345-bb66-4f5f-92ee-543299dc5311 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:19.528769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ddb9f345-bb66-4f5f-92ee-543299dc5311 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.161947 Aug 01 15:38:19.529336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 330/651] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:19.739454 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-86533459-fbf1-423d-8d42-4c82b7c2a5dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:19.740073 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-86533459-fbf1-423d-8d42-4c82b7c2a5dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:19.746779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-86533459-fbf1-423d-8d42-4c82b7c2a5dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:19.747234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-86533459-fbf1-423d-8d42-4c82b7c2a5dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:19.748013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-86533459-fbf1-423d-8d42-4c82b7c2a5dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:19.748453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-86533459-fbf1-423d-8d42-4c82b7c2a5dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:19.786658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0331c773-a7c2-454c-a1b6-cb8332b3e9f2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:19.787186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0331c773-a7c2-454c-a1b6-cb8332b3e9f2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:19.793688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0331c773-a7c2-454c-a1b6-cb8332b3e9f2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:19.794184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0331c773-a7c2-454c-a1b6-cb8332b3e9f2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:19.795013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0331c773-a7c2-454c-a1b6-cb8332b3e9f2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:19.795453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0331c773-a7c2-454c-a1b6-cb8332b3e9f2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:20.210281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-86533459-fbf1-423d-8d42-4c82b7c2a5dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:20.221007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-86533459-fbf1-423d-8d42-4c82b7c2a5dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.485304 Aug 01 15:38:20.224703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0331c773-a7c2-454c-a1b6-cb8332b3e9f2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:20.226531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 322/652] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:19 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:20.232748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0331c773-a7c2-454c-a1b6-cb8332b3e9f2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.449945 Aug 01 15:38:20.233694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 331/653] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:19 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:20.458855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-96030e4f-ab89-4697-b55f-c3527135713c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:20.459462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-96030e4f-ab89-4697-b55f-c3527135713c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:20.466270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96030e4f-ab89-4697-b55f-c3527135713c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:20.466716 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96030e4f-ab89-4697-b55f-c3527135713c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:20.467489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96030e4f-ab89-4697-b55f-c3527135713c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:20.467919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96030e4f-ab89-4697-b55f-c3527135713c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:20.552059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d334be9d-223c-48cf-91e3-5c0e274972fd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:20.552677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d334be9d-223c-48cf-91e3-5c0e274972fd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:20.559810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d334be9d-223c-48cf-91e3-5c0e274972fd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:20.560258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d334be9d-223c-48cf-91e3-5c0e274972fd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:20.561037 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d334be9d-223c-48cf-91e3-5c0e274972fd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:20.561472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d334be9d-223c-48cf-91e3-5c0e274972fd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:20.601215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-96030e4f-ab89-4697-b55f-c3527135713c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:20.609203 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-96030e4f-ab89-4697-b55f-c3527135713c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.154215 Aug 01 15:38:20.610016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 323/654] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:20 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:20.702173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d334be9d-223c-48cf-91e3-5c0e274972fd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:20.710887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d334be9d-223c-48cf-91e3-5c0e274972fd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:20.712331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d334be9d-223c-48cf-91e3-5c0e274972fd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:20.713493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d334be9d-223c-48cf-91e3-5c0e274972fd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.165480 Aug 01 15:38:20.714666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 332/655] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:21.247236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-30d533ac-fb22-49d9-9a28-9da2f5b9b181 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:21.247798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-30d533ac-fb22-49d9-9a28-9da2f5b9b181 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:21.254059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30d533ac-fb22-49d9-9a28-9da2f5b9b181 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:21.254237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-60cb37e4-dd01-41cb-b972-cdbae901b5d5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:21.254515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30d533ac-fb22-49d9-9a28-9da2f5b9b181 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:21.254668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-60cb37e4-dd01-41cb-b972-cdbae901b5d5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:21.255282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30d533ac-fb22-49d9-9a28-9da2f5b9b181 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:21.255727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30d533ac-fb22-49d9-9a28-9da2f5b9b181 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:21.260709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60cb37e4-dd01-41cb-b972-cdbae901b5d5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:21.261162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60cb37e4-dd01-41cb-b972-cdbae901b5d5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:21.261953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60cb37e4-dd01-41cb-b972-cdbae901b5d5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:21.262385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60cb37e4-dd01-41cb-b972-cdbae901b5d5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:21.450055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-30d533ac-fb22-49d9-9a28-9da2f5b9b181 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:21.457809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-30d533ac-fb22-49d9-9a28-9da2f5b9b181 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.214618 Aug 01 15:38:21.458472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 324/656] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:21 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:21.461917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-60cb37e4-dd01-41cb-b972-cdbae901b5d5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:21.469972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-60cb37e4-dd01-41cb-b972-cdbae901b5d5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.219684 Aug 01 15:38:21.470537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 333/657] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:21 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:21.634158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-83f4939e-f3fb-443c-a645-abe0972b84f6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:21.635024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-83f4939e-f3fb-443c-a645-abe0972b84f6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:21.642732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-83f4939e-f3fb-443c-a645-abe0972b84f6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:21.643153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-83f4939e-f3fb-443c-a645-abe0972b84f6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:21.643952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-83f4939e-f3fb-443c-a645-abe0972b84f6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:21.644428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-83f4939e-f3fb-443c-a645-abe0972b84f6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:21.740318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-991fd470-dc5e-4bf8-afe1-2799b9de6036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:21.741192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-991fd470-dc5e-4bf8-afe1-2799b9de6036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:21.760214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-991fd470-dc5e-4bf8-afe1-2799b9de6036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:21.761752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-991fd470-dc5e-4bf8-afe1-2799b9de6036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:21.763292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-991fd470-dc5e-4bf8-afe1-2799b9de6036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:21.763821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-991fd470-dc5e-4bf8-afe1-2799b9de6036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:21.836298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-83f4939e-f3fb-443c-a645-abe0972b84f6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:21.852654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-83f4939e-f3fb-443c-a645-abe0972b84f6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.224177 Aug 01 15:38:21.853604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 325/658] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:21 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:21.929879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-991fd470-dc5e-4bf8-afe1-2799b9de6036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:21.939891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-991fd470-dc5e-4bf8-afe1-2799b9de6036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:21.941520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-991fd470-dc5e-4bf8-afe1-2799b9de6036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:21.942815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-991fd470-dc5e-4bf8-afe1-2799b9de6036 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.209452 Aug 01 15:38:21.943420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 334/659] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:22.479893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c27cf572-063e-4bbb-a2c1-a15e40166f24 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:22.480512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c27cf572-063e-4bbb-a2c1-a15e40166f24 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:22.486642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c27cf572-063e-4bbb-a2c1-a15e40166f24 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:22.487086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c27cf572-063e-4bbb-a2c1-a15e40166f24 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:22.487849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c27cf572-063e-4bbb-a2c1-a15e40166f24 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:22.488288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c27cf572-063e-4bbb-a2c1-a15e40166f24 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:22.491375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-98a7bc7d-3ec4-4694-8ace-bf2c39c21536 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:22.491994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-98a7bc7d-3ec4-4694-8ace-bf2c39c21536 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:22.498892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98a7bc7d-3ec4-4694-8ace-bf2c39c21536 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:22.499348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98a7bc7d-3ec4-4694-8ace-bf2c39c21536 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:22.500155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98a7bc7d-3ec4-4694-8ace-bf2c39c21536 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:22.500602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98a7bc7d-3ec4-4694-8ace-bf2c39c21536 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:22.701798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c27cf572-063e-4bbb-a2c1-a15e40166f24 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:22.704842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-98a7bc7d-3ec4-4694-8ace-bf2c39c21536 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:22.709857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c27cf572-063e-4bbb-a2c1-a15e40166f24 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.234220 Aug 01 15:38:22.710471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 326/660] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:22 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:22.713124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-98a7bc7d-3ec4-4694-8ace-bf2c39c21536 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.225443 Aug 01 15:38:22.714947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 335/661] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:22 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:22.874691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-79604efc-6a19-45ed-b0b8-641d4011484a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:22.875323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-79604efc-6a19-45ed-b0b8-641d4011484a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:22.881404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79604efc-6a19-45ed-b0b8-641d4011484a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:22.881855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79604efc-6a19-45ed-b0b8-641d4011484a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:22.882657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79604efc-6a19-45ed-b0b8-641d4011484a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:22.883100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79604efc-6a19-45ed-b0b8-641d4011484a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:22.966625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e8126b80-f312-4185-a4ab-98ba749e7be7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:22.967253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e8126b80-f312-4185-a4ab-98ba749e7be7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:22.974736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8126b80-f312-4185-a4ab-98ba749e7be7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:22.974736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8126b80-f312-4185-a4ab-98ba749e7be7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:22.975452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8126b80-f312-4185-a4ab-98ba749e7be7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:22.975892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8126b80-f312-4185-a4ab-98ba749e7be7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:23.035111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-79604efc-6a19-45ed-b0b8-641d4011484a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:23.047954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-79604efc-6a19-45ed-b0b8-641d4011484a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.174503 Aug 01 15:38:23.049841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 327/662] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:22 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:23.140531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e8126b80-f312-4185-a4ab-98ba749e7be7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:23.152780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e8126b80-f312-4185-a4ab-98ba749e7be7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:23.154324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e8126b80-f312-4185-a4ab-98ba749e7be7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:23.155531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e8126b80-f312-4185-a4ab-98ba749e7be7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.193546 Aug 01 15:38:23.156101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 336/663] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:22 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:23.734754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c9fa3b0a-0815-4870-b2a3-855011b30f9b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:23.735008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8a535873-bfe6-4272-b637-3fbd7333da7e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:23.735469 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c9fa3b0a-0815-4870-b2a3-855011b30f9b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:23.735569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8a535873-bfe6-4272-b637-3fbd7333da7e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:23.737756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=84 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:23.741915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9fa3b0a-0815-4870-b2a3-855011b30f9b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:23.742369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9fa3b0a-0815-4870-b2a3-855011b30f9b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:23.742934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8a535873-bfe6-4272-b637-3fbd7333da7e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:23.743133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9fa3b0a-0815-4870-b2a3-855011b30f9b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:23.743388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8a535873-bfe6-4272-b637-3fbd7333da7e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:23.743561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9fa3b0a-0815-4870-b2a3-855011b30f9b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:23.744166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8a535873-bfe6-4272-b637-3fbd7333da7e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:23.744609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8a535873-bfe6-4272-b637-3fbd7333da7e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:23.936101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c9fa3b0a-0815-4870-b2a3-855011b30f9b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:23.944157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c9fa3b0a-0815-4870-b2a3-855011b30f9b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.213072 Aug 01 15:38:23.944743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 337/664] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:23 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:23.962028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8a535873-bfe6-4272-b637-3fbd7333da7e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:23.970408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8a535873-bfe6-4272-b637-3fbd7333da7e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.239335 Aug 01 15:38:23.971002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 328/665] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:23 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:24.074360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-69e712bb-c0b2-4334-8cbe-db45e85a56f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:24.075342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-69e712bb-c0b2-4334-8cbe-db45e85a56f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:24.085700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-69e712bb-c0b2-4334-8cbe-db45e85a56f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:24.086178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-69e712bb-c0b2-4334-8cbe-db45e85a56f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:24.086977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-69e712bb-c0b2-4334-8cbe-db45e85a56f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:24.087412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-69e712bb-c0b2-4334-8cbe-db45e85a56f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:24.179047 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5b51e574-f42d-408c-9e0a-29aab5bc5c4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:24.180009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5b51e574-f42d-408c-9e0a-29aab5bc5c4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:24.186978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b51e574-f42d-408c-9e0a-29aab5bc5c4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:24.187660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b51e574-f42d-408c-9e0a-29aab5bc5c4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:24.188444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b51e574-f42d-408c-9e0a-29aab5bc5c4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:24.188931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b51e574-f42d-408c-9e0a-29aab5bc5c4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:24.231180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-69e712bb-c0b2-4334-8cbe-db45e85a56f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:24.239703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-69e712bb-c0b2-4334-8cbe-db45e85a56f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.172478 Aug 01 15:38:24.240865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 338/666] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:24 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:24.336625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5b51e574-f42d-408c-9e0a-29aab5bc5c4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:24.340610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:24.346956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5b51e574-f42d-408c-9e0a-29aab5bc5c4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:24.348451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5b51e574-f42d-408c-9e0a-29aab5bc5c4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:24.349613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5b51e574-f42d-408c-9e0a-29aab5bc5c4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.174708 Aug 01 15:38:24.350214 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 329/667] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:24.965579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-661cc29d-c39a-452b-a745-7f7839018e4e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:24.966231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-661cc29d-c39a-452b-a745-7f7839018e4e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:24.972790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-661cc29d-c39a-452b-a745-7f7839018e4e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:24.973313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-661cc29d-c39a-452b-a745-7f7839018e4e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:24.974132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-661cc29d-c39a-452b-a745-7f7839018e4e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:24.974561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-661cc29d-c39a-452b-a745-7f7839018e4e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:24.992638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5d932c5e-a4ee-4d17-bf7d-e524c3c4e359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:24.993260 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5d932c5e-a4ee-4d17-bf7d-e524c3c4e359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:25.000331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d932c5e-a4ee-4d17-bf7d-e524c3c4e359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:25.000781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d932c5e-a4ee-4d17-bf7d-e524c3c4e359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:25.001553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d932c5e-a4ee-4d17-bf7d-e524c3c4e359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:25.002011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d932c5e-a4ee-4d17-bf7d-e524c3c4e359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:25.186129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-661cc29d-c39a-452b-a745-7f7839018e4e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:25.191137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d932c5e-a4ee-4d17-bf7d-e524c3c4e359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:25.194246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-661cc29d-c39a-452b-a745-7f7839018e4e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.232713 Aug 01 15:38:25.194839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 339/668] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:24 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:25.200313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5d932c5e-a4ee-4d17-bf7d-e524c3c4e359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.211490 Aug 01 15:38:25.201087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 330/669] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:24 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:25.263046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-45e7aadc-471f-4dab-b9be-4e6e882d5923 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:25.263550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-45e7aadc-471f-4dab-b9be-4e6e882d5923 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:25.269811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45e7aadc-471f-4dab-b9be-4e6e882d5923 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:25.270287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45e7aadc-471f-4dab-b9be-4e6e882d5923 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:25.271061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45e7aadc-471f-4dab-b9be-4e6e882d5923 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:25.271492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45e7aadc-471f-4dab-b9be-4e6e882d5923 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:25.373382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1c7f529c-bfb8-4d0b-b17d-0a67c84e51b0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:25.374116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1c7f529c-bfb8-4d0b-b17d-0a67c84e51b0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:25.380855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c7f529c-bfb8-4d0b-b17d-0a67c84e51b0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:25.381322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c7f529c-bfb8-4d0b-b17d-0a67c84e51b0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:25.382154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c7f529c-bfb8-4d0b-b17d-0a67c84e51b0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:25.382597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c7f529c-bfb8-4d0b-b17d-0a67c84e51b0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:25.418615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-45e7aadc-471f-4dab-b9be-4e6e882d5923 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:25.425502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-45e7aadc-471f-4dab-b9be-4e6e882d5923 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.166929 Aug 01 15:38:25.426118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 340/670] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:25 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:25.519064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c7f529c-bfb8-4d0b-b17d-0a67c84e51b0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:25.527896 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c7f529c-bfb8-4d0b-b17d-0a67c84e51b0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:25.529392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c7f529c-bfb8-4d0b-b17d-0a67c84e51b0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:25.530592 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1c7f529c-bfb8-4d0b-b17d-0a67c84e51b0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.162007 Aug 01 15:38:25.531163 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 331/671] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:25 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:26.218492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9a70b84d-23f0-4eba-b28f-cdaffb8053d1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:26.219451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9a70b84d-23f0-4eba-b28f-cdaffb8053d1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:26.222112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c2d1e732-94cf-41cf-8573-9a427357b3a7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:26.222733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c2d1e732-94cf-41cf-8573-9a427357b3a7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:26.227477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a70b84d-23f0-4eba-b28f-cdaffb8053d1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:26.227978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a70b84d-23f0-4eba-b28f-cdaffb8053d1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:26.228849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a70b84d-23f0-4eba-b28f-cdaffb8053d1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:26.229310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a70b84d-23f0-4eba-b28f-cdaffb8053d1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:26.230749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2d1e732-94cf-41cf-8573-9a427357b3a7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:26.231353 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2d1e732-94cf-41cf-8573-9a427357b3a7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:26.232223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2d1e732-94cf-41cf-8573-9a427357b3a7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:26.232932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2d1e732-94cf-41cf-8573-9a427357b3a7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:26.446611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9a70b84d-23f0-4eba-b28f-cdaffb8053d1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:26.450579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c2d1e732-94cf-41cf-8573-9a427357b3a7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:26.454289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9a70b84d-23f0-4eba-b28f-cdaffb8053d1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.241605 Aug 01 15:38:26.454872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 341/672] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:26 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:26.458621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c2d1e732-94cf-41cf-8573-9a427357b3a7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.241050 Aug 01 15:38:26.459185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 332/673] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:26 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:26.459371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fc08050f-a355-4aec-9f20-602f24dc2c9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:26.471300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fc08050f-a355-4aec-9f20-602f24dc2c9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:26.471300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fc08050f-a355-4aec-9f20-602f24dc2c9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:26.471300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fc08050f-a355-4aec-9f20-602f24dc2c9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:26.471300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fc08050f-a355-4aec-9f20-602f24dc2c9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:26.471633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fc08050f-a355-4aec-9f20-602f24dc2c9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:26.558760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ac56aee1-6f86-4ddc-9355-ca6780a52fbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:26.559483 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ac56aee1-6f86-4ddc-9355-ca6780a52fbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:26.565866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac56aee1-6f86-4ddc-9355-ca6780a52fbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:26.566480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac56aee1-6f86-4ddc-9355-ca6780a52fbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:26.567982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac56aee1-6f86-4ddc-9355-ca6780a52fbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:26.568478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac56aee1-6f86-4ddc-9355-ca6780a52fbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:26.618468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fc08050f-a355-4aec-9f20-602f24dc2c9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:26.626661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fc08050f-a355-4aec-9f20-602f24dc2c9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.170767 Aug 01 15:38:26.631776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 342/674] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:26 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:26.705500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ac56aee1-6f86-4ddc-9355-ca6780a52fbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:26.714960 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ac56aee1-6f86-4ddc-9355-ca6780a52fbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:26.716471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ac56aee1-6f86-4ddc-9355-ca6780a52fbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:26.717637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ac56aee1-6f86-4ddc-9355-ca6780a52fbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.166352 Aug 01 15:38:26.718237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 333/675] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:27.408109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5830741c-bc63-46fa-9bcd-9013170acf03 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f48e74f-f402-47f5-9c3e-6cc1ad1425eb"}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:38:27.410576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5830741c-bc63-46fa-9bcd-9013170acf03 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:27.417784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5830741c-bc63-46fa-9bcd-9013170acf03 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:27.418259 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5830741c-bc63-46fa-9bcd-9013170acf03 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:27.419127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5830741c-bc63-46fa-9bcd-9013170acf03 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:27.419609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5830741c-bc63-46fa-9bcd-9013170acf03 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:27.434541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:27.478572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fae26c3d-231c-48ab-abee-9fd0f45942a1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:27.478572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fae26c3d-231c-48ab-abee-9fd0f45942a1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:27.485180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fae26c3d-231c-48ab-abee-9fd0f45942a1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:27.485700 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fae26c3d-231c-48ab-abee-9fd0f45942a1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:27.486576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fae26c3d-231c-48ab-abee-9fd0f45942a1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:27.487096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fae26c3d-231c-48ab-abee-9fd0f45942a1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:27.624791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fae26c3d-231c-48ab-abee-9fd0f45942a1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:27.632642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fae26c3d-231c-48ab-abee-9fd0f45942a1 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.161539 Aug 01 15:38:27.633203 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 334/676] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:27 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:27.638146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9ca66824-ad13-4a52-b124-66aff813087c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:27.638759 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9ca66824-ad13-4a52-b124-66aff813087c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:27.645828 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ca66824-ad13-4a52-b124-66aff813087c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:27.646053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ca66824-ad13-4a52-b124-66aff813087c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:27.647212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ca66824-ad13-4a52-b124-66aff813087c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:27.647212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ca66824-ad13-4a52-b124-66aff813087c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:27.797364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9ca66824-ad13-4a52-b124-66aff813087c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:27.805000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9ca66824-ad13-4a52-b124-66aff813087c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.170828 Aug 01 15:38:27.805573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 335/677] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:27 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:27.810071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a0b5ffde-5d6e-4450-ade8-774b6898eac6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:27.810687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a0b5ffde-5d6e-4450-ade8-774b6898eac6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:27.816798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0b5ffde-5d6e-4450-ade8-774b6898eac6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:27.817257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0b5ffde-5d6e-4450-ade8-774b6898eac6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:27.818143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0b5ffde-5d6e-4450-ade8-774b6898eac6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:27.818586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0b5ffde-5d6e-4450-ade8-774b6898eac6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:27.961779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a0b5ffde-5d6e-4450-ade8-774b6898eac6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:27.971076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a0b5ffde-5d6e-4450-ade8-774b6898eac6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.164090 Aug 01 15:38:27.972150 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 336/678] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:27 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:27.982288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-248913a0-438e-4eec-81ba-cb46219863bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:27.982910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-248913a0-438e-4eec-81ba-cb46219863bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:27.989649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-248913a0-438e-4eec-81ba-cb46219863bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:27.990082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-248913a0-438e-4eec-81ba-cb46219863bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:27.990999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-248913a0-438e-4eec-81ba-cb46219863bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:27.991548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-248913a0-438e-4eec-81ba-cb46219863bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:28.132042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-248913a0-438e-4eec-81ba-cb46219863bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:28.141280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-248913a0-438e-4eec-81ba-cb46219863bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:28.142834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-248913a0-438e-4eec-81ba-cb46219863bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:28.143999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-248913a0-438e-4eec-81ba-cb46219863bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.170610 Aug 01 15:38:28.144566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 337/679] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:28.654857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c5f88938-acfd-44e6-bcb0-fe645b9b313a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:28.655496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c5f88938-acfd-44e6-bcb0-fe645b9b313a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:28.662378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5f88938-acfd-44e6-bcb0-fe645b9b313a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:28.662894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5f88938-acfd-44e6-bcb0-fe645b9b313a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:28.663797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5f88938-acfd-44e6-bcb0-fe645b9b313a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:28.664281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5f88938-acfd-44e6-bcb0-fe645b9b313a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:28.801588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c5f88938-acfd-44e6-bcb0-fe645b9b313a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:28.809182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c5f88938-acfd-44e6-bcb0-fe645b9b313a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.158714 Aug 01 15:38:28.809754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 338/680] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:28 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:28.826085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7ec75038-f641-46eb-8bf2-2323c9d2a212 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:28.826690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7ec75038-f641-46eb-8bf2-2323c9d2a212 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:28.832781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ec75038-f641-46eb-8bf2-2323c9d2a212 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:28.833221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ec75038-f641-46eb-8bf2-2323c9d2a212 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:28.834031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ec75038-f641-46eb-8bf2-2323c9d2a212 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:28.834463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ec75038-f641-46eb-8bf2-2323c9d2a212 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:28.973390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7ec75038-f641-46eb-8bf2-2323c9d2a212 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:28.981660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7ec75038-f641-46eb-8bf2-2323c9d2a212 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.159411 Aug 01 15:38:28.982267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 339/681] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:28 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:28.992262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a8d7a5c0-e67f-4577-8567-a409728f360b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:28.992871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a8d7a5c0-e67f-4577-8567-a409728f360b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:29.000536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a8d7a5c0-e67f-4577-8567-a409728f360b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:29.000995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a8d7a5c0-e67f-4577-8567-a409728f360b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:29.002151 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a8d7a5c0-e67f-4577-8567-a409728f360b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:29.002940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a8d7a5c0-e67f-4577-8567-a409728f360b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:29.142433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a8d7a5c0-e67f-4577-8567-a409728f360b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:29.150239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a8d7a5c0-e67f-4577-8567-a409728f360b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.161543 Aug 01 15:38:29.150806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 340/682] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:28 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:29.169541 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-62dff31c-330f-4829-b7fe-a60f8a0501ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:29.170183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-62dff31c-330f-4829-b7fe-a60f8a0501ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:29.178841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62dff31c-330f-4829-b7fe-a60f8a0501ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:29.179290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62dff31c-330f-4829-b7fe-a60f8a0501ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:29.180193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62dff31c-330f-4829-b7fe-a60f8a0501ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:29.180656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62dff31c-330f-4829-b7fe-a60f8a0501ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:29.332386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-62dff31c-330f-4829-b7fe-a60f8a0501ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:29.341602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-62dff31c-330f-4829-b7fe-a60f8a0501ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:29.343197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-62dff31c-330f-4829-b7fe-a60f8a0501ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:29.344382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-62dff31c-330f-4829-b7fe-a60f8a0501ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.180934 Aug 01 15:38:29.344940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 341/683] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:29.830937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-60026b59-7b8c-48ab-8774-3017348911cb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:29.831609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-60026b59-7b8c-48ab-8774-3017348911cb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:29.838803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60026b59-7b8c-48ab-8774-3017348911cb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:29.839500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60026b59-7b8c-48ab-8774-3017348911cb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:29.840272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60026b59-7b8c-48ab-8774-3017348911cb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:29.840698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60026b59-7b8c-48ab-8774-3017348911cb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:30.002933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-60026b59-7b8c-48ab-8774-3017348911cb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:30.010310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-60026b59-7b8c-48ab-8774-3017348911cb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.183505 Aug 01 15:38:30.011103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 342/684] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:29 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:30.024032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b6164c30-4339-41ec-9041-32d896ecaa84 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:30.024835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b6164c30-4339-41ec-9041-32d896ecaa84 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:30.033315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6164c30-4339-41ec-9041-32d896ecaa84 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:30.033767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6164c30-4339-41ec-9041-32d896ecaa84 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:30.034608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6164c30-4339-41ec-9041-32d896ecaa84 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:30.035045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6164c30-4339-41ec-9041-32d896ecaa84 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:30.176110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b6164c30-4339-41ec-9041-32d896ecaa84 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:30.184435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b6164c30-4339-41ec-9041-32d896ecaa84 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.172222 Aug 01 15:38:30.185012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 343/685] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:30 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:30.189563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f124a8bd-5b6d-4ccf-829f-bbf6b1f73a68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:30.190196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f124a8bd-5b6d-4ccf-829f-bbf6b1f73a68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:30.196443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f124a8bd-5b6d-4ccf-829f-bbf6b1f73a68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:30.196890 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f124a8bd-5b6d-4ccf-829f-bbf6b1f73a68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:30.197655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f124a8bd-5b6d-4ccf-829f-bbf6b1f73a68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:30.198118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f124a8bd-5b6d-4ccf-829f-bbf6b1f73a68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:30.365827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f124a8bd-5b6d-4ccf-829f-bbf6b1f73a68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:30.373934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f124a8bd-5b6d-4ccf-829f-bbf6b1f73a68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.187836 Aug 01 15:38:30.374452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 344/686] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:30 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:30.379038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-67492e2b-f100-4952-bfea-94d259001030 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:30.379638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-67492e2b-f100-4952-bfea-94d259001030 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:30.390929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67492e2b-f100-4952-bfea-94d259001030 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:30.391364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67492e2b-f100-4952-bfea-94d259001030 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:30.392391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67492e2b-f100-4952-bfea-94d259001030 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:30.392588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67492e2b-f100-4952-bfea-94d259001030 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:30.530747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-67492e2b-f100-4952-bfea-94d259001030 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:30.539767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-67492e2b-f100-4952-bfea-94d259001030 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:30.541250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-67492e2b-f100-4952-bfea-94d259001030 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:30.543120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-67492e2b-f100-4952-bfea-94d259001030 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.167722 Aug 01 15:38:30.543719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 345/687] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:31.034500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7c8bfc55-acbb-4c29-af33-ce67d30042cf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:31.035112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7c8bfc55-acbb-4c29-af33-ce67d30042cf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:31.041671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c8bfc55-acbb-4c29-af33-ce67d30042cf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:31.042162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c8bfc55-acbb-4c29-af33-ce67d30042cf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:31.042938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c8bfc55-acbb-4c29-af33-ce67d30042cf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:31.043376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c8bfc55-acbb-4c29-af33-ce67d30042cf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:31.063007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:31.180051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7c8bfc55-acbb-4c29-af33-ce67d30042cf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:31.188205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7c8bfc55-acbb-4c29-af33-ce67d30042cf tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.160257 Aug 01 15:38:31.188784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 346/688] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:31 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:31.205790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-148ea41f-8b92-47f7-9afd-35c7c6dce492 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:31.206439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-148ea41f-8b92-47f7-9afd-35c7c6dce492 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:31.212627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-148ea41f-8b92-47f7-9afd-35c7c6dce492 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:31.213077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-148ea41f-8b92-47f7-9afd-35c7c6dce492 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:31.213872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-148ea41f-8b92-47f7-9afd-35c7c6dce492 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:31.214590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-148ea41f-8b92-47f7-9afd-35c7c6dce492 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:31.347932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-148ea41f-8b92-47f7-9afd-35c7c6dce492 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:31.355943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-148ea41f-8b92-47f7-9afd-35c7c6dce492 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.154048 Aug 01 15:38:31.356507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 347/689] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:31 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:31.395425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d257cd2e-b8f1-42c0-8abb-060a595a4aa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:31.396026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d257cd2e-b8f1-42c0-8abb-060a595a4aa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:31.402021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d257cd2e-b8f1-42c0-8abb-060a595a4aa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:31.402462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d257cd2e-b8f1-42c0-8abb-060a595a4aa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:31.403212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d257cd2e-b8f1-42c0-8abb-060a595a4aa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:31.403644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d257cd2e-b8f1-42c0-8abb-060a595a4aa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:31.532988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d257cd2e-b8f1-42c0-8abb-060a595a4aa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:31.540754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d257cd2e-b8f1-42c0-8abb-060a595a4aa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.148958 Aug 01 15:38:31.541254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 348/690] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:31 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:31.568403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-44771b52-1181-4e6c-9d23-2ba4486fb517 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:31.569003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-44771b52-1181-4e6c-9d23-2ba4486fb517 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:31.575662 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44771b52-1181-4e6c-9d23-2ba4486fb517 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:31.576100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44771b52-1181-4e6c-9d23-2ba4486fb517 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:31.576853 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44771b52-1181-4e6c-9d23-2ba4486fb517 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:31.577280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44771b52-1181-4e6c-9d23-2ba4486fb517 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:31.714918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-44771b52-1181-4e6c-9d23-2ba4486fb517 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:31.724726 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-44771b52-1181-4e6c-9d23-2ba4486fb517 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:31.726282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-44771b52-1181-4e6c-9d23-2ba4486fb517 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:31.727444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-44771b52-1181-4e6c-9d23-2ba4486fb517 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.162940 Aug 01 15:38:31.728139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 349/691] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:32.210199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-631dd3f6-0ef4-4484-bda1-39f070845945 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:32.210841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-631dd3f6-0ef4-4484-bda1-39f070845945 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:32.217588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-631dd3f6-0ef4-4484-bda1-39f070845945 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:32.218087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-631dd3f6-0ef4-4484-bda1-39f070845945 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:32.218864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-631dd3f6-0ef4-4484-bda1-39f070845945 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:32.219299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-631dd3f6-0ef4-4484-bda1-39f070845945 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:32.354120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-631dd3f6-0ef4-4484-bda1-39f070845945 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:32.362759 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-631dd3f6-0ef4-4484-bda1-39f070845945 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.156422 Aug 01 15:38:32.363328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 350/692] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:32 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:32.376793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-01edee61-e54a-4254-a41e-35832db9ed71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:32.377407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-01edee61-e54a-4254-a41e-35832db9ed71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:32.383549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01edee61-e54a-4254-a41e-35832db9ed71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:32.383996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01edee61-e54a-4254-a41e-35832db9ed71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:32.384762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01edee61-e54a-4254-a41e-35832db9ed71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:32.385196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01edee61-e54a-4254-a41e-35832db9ed71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:32.522314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-01edee61-e54a-4254-a41e-35832db9ed71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:32.531074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-01edee61-e54a-4254-a41e-35832db9ed71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.158022 Aug 01 15:38:32.531647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 351/693] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:32 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:32.562207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-20838501-d533-4dfc-8e00-32f7d6b90ebd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:32.562825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-20838501-d533-4dfc-8e00-32f7d6b90ebd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:32.576012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-20838501-d533-4dfc-8e00-32f7d6b90ebd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:32.576515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-20838501-d533-4dfc-8e00-32f7d6b90ebd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:32.577298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-20838501-d533-4dfc-8e00-32f7d6b90ebd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:32.577739 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-20838501-d533-4dfc-8e00-32f7d6b90ebd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:32.709968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-20838501-d533-4dfc-8e00-32f7d6b90ebd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:32.720128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-20838501-d533-4dfc-8e00-32f7d6b90ebd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.161543 Aug 01 15:38:32.720693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 352/694] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:32 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:32.749578 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-eff70da9-a26c-440a-b0d5-359853a94620 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:32.750228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-eff70da9-a26c-440a-b0d5-359853a94620 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:32.756400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eff70da9-a26c-440a-b0d5-359853a94620 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:32.756852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eff70da9-a26c-440a-b0d5-359853a94620 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:32.757617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eff70da9-a26c-440a-b0d5-359853a94620 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:32.758103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eff70da9-a26c-440a-b0d5-359853a94620 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:32.892652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-eff70da9-a26c-440a-b0d5-359853a94620 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:32.903570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-eff70da9-a26c-440a-b0d5-359853a94620 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:32.905226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-eff70da9-a26c-440a-b0d5-359853a94620 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:32.906349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-eff70da9-a26c-440a-b0d5-359853a94620 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.160686 Aug 01 15:38:32.906937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 353/695] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:33.384052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-68fc31f4-438f-490e-bb17-74f35793475b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:33.384659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-68fc31f4-438f-490e-bb17-74f35793475b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:33.391504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68fc31f4-438f-490e-bb17-74f35793475b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:33.391959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68fc31f4-438f-490e-bb17-74f35793475b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:33.392734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68fc31f4-438f-490e-bb17-74f35793475b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:33.393168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68fc31f4-438f-490e-bb17-74f35793475b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:33.526495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-68fc31f4-438f-490e-bb17-74f35793475b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:33.534061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-68fc31f4-438f-490e-bb17-74f35793475b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.153839 Aug 01 15:38:33.534638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 354/696] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:33 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:33.552335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-84bd0cf2-006b-49a4-987f-bc55969589a3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:33.552939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-84bd0cf2-006b-49a4-987f-bc55969589a3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:33.559546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84bd0cf2-006b-49a4-987f-bc55969589a3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:33.559984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84bd0cf2-006b-49a4-987f-bc55969589a3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:33.560736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84bd0cf2-006b-49a4-987f-bc55969589a3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:33.561171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84bd0cf2-006b-49a4-987f-bc55969589a3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:33.705437 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-84bd0cf2-006b-49a4-987f-bc55969589a3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:33.713208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-84bd0cf2-006b-49a4-987f-bc55969589a3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.164619 Aug 01 15:38:33.713794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 355/697] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:33 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:33.742612 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ef7a799f-4bb3-4dd6-a5e8-d6f85eb94af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:33.743219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ef7a799f-4bb3-4dd6-a5e8-d6f85eb94af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:33.750995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef7a799f-4bb3-4dd6-a5e8-d6f85eb94af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:33.751433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef7a799f-4bb3-4dd6-a5e8-d6f85eb94af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:33.752194 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef7a799f-4bb3-4dd6-a5e8-d6f85eb94af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:33.752618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef7a799f-4bb3-4dd6-a5e8-d6f85eb94af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:33.892824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ef7a799f-4bb3-4dd6-a5e8-d6f85eb94af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:33.900902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ef7a799f-4bb3-4dd6-a5e8-d6f85eb94af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.162050 Aug 01 15:38:33.901448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 356/698] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:33 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:33.930562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-799c676f-e5d7-42ed-a6fe-9eb94f738a5b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:33.931179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-799c676f-e5d7-42ed-a6fe-9eb94f738a5b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:33.937907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-799c676f-e5d7-42ed-a6fe-9eb94f738a5b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:33.938368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-799c676f-e5d7-42ed-a6fe-9eb94f738a5b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:33.939178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-799c676f-e5d7-42ed-a6fe-9eb94f738a5b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:33.939615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-799c676f-e5d7-42ed-a6fe-9eb94f738a5b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:34.076102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-799c676f-e5d7-42ed-a6fe-9eb94f738a5b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:34.084984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-799c676f-e5d7-42ed-a6fe-9eb94f738a5b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:34.086657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-799c676f-e5d7-42ed-a6fe-9eb94f738a5b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:34.087837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-799c676f-e5d7-42ed-a6fe-9eb94f738a5b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.161252 Aug 01 15:38:34.088403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 357/699] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:34.555340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d5ba7546-d0fa-4a91-a8e4-b93642aef0c3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:34.555980 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d5ba7546-d0fa-4a91-a8e4-b93642aef0c3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:34.562608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5ba7546-d0fa-4a91-a8e4-b93642aef0c3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:34.563064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5ba7546-d0fa-4a91-a8e4-b93642aef0c3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:34.563832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5ba7546-d0fa-4a91-a8e4-b93642aef0c3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:34.564270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5ba7546-d0fa-4a91-a8e4-b93642aef0c3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:34.712820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d5ba7546-d0fa-4a91-a8e4-b93642aef0c3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:34.721110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d5ba7546-d0fa-4a91-a8e4-b93642aef0c3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.169631 Aug 01 15:38:34.721680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 358/700] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:34 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:34.734068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-49455929-7d0c-41ef-8833-5cd207d8eadf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:34.734678 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-49455929-7d0c-41ef-8833-5cd207d8eadf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:34.740812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49455929-7d0c-41ef-8833-5cd207d8eadf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:34.741252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49455929-7d0c-41ef-8833-5cd207d8eadf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:34.742046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49455929-7d0c-41ef-8833-5cd207d8eadf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:34.742475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49455929-7d0c-41ef-8833-5cd207d8eadf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:34.883162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-49455929-7d0c-41ef-8833-5cd207d8eadf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:34.890988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-49455929-7d0c-41ef-8833-5cd207d8eadf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.160564 Aug 01 15:38:34.891545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 359/701] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:34 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:34.922959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9af56664-a701-47ac-a0ad-91b13463009b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:34.923489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9af56664-a701-47ac-a0ad-91b13463009b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:34.929632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9af56664-a701-47ac-a0ad-91b13463009b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:34.930128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9af56664-a701-47ac-a0ad-91b13463009b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:34.930896 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9af56664-a701-47ac-a0ad-91b13463009b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:34.931333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9af56664-a701-47ac-a0ad-91b13463009b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:35.061040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9af56664-a701-47ac-a0ad-91b13463009b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:35.068699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9af56664-a701-47ac-a0ad-91b13463009b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.149707 Aug 01 15:38:35.069269 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 360/702] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:34 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:35.112578 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-94cd98c6-dac9-4083-8d8e-33b002ef7c14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:35.113182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-94cd98c6-dac9-4083-8d8e-33b002ef7c14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:35.119599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94cd98c6-dac9-4083-8d8e-33b002ef7c14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:35.120041 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94cd98c6-dac9-4083-8d8e-33b002ef7c14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:35.120811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94cd98c6-dac9-4083-8d8e-33b002ef7c14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:35.121245 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94cd98c6-dac9-4083-8d8e-33b002ef7c14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:35.257226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-94cd98c6-dac9-4083-8d8e-33b002ef7c14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:35.266330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-94cd98c6-dac9-4083-8d8e-33b002ef7c14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:35.267823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-94cd98c6-dac9-4083-8d8e-33b002ef7c14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:35.269084 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-94cd98c6-dac9-4083-8d8e-33b002ef7c14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.160298 Aug 01 15:38:35.269653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 361/703] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:35.743088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-feb8fe82-3e49-40a8-8634-847f1c92fb5b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:35.743801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-feb8fe82-3e49-40a8-8634-847f1c92fb5b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:35.751265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-feb8fe82-3e49-40a8-8634-847f1c92fb5b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:35.751720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-feb8fe82-3e49-40a8-8634-847f1c92fb5b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:35.752497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-feb8fe82-3e49-40a8-8634-847f1c92fb5b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:35.752955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-feb8fe82-3e49-40a8-8634-847f1c92fb5b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:35.890729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-feb8fe82-3e49-40a8-8634-847f1c92fb5b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:35.898618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-feb8fe82-3e49-40a8-8634-847f1c92fb5b tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.159594 Aug 01 15:38:35.899236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 362/704] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:35 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:35.913537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e0f425be-c39c-407b-a01b-b9c610d2132f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:35.914262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e0f425be-c39c-407b-a01b-b9c610d2132f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:35.921365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e0f425be-c39c-407b-a01b-b9c610d2132f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:35.922093 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e0f425be-c39c-407b-a01b-b9c610d2132f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:35.923074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e0f425be-c39c-407b-a01b-b9c610d2132f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:35.923654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e0f425be-c39c-407b-a01b-b9c610d2132f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:35.929122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:36.068668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e0f425be-c39c-407b-a01b-b9c610d2132f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:36.076410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e0f425be-c39c-407b-a01b-b9c610d2132f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.167028 Aug 01 15:38:36.077099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 363/705] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:35 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:36.091046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c97ab82d-32b8-43fa-9698-bfe48d11a150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:36.091663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c97ab82d-32b8-43fa-9698-bfe48d11a150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:36.097814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c97ab82d-32b8-43fa-9698-bfe48d11a150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:36.098318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c97ab82d-32b8-43fa-9698-bfe48d11a150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:36.099091 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c97ab82d-32b8-43fa-9698-bfe48d11a150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:36.099530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c97ab82d-32b8-43fa-9698-bfe48d11a150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:36.238108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c97ab82d-32b8-43fa-9698-bfe48d11a150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:36.246162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c97ab82d-32b8-43fa-9698-bfe48d11a150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.159172 Aug 01 15:38:36.246735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 364/706] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:36 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:36.293748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bd8e3135-67af-4b5d-a540-8118843ec21c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:36.294292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bd8e3135-67af-4b5d-a540-8118843ec21c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:36.300558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd8e3135-67af-4b5d-a540-8118843ec21c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:36.300993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd8e3135-67af-4b5d-a540-8118843ec21c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:36.301742 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd8e3135-67af-4b5d-a540-8118843ec21c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:36.302217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd8e3135-67af-4b5d-a540-8118843ec21c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:36.442336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bd8e3135-67af-4b5d-a540-8118843ec21c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:36.452225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bd8e3135-67af-4b5d-a540-8118843ec21c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:36.454100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bd8e3135-67af-4b5d-a540-8118843ec21c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:36.455432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bd8e3135-67af-4b5d-a540-8118843ec21c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.166239 Aug 01 15:38:36.455909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 365/707] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:36.919586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a6c5175c-22c7-41d0-a2e4-0357f439a3bc tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:36.920516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a6c5175c-22c7-41d0-a2e4-0357f439a3bc tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:36.927038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6c5175c-22c7-41d0-a2e4-0357f439a3bc tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:36.927486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6c5175c-22c7-41d0-a2e4-0357f439a3bc tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:36.928254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6c5175c-22c7-41d0-a2e4-0357f439a3bc tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:36.928684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6c5175c-22c7-41d0-a2e4-0357f439a3bc tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:37.067981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a6c5175c-22c7-41d0-a2e4-0357f439a3bc tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:37.079925 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a6c5175c-22c7-41d0-a2e4-0357f439a3bc tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.163661 Aug 01 15:38:37.080895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 366/708] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:36 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:37.098158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2b8d653c-2d47-4ec4-9aff-6dc86130d66f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:37.098809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2b8d653c-2d47-4ec4-9aff-6dc86130d66f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:37.105707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b8d653c-2d47-4ec4-9aff-6dc86130d66f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:37.106189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b8d653c-2d47-4ec4-9aff-6dc86130d66f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:37.106969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b8d653c-2d47-4ec4-9aff-6dc86130d66f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:37.107402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b8d653c-2d47-4ec4-9aff-6dc86130d66f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:37.253304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2b8d653c-2d47-4ec4-9aff-6dc86130d66f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:37.262159 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2b8d653c-2d47-4ec4-9aff-6dc86130d66f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.167743 Aug 01 15:38:37.263050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 367/709] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:37 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:37.267694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1c0e427a-aacb-4389-8038-eef65e46bb3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:37.268310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1c0e427a-aacb-4389-8038-eef65e46bb3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:37.274861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c0e427a-aacb-4389-8038-eef65e46bb3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:37.275314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c0e427a-aacb-4389-8038-eef65e46bb3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:37.276110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c0e427a-aacb-4389-8038-eef65e46bb3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:37.276529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c0e427a-aacb-4389-8038-eef65e46bb3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:37.414437 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c0e427a-aacb-4389-8038-eef65e46bb3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:37.415160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:37.423617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1c0e427a-aacb-4389-8038-eef65e46bb3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.159467 Aug 01 15:38:37.424208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 368/710] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:37 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:37.480612 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-110f909d-fc29-4487-b08b-3df6624bb5a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:37.481243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-110f909d-fc29-4487-b08b-3df6624bb5a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:37.488067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-110f909d-fc29-4487-b08b-3df6624bb5a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:37.488528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-110f909d-fc29-4487-b08b-3df6624bb5a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:37.489311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-110f909d-fc29-4487-b08b-3df6624bb5a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:37.489747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-110f909d-fc29-4487-b08b-3df6624bb5a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:37.501291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=3 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:37.636185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-110f909d-fc29-4487-b08b-3df6624bb5a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:37.644926 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-110f909d-fc29-4487-b08b-3df6624bb5a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:37.646479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-110f909d-fc29-4487-b08b-3df6624bb5a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:37.647649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-110f909d-fc29-4487-b08b-3df6624bb5a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.171507 Aug 01 15:38:37.648234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 369/711] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:38.106798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7d6b1566-f2b9-4e4e-8749-da79c5052aaa tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:38.107376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7d6b1566-f2b9-4e4e-8749-da79c5052aaa tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:38.113821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d6b1566-f2b9-4e4e-8749-da79c5052aaa tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:38.114301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d6b1566-f2b9-4e4e-8749-da79c5052aaa tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:38.115091 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d6b1566-f2b9-4e4e-8749-da79c5052aaa tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:38.115531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d6b1566-f2b9-4e4e-8749-da79c5052aaa tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:38.248465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7d6b1566-f2b9-4e4e-8749-da79c5052aaa tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:38.255791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7d6b1566-f2b9-4e4e-8749-da79c5052aaa tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.153339 Aug 01 15:38:38.256343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 370/712] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:38 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:38.282764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8e0ffcb6-e6cc-430e-bb51-9bf7c11cefeb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:38.283362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8e0ffcb6-e6cc-430e-bb51-9bf7c11cefeb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:38.289199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e0ffcb6-e6cc-430e-bb51-9bf7c11cefeb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:38.289638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e0ffcb6-e6cc-430e-bb51-9bf7c11cefeb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:38.290417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e0ffcb6-e6cc-430e-bb51-9bf7c11cefeb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:38.290845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e0ffcb6-e6cc-430e-bb51-9bf7c11cefeb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:38.422538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8e0ffcb6-e6cc-430e-bb51-9bf7c11cefeb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:38.430092 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8e0ffcb6-e6cc-430e-bb51-9bf7c11cefeb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.150835 Aug 01 15:38:38.430659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 371/713] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:38 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:38.445903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b5387be1-d5aa-405a-bf9e-e5a394ecbad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:38.446519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b5387be1-d5aa-405a-bf9e-e5a394ecbad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:38.452528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b5387be1-d5aa-405a-bf9e-e5a394ecbad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:38.452969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b5387be1-d5aa-405a-bf9e-e5a394ecbad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:38.453715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b5387be1-d5aa-405a-bf9e-e5a394ecbad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:38.454179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b5387be1-d5aa-405a-bf9e-e5a394ecbad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:38.581785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b5387be1-d5aa-405a-bf9e-e5a394ecbad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:38.589809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b5387be1-d5aa-405a-bf9e-e5a394ecbad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.147130 Aug 01 15:38:38.590399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 372/714] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:38 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:38.671936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-768abb63-dcc6-4853-a09a-fe40e27f6f44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:38.672762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-768abb63-dcc6-4853-a09a-fe40e27f6f44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:38.679200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-768abb63-dcc6-4853-a09a-fe40e27f6f44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:38.679652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-768abb63-dcc6-4853-a09a-fe40e27f6f44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:38.680427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-768abb63-dcc6-4853-a09a-fe40e27f6f44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:38.680891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-768abb63-dcc6-4853-a09a-fe40e27f6f44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:38.813962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-768abb63-dcc6-4853-a09a-fe40e27f6f44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:38.822711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-768abb63-dcc6-4853-a09a-fe40e27f6f44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:38.824931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-768abb63-dcc6-4853-a09a-fe40e27f6f44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:38.826174 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-768abb63-dcc6-4853-a09a-fe40e27f6f44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.158947 Aug 01 15:38:38.826778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 373/715] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:39.275903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cc78510b-2348-45bb-bacc-c5092823cab2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:39.276532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cc78510b-2348-45bb-bacc-c5092823cab2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:39.283623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc78510b-2348-45bb-bacc-c5092823cab2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:39.284075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc78510b-2348-45bb-bacc-c5092823cab2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:39.284842 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc78510b-2348-45bb-bacc-c5092823cab2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:39.285280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc78510b-2348-45bb-bacc-c5092823cab2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:39.415927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cc78510b-2348-45bb-bacc-c5092823cab2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:39.423884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cc78510b-2348-45bb-bacc-c5092823cab2 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.151935 Aug 01 15:38:39.424444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 374/716] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:39 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:39.451004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b273bcc3-8b15-492c-b000-f218519526d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:39.451620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b273bcc3-8b15-492c-b000-f218519526d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:39.457797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b273bcc3-8b15-492c-b000-f218519526d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:39.458281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b273bcc3-8b15-492c-b000-f218519526d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:39.459086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b273bcc3-8b15-492c-b000-f218519526d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:39.459523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b273bcc3-8b15-492c-b000-f218519526d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:39.595771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b273bcc3-8b15-492c-b000-f218519526d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:39.603201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b273bcc3-8b15-492c-b000-f218519526d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.156037 Aug 01 15:38:39.603765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 375/717] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:39 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:39.610824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-43ad5dae-3430-4fa8-a267-501774eafb84 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:39.611430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-43ad5dae-3430-4fa8-a267-501774eafb84 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:39.617252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43ad5dae-3430-4fa8-a267-501774eafb84 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:39.617685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43ad5dae-3430-4fa8-a267-501774eafb84 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:39.618485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43ad5dae-3430-4fa8-a267-501774eafb84 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:39.618917 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43ad5dae-3430-4fa8-a267-501774eafb84 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:39.748818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-43ad5dae-3430-4fa8-a267-501774eafb84 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:39.756778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-43ad5dae-3430-4fa8-a267-501774eafb84 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.149533 Aug 01 15:38:39.757321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 376/718] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:39 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:39.850871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a909a3c7-07d3-4dea-9aa4-73942c1eafbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:39.851591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a909a3c7-07d3-4dea-9aa4-73942c1eafbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:39.857760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a909a3c7-07d3-4dea-9aa4-73942c1eafbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:39.858248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a909a3c7-07d3-4dea-9aa4-73942c1eafbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:39.859007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a909a3c7-07d3-4dea-9aa4-73942c1eafbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:39.859440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a909a3c7-07d3-4dea-9aa4-73942c1eafbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:39.992866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a909a3c7-07d3-4dea-9aa4-73942c1eafbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:40.002465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a909a3c7-07d3-4dea-9aa4-73942c1eafbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:40.003956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a909a3c7-07d3-4dea-9aa4-73942c1eafbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:40.005351 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a909a3c7-07d3-4dea-9aa4-73942c1eafbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.158633 Aug 01 15:38:40.005935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 377/719] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:40.443710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d42fae3a-8b4f-4d87-9c7a-5c376bca60d3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:40.444341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d42fae3a-8b4f-4d87-9c7a-5c376bca60d3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:40.446603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:40.451873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d42fae3a-8b4f-4d87-9c7a-5c376bca60d3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:40.452320 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d42fae3a-8b4f-4d87-9c7a-5c376bca60d3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:40.453079 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d42fae3a-8b4f-4d87-9c7a-5c376bca60d3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:40.453510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d42fae3a-8b4f-4d87-9c7a-5c376bca60d3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:40.583392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d42fae3a-8b4f-4d87-9c7a-5c376bca60d3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:40.593114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d42fae3a-8b4f-4d87-9c7a-5c376bca60d3 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.153216 Aug 01 15:38:40.593681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 378/720] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:40 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:40.624294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5d7a01c4-a064-4df5-af01-18e7e527b839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:40.624917 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5d7a01c4-a064-4df5-af01-18e7e527b839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:40.631371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d7a01c4-a064-4df5-af01-18e7e527b839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:40.631815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d7a01c4-a064-4df5-af01-18e7e527b839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:40.632592 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d7a01c4-a064-4df5-af01-18e7e527b839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:40.633022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d7a01c4-a064-4df5-af01-18e7e527b839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:40.777705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d7a01c4-a064-4df5-af01-18e7e527b839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:40.782514 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:40.788234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5d7a01c4-a064-4df5-af01-18e7e527b839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.167777 Aug 01 15:38:40.788824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 379/721] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:40 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:40.793599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b41c57e3-ce95-42a4-b113-d2a07fed109c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:40.794241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b41c57e3-ce95-42a4-b113-d2a07fed109c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:40.800486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b41c57e3-ce95-42a4-b113-d2a07fed109c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:40.800963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b41c57e3-ce95-42a4-b113-d2a07fed109c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:40.801715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b41c57e3-ce95-42a4-b113-d2a07fed109c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:40.802182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b41c57e3-ce95-42a4-b113-d2a07fed109c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:40.949709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b41c57e3-ce95-42a4-b113-d2a07fed109c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:40.957811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b41c57e3-ce95-42a4-b113-d2a07fed109c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.167979 Aug 01 15:38:40.958438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 380/722] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:40 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:41.029199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2b31548e-62a1-41bc-9326-68b2c81392eb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:41.029806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2b31548e-62a1-41bc-9326-68b2c81392eb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:41.036338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b31548e-62a1-41bc-9326-68b2c81392eb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:41.036857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b31548e-62a1-41bc-9326-68b2c81392eb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:41.037638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b31548e-62a1-41bc-9326-68b2c81392eb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:41.038108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b31548e-62a1-41bc-9326-68b2c81392eb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:41.171318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2b31548e-62a1-41bc-9326-68b2c81392eb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:41.180315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2b31548e-62a1-41bc-9326-68b2c81392eb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:41.181866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2b31548e-62a1-41bc-9326-68b2c81392eb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:41.183665 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2b31548e-62a1-41bc-9326-68b2c81392eb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.158171 Aug 01 15:38:41.184230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 381/723] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:41.613548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-40a3a1db-7098-4adf-8588-682fa2336747 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:41.614179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-40a3a1db-7098-4adf-8588-682fa2336747 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:41.622616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-40a3a1db-7098-4adf-8588-682fa2336747 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:41.623061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-40a3a1db-7098-4adf-8588-682fa2336747 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:41.623854 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-40a3a1db-7098-4adf-8588-682fa2336747 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:41.624284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-40a3a1db-7098-4adf-8588-682fa2336747 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:41.778338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-40a3a1db-7098-4adf-8588-682fa2336747 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:41.787030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-40a3a1db-7098-4adf-8588-682fa2336747 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.177541 Aug 01 15:38:41.787612 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 382/724] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:41 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:41.809138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6ad3e9f9-5f5a-487d-b64d-1191d7762dc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:41.809670 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6ad3e9f9-5f5a-487d-b64d-1191d7762dc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:41.816539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6ad3e9f9-5f5a-487d-b64d-1191d7762dc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:41.816984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6ad3e9f9-5f5a-487d-b64d-1191d7762dc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:41.817757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6ad3e9f9-5f5a-487d-b64d-1191d7762dc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:41.818215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6ad3e9f9-5f5a-487d-b64d-1191d7762dc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:41.961060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6ad3e9f9-5f5a-487d-b64d-1191d7762dc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:41.970490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6ad3e9f9-5f5a-487d-b64d-1191d7762dc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.165132 Aug 01 15:38:41.971102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 383/725] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:41 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:41.989632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b483c9d2-44fd-4a4c-b013-858505d78140 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:41.990271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b483c9d2-44fd-4a4c-b013-858505d78140 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:41.997051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b483c9d2-44fd-4a4c-b013-858505d78140 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:41.997493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b483c9d2-44fd-4a4c-b013-858505d78140 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:41.998291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b483c9d2-44fd-4a4c-b013-858505d78140 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:41.998722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b483c9d2-44fd-4a4c-b013-858505d78140 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:42.152346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b483c9d2-44fd-4a4c-b013-858505d78140 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:42.159684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b483c9d2-44fd-4a4c-b013-858505d78140 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.173581 Aug 01 15:38:42.160598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 384/726] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:41 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:42.209269 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b028321f-d72c-44c0-a74a-c750e27947be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:42.209878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b028321f-d72c-44c0-a74a-c750e27947be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:42.216950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b028321f-d72c-44c0-a74a-c750e27947be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:42.217408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b028321f-d72c-44c0-a74a-c750e27947be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:42.218258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b028321f-d72c-44c0-a74a-c750e27947be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:42.218696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b028321f-d72c-44c0-a74a-c750e27947be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:42.365828 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b028321f-d72c-44c0-a74a-c750e27947be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:42.374394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b028321f-d72c-44c0-a74a-c750e27947be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:42.375885 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b028321f-d72c-44c0-a74a-c750e27947be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:42.377050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b028321f-d72c-44c0-a74a-c750e27947be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.171857 Aug 01 15:38:42.377607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 385/727] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:42 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:42.808657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8a18b9f5-de22-44e1-bd10-0ccd121b6e91 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:42.809339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8a18b9f5-de22-44e1-bd10-0ccd121b6e91 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:42.816374 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8a18b9f5-de22-44e1-bd10-0ccd121b6e91 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:42.816853 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8a18b9f5-de22-44e1-bd10-0ccd121b6e91 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:42.817609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8a18b9f5-de22-44e1-bd10-0ccd121b6e91 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:42.818077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8a18b9f5-de22-44e1-bd10-0ccd121b6e91 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:42.953431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8a18b9f5-de22-44e1-bd10-0ccd121b6e91 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:42.961478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8a18b9f5-de22-44e1-bd10-0ccd121b6e91 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.156653 Aug 01 15:38:42.962088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 386/728] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:42 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:42.992867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9762ce43-86fa-4f39-a6a4-7ac81bd321ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:42.993474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9762ce43-86fa-4f39-a6a4-7ac81bd321ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:43.000164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9762ce43-86fa-4f39-a6a4-7ac81bd321ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:43.000614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9762ce43-86fa-4f39-a6a4-7ac81bd321ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:43.001384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9762ce43-86fa-4f39-a6a4-7ac81bd321ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:43.001818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9762ce43-86fa-4f39-a6a4-7ac81bd321ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:43.143638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9762ce43-86fa-4f39-a6a4-7ac81bd321ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:43.151376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9762ce43-86fa-4f39-a6a4-7ac81bd321ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.162317 Aug 01 15:38:43.151905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 387/729] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:42 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:43.186396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-03648b84-f1dd-4550-b1c7-e7927aff45e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:43.186998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-03648b84-f1dd-4550-b1c7-e7927aff45e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:43.193455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03648b84-f1dd-4550-b1c7-e7927aff45e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:43.193914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03648b84-f1dd-4550-b1c7-e7927aff45e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:43.194691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03648b84-f1dd-4550-b1c7-e7927aff45e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:43.195119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03648b84-f1dd-4550-b1c7-e7927aff45e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:43.337802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-03648b84-f1dd-4550-b1c7-e7927aff45e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:43.345694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-03648b84-f1dd-4550-b1c7-e7927aff45e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.163785 Aug 01 15:38:43.346296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 388/730] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:43 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:43.400243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1c113271-c001-4d2c-a673-71efaddac605 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:43.400881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1c113271-c001-4d2c-a673-71efaddac605 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:43.407804 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c113271-c001-4d2c-a673-71efaddac605 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:43.408164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c113271-c001-4d2c-a673-71efaddac605 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:43.408938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c113271-c001-4d2c-a673-71efaddac605 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:43.409366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c113271-c001-4d2c-a673-71efaddac605 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:43.551086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c113271-c001-4d2c-a673-71efaddac605 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:43.561579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c113271-c001-4d2c-a673-71efaddac605 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:43.563181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c113271-c001-4d2c-a673-71efaddac605 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:43.564698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1c113271-c001-4d2c-a673-71efaddac605 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.168045 Aug 01 15:38:43.564997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 389/731] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:43.982070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9efede5f-9980-4b12-bd38-8a17a0a7f73e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:43.982806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9efede5f-9980-4b12-bd38-8a17a0a7f73e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:43.989504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9efede5f-9980-4b12-bd38-8a17a0a7f73e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:43.989985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9efede5f-9980-4b12-bd38-8a17a0a7f73e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:43.990765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9efede5f-9980-4b12-bd38-8a17a0a7f73e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:43.991205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9efede5f-9980-4b12-bd38-8a17a0a7f73e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:44.139005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9efede5f-9980-4b12-bd38-8a17a0a7f73e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:44.146565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9efede5f-9980-4b12-bd38-8a17a0a7f73e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.168518 Aug 01 15:38:44.147130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 390/732] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:43 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:44.173029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ab713d68-6493-4597-861b-330e8107c78a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:44.173631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ab713d68-6493-4597-861b-330e8107c78a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:44.179927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ab713d68-6493-4597-861b-330e8107c78a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:44.180362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ab713d68-6493-4597-861b-330e8107c78a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:44.181123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ab713d68-6493-4597-861b-330e8107c78a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:44.181553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ab713d68-6493-4597-861b-330e8107c78a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:44.316769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ab713d68-6493-4597-861b-330e8107c78a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:44.324905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ab713d68-6493-4597-861b-330e8107c78a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.155511 Aug 01 15:38:44.325492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 391/733] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:44 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:44.368219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2dc6955d-d572-43be-bbd6-6b812511ed31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:44.368817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2dc6955d-d572-43be-bbd6-6b812511ed31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:44.378047 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dc6955d-d572-43be-bbd6-6b812511ed31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:44.378519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dc6955d-d572-43be-bbd6-6b812511ed31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:44.379417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dc6955d-d572-43be-bbd6-6b812511ed31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:44.379841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dc6955d-d572-43be-bbd6-6b812511ed31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:44.547311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2dc6955d-d572-43be-bbd6-6b812511ed31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:44.555301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2dc6955d-d572-43be-bbd6-6b812511ed31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.190903 Aug 01 15:38:44.555888 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 392/734] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:44 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:44.588806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-777ec0d5-3b5b-4500-8016-e8d4b6185eea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:44.589949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-777ec0d5-3b5b-4500-8016-e8d4b6185eea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:44.600464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-777ec0d5-3b5b-4500-8016-e8d4b6185eea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:44.600909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-777ec0d5-3b5b-4500-8016-e8d4b6185eea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:44.601684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-777ec0d5-3b5b-4500-8016-e8d4b6185eea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:44.602159 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-777ec0d5-3b5b-4500-8016-e8d4b6185eea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:44.743055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-777ec0d5-3b5b-4500-8016-e8d4b6185eea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:44.751652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-777ec0d5-3b5b-4500-8016-e8d4b6185eea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:44.753181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-777ec0d5-3b5b-4500-8016-e8d4b6185eea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:44.754376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-777ec0d5-3b5b-4500-8016-e8d4b6185eea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.169513 Aug 01 15:38:44.754940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 393/735] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:45.168015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3a947e54-cf82-4929-8e10-878746b6e6db tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:45.168682 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3a947e54-cf82-4929-8e10-878746b6e6db tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:45.175262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a947e54-cf82-4929-8e10-878746b6e6db tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:45.175716 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a947e54-cf82-4929-8e10-878746b6e6db tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:45.176489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a947e54-cf82-4929-8e10-878746b6e6db tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:45.176922 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a947e54-cf82-4929-8e10-878746b6e6db tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:45.313773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3a947e54-cf82-4929-8e10-878746b6e6db tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:45.321252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3a947e54-cf82-4929-8e10-878746b6e6db tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.157640 Aug 01 15:38:45.321812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 394/736] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:45 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:45.346577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3116dd2f-f8bd-443f-9440-11e420e0363a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:45.347186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3116dd2f-f8bd-443f-9440-11e420e0363a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:45.353235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3116dd2f-f8bd-443f-9440-11e420e0363a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:45.353684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3116dd2f-f8bd-443f-9440-11e420e0363a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:45.354474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3116dd2f-f8bd-443f-9440-11e420e0363a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:45.355511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3116dd2f-f8bd-443f-9440-11e420e0363a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:45.488152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3116dd2f-f8bd-443f-9440-11e420e0363a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:45.495910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3116dd2f-f8bd-443f-9440-11e420e0363a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.153051 Aug 01 15:38:45.496480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 395/737] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:45 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:45.577132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5f2c2c6e-633b-48e7-83f8-5bef48009d10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:45.577668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5f2c2c6e-633b-48e7-83f8-5bef48009d10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:45.583735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5f2c2c6e-633b-48e7-83f8-5bef48009d10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:45.584184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5f2c2c6e-633b-48e7-83f8-5bef48009d10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:45.584939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5f2c2c6e-633b-48e7-83f8-5bef48009d10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:45.585383 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5f2c2c6e-633b-48e7-83f8-5bef48009d10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:45.603768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:45.722390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5f2c2c6e-633b-48e7-83f8-5bef48009d10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:45.733506 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5f2c2c6e-633b-48e7-83f8-5bef48009d10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.158573 Aug 01 15:38:45.733506 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 396/738] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:45 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:45.778775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-624c0a99-024a-4805-8541-1fac269433f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:45.779382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-624c0a99-024a-4805-8541-1fac269433f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:45.785464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-624c0a99-024a-4805-8541-1fac269433f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:45.785930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-624c0a99-024a-4805-8541-1fac269433f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:45.786712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-624c0a99-024a-4805-8541-1fac269433f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:45.787135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-624c0a99-024a-4805-8541-1fac269433f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:45.935442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-624c0a99-024a-4805-8541-1fac269433f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:45.944703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-624c0a99-024a-4805-8541-1fac269433f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:45.946211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-624c0a99-024a-4805-8541-1fac269433f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:45.947369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-624c0a99-024a-4805-8541-1fac269433f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.173670 Aug 01 15:38:45.947932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 397/739] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:46.342290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0498bc3e-9cab-4847-8aa2-27f8ec660b49 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:46.342939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0498bc3e-9cab-4847-8aa2-27f8ec660b49 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:46.349776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0498bc3e-9cab-4847-8aa2-27f8ec660b49 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:46.350263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0498bc3e-9cab-4847-8aa2-27f8ec660b49 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:46.351033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0498bc3e-9cab-4847-8aa2-27f8ec660b49 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:46.351473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0498bc3e-9cab-4847-8aa2-27f8ec660b49 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:46.653474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0498bc3e-9cab-4847-8aa2-27f8ec660b49 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:46.660923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0498bc3e-9cab-4847-8aa2-27f8ec660b49 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.322723 Aug 01 15:38:46.661494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 398/740] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:46 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:46.666044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a6fe290c-0d0f-4972-b773-bbb2d6c9d28e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:46.666645 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a6fe290c-0d0f-4972-b773-bbb2d6c9d28e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:46.674346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6fe290c-0d0f-4972-b773-bbb2d6c9d28e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:46.674834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6fe290c-0d0f-4972-b773-bbb2d6c9d28e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:46.675646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6fe290c-0d0f-4972-b773-bbb2d6c9d28e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:46.676076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6fe290c-0d0f-4972-b773-bbb2d6c9d28e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:46.822360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a6fe290c-0d0f-4972-b773-bbb2d6c9d28e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:46.830022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a6fe290c-0d0f-4972-b773-bbb2d6c9d28e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.167465 Aug 01 15:38:46.830599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 399/741] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:46 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:46.835323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c28c479a-c1d7-46a3-81bc-61463405c730 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:46.836045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c28c479a-c1d7-46a3-81bc-61463405c730 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:46.844370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c28c479a-c1d7-46a3-81bc-61463405c730 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:46.844949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c28c479a-c1d7-46a3-81bc-61463405c730 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:46.845840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c28c479a-c1d7-46a3-81bc-61463405c730 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:46.846431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c28c479a-c1d7-46a3-81bc-61463405c730 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:46.980852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c28c479a-c1d7-46a3-81bc-61463405c730 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:46.988563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c28c479a-c1d7-46a3-81bc-61463405c730 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.156886 Aug 01 15:38:46.989145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 400/742] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:46 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:46.993816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-62e3b550-0359-464a-b03e-f97850ae5af0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:46.994451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-62e3b550-0359-464a-b03e-f97850ae5af0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:47.000817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62e3b550-0359-464a-b03e-f97850ae5af0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:47.001262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62e3b550-0359-464a-b03e-f97850ae5af0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:47.002085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62e3b550-0359-464a-b03e-f97850ae5af0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:47.002527 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62e3b550-0359-464a-b03e-f97850ae5af0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:47.143766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-62e3b550-0359-464a-b03e-f97850ae5af0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:47.153243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-62e3b550-0359-464a-b03e-f97850ae5af0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:47.154776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-62e3b550-0359-464a-b03e-f97850ae5af0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:47.155964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-62e3b550-0359-464a-b03e-f97850ae5af0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.165812 Aug 01 15:38:47.156504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 401/743] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:47.684615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8993fbc4-129c-4abf-853c-d573d973f78a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:47.685265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8993fbc4-129c-4abf-853c-d573d973f78a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:47.693308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8993fbc4-129c-4abf-853c-d573d973f78a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:47.693903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8993fbc4-129c-4abf-853c-d573d973f78a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:47.695069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8993fbc4-129c-4abf-853c-d573d973f78a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:47.695617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8993fbc4-129c-4abf-853c-d573d973f78a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:47.841531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8993fbc4-129c-4abf-853c-d573d973f78a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:47.849292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8993fbc4-129c-4abf-853c-d573d973f78a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.169101 Aug 01 15:38:47.849846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 402/744] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:47 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:47.854305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-dbc13726-c873-41ab-a985-1ffd80b9a799 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:47.855440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-dbc13726-c873-41ab-a985-1ffd80b9a799 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:47.861690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dbc13726-c873-41ab-a985-1ffd80b9a799 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:47.862204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dbc13726-c873-41ab-a985-1ffd80b9a799 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:47.862999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dbc13726-c873-41ab-a985-1ffd80b9a799 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:47.863429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dbc13726-c873-41ab-a985-1ffd80b9a799 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:48.000331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dbc13726-c873-41ab-a985-1ffd80b9a799 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:48.008190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-dbc13726-c873-41ab-a985-1ffd80b9a799 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.157248 Aug 01 15:38:48.008766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 403/745] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:47 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:48.013419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4ef1a9fb-78d7-4f7b-ae0d-4c9a4a6251cf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:48.014061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4ef1a9fb-78d7-4f7b-ae0d-4c9a4a6251cf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:48.020481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4ef1a9fb-78d7-4f7b-ae0d-4c9a4a6251cf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:48.020935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4ef1a9fb-78d7-4f7b-ae0d-4c9a4a6251cf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:48.021711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4ef1a9fb-78d7-4f7b-ae0d-4c9a4a6251cf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:48.022178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4ef1a9fb-78d7-4f7b-ae0d-4c9a4a6251cf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:48.169313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4ef1a9fb-78d7-4f7b-ae0d-4c9a4a6251cf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:48.177993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4ef1a9fb-78d7-4f7b-ae0d-4c9a4a6251cf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.168094 Aug 01 15:38:48.178568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 404/746] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:48 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:48.183732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b400dfdb-3f11-4d6b-a960-b45f7f3ebef1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:48.184342 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b400dfdb-3f11-4d6b-a960-b45f7f3ebef1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:48.190574 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b400dfdb-3f11-4d6b-a960-b45f7f3ebef1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:48.191013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b400dfdb-3f11-4d6b-a960-b45f7f3ebef1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:48.191840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b400dfdb-3f11-4d6b-a960-b45f7f3ebef1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:48.192272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b400dfdb-3f11-4d6b-a960-b45f7f3ebef1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:48.331675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b400dfdb-3f11-4d6b-a960-b45f7f3ebef1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:48.341980 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b400dfdb-3f11-4d6b-a960-b45f7f3ebef1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:48.343488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b400dfdb-3f11-4d6b-a960-b45f7f3ebef1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:48.344660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b400dfdb-3f11-4d6b-a960-b45f7f3ebef1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.165184 Aug 01 15:38:48.345213 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 405/747] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:48.871045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1f33ecd7-4831-442a-9d7e-784db9243aac tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:48.871045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1f33ecd7-4831-442a-9d7e-784db9243aac tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:48.878554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1f33ecd7-4831-442a-9d7e-784db9243aac tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:48.878997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1f33ecd7-4831-442a-9d7e-784db9243aac tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:48.879824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1f33ecd7-4831-442a-9d7e-784db9243aac tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:48.880200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1f33ecd7-4831-442a-9d7e-784db9243aac tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:49.017722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1f33ecd7-4831-442a-9d7e-784db9243aac tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:49.025310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1f33ecd7-4831-442a-9d7e-784db9243aac tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.158073 Aug 01 15:38:49.025875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 406/748] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:48 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:49.030386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3086bf7b-1113-484a-bf61-3d82f4f4fbe2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:49.030985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3086bf7b-1113-484a-bf61-3d82f4f4fbe2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:49.036999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3086bf7b-1113-484a-bf61-3d82f4f4fbe2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:49.037442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3086bf7b-1113-484a-bf61-3d82f4f4fbe2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:49.038242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3086bf7b-1113-484a-bf61-3d82f4f4fbe2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:49.038677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3086bf7b-1113-484a-bf61-3d82f4f4fbe2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:49.184375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3086bf7b-1113-484a-bf61-3d82f4f4fbe2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:49.191805 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3086bf7b-1113-484a-bf61-3d82f4f4fbe2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.164920 Aug 01 15:38:49.192361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 407/749] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:49 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:49.212797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-904f7f8d-f7e0-47ef-b2ab-5879cb124f80 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:49.213399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-904f7f8d-f7e0-47ef-b2ab-5879cb124f80 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:49.219499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-904f7f8d-f7e0-47ef-b2ab-5879cb124f80 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:49.219980 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-904f7f8d-f7e0-47ef-b2ab-5879cb124f80 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:49.220764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-904f7f8d-f7e0-47ef-b2ab-5879cb124f80 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:49.221192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-904f7f8d-f7e0-47ef-b2ab-5879cb124f80 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:49.350185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-904f7f8d-f7e0-47ef-b2ab-5879cb124f80 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:49.358031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-904f7f8d-f7e0-47ef-b2ab-5879cb124f80 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.149015 Aug 01 15:38:49.358596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 408/750] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:49 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:49.368183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-27d90a96-ff49-429c-9bc1-e23cb1b972bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:49.368811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-27d90a96-ff49-429c-9bc1-e23cb1b972bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:49.374945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27d90a96-ff49-429c-9bc1-e23cb1b972bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:49.375384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27d90a96-ff49-429c-9bc1-e23cb1b972bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:49.376137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27d90a96-ff49-429c-9bc1-e23cb1b972bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:49.376566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27d90a96-ff49-429c-9bc1-e23cb1b972bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:49.507490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-27d90a96-ff49-429c-9bc1-e23cb1b972bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:49.516333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-27d90a96-ff49-429c-9bc1-e23cb1b972bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:49.517838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-27d90a96-ff49-429c-9bc1-e23cb1b972bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:49.519032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-27d90a96-ff49-429c-9bc1-e23cb1b972bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.154744 Aug 01 15:38:49.519588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 409/751] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:50.047192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f4421e88-298a-4909-9cda-bb239ab1a363 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:50.048247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f4421e88-298a-4909-9cda-bb239ab1a363 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:50.055126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4421e88-298a-4909-9cda-bb239ab1a363 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:50.055576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4421e88-298a-4909-9cda-bb239ab1a363 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:50.056345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4421e88-298a-4909-9cda-bb239ab1a363 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:50.056780 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4421e88-298a-4909-9cda-bb239ab1a363 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:50.195185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f4421e88-298a-4909-9cda-bb239ab1a363 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:50.203536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f4421e88-298a-4909-9cda-bb239ab1a363 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.160987 Aug 01 15:38:50.204129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 410/752] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:50 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:50.212462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-01c35712-583c-48f3-a3d5-e90ba17fd9f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:50.213083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-01c35712-583c-48f3-a3d5-e90ba17fd9f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:50.220268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01c35712-583c-48f3-a3d5-e90ba17fd9f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:50.220724 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01c35712-583c-48f3-a3d5-e90ba17fd9f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:50.221535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01c35712-583c-48f3-a3d5-e90ba17fd9f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:50.222016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01c35712-583c-48f3-a3d5-e90ba17fd9f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:50.372104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-01c35712-583c-48f3-a3d5-e90ba17fd9f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:50.380763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-01c35712-583c-48f3-a3d5-e90ba17fd9f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.171939 Aug 01 15:38:50.381660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 411/753] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:50 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:50.386714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7254579b-f91c-498d-853c-bad4fce8a2ee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:50.387331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7254579b-f91c-498d-853c-bad4fce8a2ee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:50.393807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7254579b-f91c-498d-853c-bad4fce8a2ee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:50.394327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7254579b-f91c-498d-853c-bad4fce8a2ee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:50.395121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7254579b-f91c-498d-853c-bad4fce8a2ee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:50.395563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7254579b-f91c-498d-853c-bad4fce8a2ee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:50.540196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7254579b-f91c-498d-853c-bad4fce8a2ee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:50.549000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7254579b-f91c-498d-853c-bad4fce8a2ee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.166469 Aug 01 15:38:50.549583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 412/754] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:50 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:50.554529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-466e3de1-433a-462f-b018-c60649e1e719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:50.555379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-466e3de1-433a-462f-b018-c60649e1e719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:50.562318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-466e3de1-433a-462f-b018-c60649e1e719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:50.562760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-466e3de1-433a-462f-b018-c60649e1e719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:50.563595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-466e3de1-433a-462f-b018-c60649e1e719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:50.563968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-466e3de1-433a-462f-b018-c60649e1e719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:50.568803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:50.708495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-466e3de1-433a-462f-b018-c60649e1e719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:50.718684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-466e3de1-433a-462f-b018-c60649e1e719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:50.720193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-466e3de1-433a-462f-b018-c60649e1e719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:50.721400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-466e3de1-433a-462f-b018-c60649e1e719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.170856 Aug 01 15:38:50.721976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 413/755] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:51.225546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-45b2bfdd-8007-4d25-8e6e-e090573fe71a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:51.226232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-45b2bfdd-8007-4d25-8e6e-e090573fe71a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:51.233389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45b2bfdd-8007-4d25-8e6e-e090573fe71a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:51.233840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45b2bfdd-8007-4d25-8e6e-e090573fe71a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:51.234691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45b2bfdd-8007-4d25-8e6e-e090573fe71a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:51.235100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45b2bfdd-8007-4d25-8e6e-e090573fe71a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:51.600303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-45b2bfdd-8007-4d25-8e6e-e090573fe71a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:51.608372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-45b2bfdd-8007-4d25-8e6e-e090573fe71a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.386611 Aug 01 15:38:51.608962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 414/756] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:51 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:51.613627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9f201f44-f21d-40fd-add2-84a0cc59e16e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:51.614272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9f201f44-f21d-40fd-add2-84a0cc59e16e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:51.620416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9f201f44-f21d-40fd-add2-84a0cc59e16e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:51.620869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9f201f44-f21d-40fd-add2-84a0cc59e16e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:51.621656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9f201f44-f21d-40fd-add2-84a0cc59e16e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:51.622128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9f201f44-f21d-40fd-add2-84a0cc59e16e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:51.777827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9f201f44-f21d-40fd-add2-84a0cc59e16e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:51.787117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9f201f44-f21d-40fd-add2-84a0cc59e16e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.177018 Aug 01 15:38:51.788192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 415/757] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:51 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:51.793064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a55ef492-7625-41cb-9bba-38780ad47453 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:51.793684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a55ef492-7625-41cb-9bba-38780ad47453 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:51.802232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a55ef492-7625-41cb-9bba-38780ad47453 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:51.802656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a55ef492-7625-41cb-9bba-38780ad47453 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:51.803500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a55ef492-7625-41cb-9bba-38780ad47453 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:51.803943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a55ef492-7625-41cb-9bba-38780ad47453 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:51.954916 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a55ef492-7625-41cb-9bba-38780ad47453 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:51.962789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a55ef492-7625-41cb-9bba-38780ad47453 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.173448 Aug 01 15:38:51.963376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 416/758] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:51 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:51.968176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3c0b90f3-60c9-45a6-a00f-d8faabc8cfa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:51.968797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3c0b90f3-60c9-45a6-a00f-d8faabc8cfa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:51.975323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3c0b90f3-60c9-45a6-a00f-d8faabc8cfa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:51.975323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3c0b90f3-60c9-45a6-a00f-d8faabc8cfa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:51.976126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3c0b90f3-60c9-45a6-a00f-d8faabc8cfa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:51.976571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3c0b90f3-60c9-45a6-a00f-d8faabc8cfa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:52.119830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3c0b90f3-60c9-45a6-a00f-d8faabc8cfa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:52.129705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3c0b90f3-60c9-45a6-a00f-d8faabc8cfa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:52.131507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3c0b90f3-60c9-45a6-a00f-d8faabc8cfa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:52.132714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3c0b90f3-60c9-45a6-a00f-d8faabc8cfa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.168408 Aug 01 15:38:52.133292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 417/759] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:52.629601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-adc4d046-4258-463f-b1c3-c46cd676e571 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:52.630412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-adc4d046-4258-463f-b1c3-c46cd676e571 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:52.637014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-adc4d046-4258-463f-b1c3-c46cd676e571 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:52.637467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-adc4d046-4258-463f-b1c3-c46cd676e571 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:52.638282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-adc4d046-4258-463f-b1c3-c46cd676e571 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:52.638723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-adc4d046-4258-463f-b1c3-c46cd676e571 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:52.779180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-adc4d046-4258-463f-b1c3-c46cd676e571 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:52.786734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-adc4d046-4258-463f-b1c3-c46cd676e571 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.161159 Aug 01 15:38:52.787305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 418/760] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:52 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:52.808560 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9b69831e-02a9-4fa2-9d84-06338cdb42f6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:52.809175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9b69831e-02a9-4fa2-9d84-06338cdb42f6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:52.815484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b69831e-02a9-4fa2-9d84-06338cdb42f6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:52.815930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b69831e-02a9-4fa2-9d84-06338cdb42f6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:52.816705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b69831e-02a9-4fa2-9d84-06338cdb42f6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:52.817138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b69831e-02a9-4fa2-9d84-06338cdb42f6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:52.962873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9b69831e-02a9-4fa2-9d84-06338cdb42f6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:52.971523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9b69831e-02a9-4fa2-9d84-06338cdb42f6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.166661 Aug 01 15:38:52.972112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 419/761] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:52 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:52.985335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4585072a-5246-400f-b6a5-52d938f0d46c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:52.986111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4585072a-5246-400f-b6a5-52d938f0d46c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:52.992742 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4585072a-5246-400f-b6a5-52d938f0d46c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:52.993200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4585072a-5246-400f-b6a5-52d938f0d46c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:52.994033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4585072a-5246-400f-b6a5-52d938f0d46c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:52.994475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4585072a-5246-400f-b6a5-52d938f0d46c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:53.134424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4585072a-5246-400f-b6a5-52d938f0d46c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:53.142602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4585072a-5246-400f-b6a5-52d938f0d46c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.161137 Aug 01 15:38:53.143183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 420/762] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:52 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:53.157037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0c4334de-1b85-4338-987b-87470766afbd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:53.157664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0c4334de-1b85-4338-987b-87470766afbd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:53.164065 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c4334de-1b85-4338-987b-87470766afbd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:53.164514 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c4334de-1b85-4338-987b-87470766afbd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:53.165298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c4334de-1b85-4338-987b-87470766afbd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:53.165737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c4334de-1b85-4338-987b-87470766afbd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:53.304106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c4334de-1b85-4338-987b-87470766afbd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:53.313210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c4334de-1b85-4338-987b-87470766afbd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:53.314746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c4334de-1b85-4338-987b-87470766afbd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:53.315941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0c4334de-1b85-4338-987b-87470766afbd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.163076 Aug 01 15:38:53.316512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 421/763] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:53.809243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ba2b8cb0-69cb-4106-9426-7f04577b803a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:53.809944 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ba2b8cb0-69cb-4106-9426-7f04577b803a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:53.816880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba2b8cb0-69cb-4106-9426-7f04577b803a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:53.817335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba2b8cb0-69cb-4106-9426-7f04577b803a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:53.818150 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba2b8cb0-69cb-4106-9426-7f04577b803a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:53.818586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba2b8cb0-69cb-4106-9426-7f04577b803a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:53.965860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ba2b8cb0-69cb-4106-9426-7f04577b803a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:53.974004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ba2b8cb0-69cb-4106-9426-7f04577b803a tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.169054 Aug 01 15:38:53.974822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 422/764] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:53 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:53.993810 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2a941460-51dd-40c1-a097-4ae84e8bee66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:53.994545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2a941460-51dd-40c1-a097-4ae84e8bee66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:54.001605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a941460-51dd-40c1-a097-4ae84e8bee66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:54.001961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a941460-51dd-40c1-a097-4ae84e8bee66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:54.002736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a941460-51dd-40c1-a097-4ae84e8bee66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:54.003355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a941460-51dd-40c1-a097-4ae84e8bee66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:54.144435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2a941460-51dd-40c1-a097-4ae84e8bee66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:54.152634 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2a941460-51dd-40c1-a097-4ae84e8bee66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.162584 Aug 01 15:38:54.153215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 423/765] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:53 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:54.164511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6fe2427b-be88-4139-bf4d-7c29a93708d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:54.165333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6fe2427b-be88-4139-bf4d-7c29a93708d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:54.171978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6fe2427b-be88-4139-bf4d-7c29a93708d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:54.172502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6fe2427b-be88-4139-bf4d-7c29a93708d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:54.173272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6fe2427b-be88-4139-bf4d-7c29a93708d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:54.173770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6fe2427b-be88-4139-bf4d-7c29a93708d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:54.311090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6fe2427b-be88-4139-bf4d-7c29a93708d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:54.319074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6fe2427b-be88-4139-bf4d-7c29a93708d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.158250 Aug 01 15:38:54.319663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 424/766] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:54 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:38:54.340989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-527f965b-15bc-41db-8b0e-fc92c450cc32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:54.341510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-527f965b-15bc-41db-8b0e-fc92c450cc32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:54.352938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-527f965b-15bc-41db-8b0e-fc92c450cc32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:54.353383 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-527f965b-15bc-41db-8b0e-fc92c450cc32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:54.354190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-527f965b-15bc-41db-8b0e-fc92c450cc32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:54.354648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-527f965b-15bc-41db-8b0e-fc92c450cc32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:54.507071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-527f965b-15bc-41db-8b0e-fc92c450cc32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:54.516328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-527f965b-15bc-41db-8b0e-fc92c450cc32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:54.517959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-527f965b-15bc-41db-8b0e-fc92c450cc32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:54.519247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-527f965b-15bc-41db-8b0e-fc92c450cc32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.183173 Aug 01 15:38:54.519901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 425/767] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:38:55.001937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f60abe2d-5833-4389-832d-9f2f6ee55343 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:55.002563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f60abe2d-5833-4389-832d-9f2f6ee55343 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:55.009068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f60abe2d-5833-4389-832d-9f2f6ee55343 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:55.009530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f60abe2d-5833-4389-832d-9f2f6ee55343 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:55.010491 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f60abe2d-5833-4389-832d-9f2f6ee55343 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:55.011652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f60abe2d-5833-4389-832d-9f2f6ee55343 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:55.155639 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f60abe2d-5833-4389-832d-9f2f6ee55343 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:55.163602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f60abe2d-5833-4389-832d-9f2f6ee55343 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1359 microversion: 2.1 time: 0.172681 Aug 01 15:38:55.164421 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 426/768] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:54 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:55.174666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ace4f2c5-e7eb-4229-b63a-7157f332b502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:55.175517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ace4f2c5-e7eb-4229-b63a-7157f332b502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:55.182640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ace4f2c5-e7eb-4229-b63a-7157f332b502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:55.183579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ace4f2c5-e7eb-4229-b63a-7157f332b502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:55.184362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ace4f2c5-e7eb-4229-b63a-7157f332b502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:55.184800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ace4f2c5-e7eb-4229-b63a-7157f332b502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:55.257333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5830741c-bc63-46fa-9bcd-9013170acf03 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "POST /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 27.853024 Aug 01 15:38:55.258163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 343/769] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 1 15:38:27 2022] POST /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13/os-volume_attachments => generated 194 bytes in 27855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:38:55.338754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ace4f2c5-e7eb-4229-b63a-7157f332b502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:55.343101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dcbe5385-cdd6-4285-9b19-683a4b71d49d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:55.343867 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dcbe5385-cdd6-4285-9b19-683a4b71d49d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:55.347613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ace4f2c5-e7eb-4229-b63a-7157f332b502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.177694 Aug 01 15:38:55.348908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 427/770] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:55 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:55.353340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcbe5385-cdd6-4285-9b19-683a4b71d49d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:55.353917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcbe5385-cdd6-4285-9b19-683a4b71d49d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:55.355385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcbe5385-cdd6-4285-9b19-683a4b71d49d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:55.355908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcbe5385-cdd6-4285-9b19-683a4b71d49d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:55.492974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dcbe5385-cdd6-4285-9b19-683a4b71d49d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:55.501414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dcbe5385-cdd6-4285-9b19-683a4b71d49d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.163816 Aug 01 15:38:55.502023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 344/771] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:55 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:55.543177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-088b34dc-afea-405a-81d7-51347786b0df tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:55.543825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-088b34dc-afea-405a-81d7-51347786b0df tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:55.545748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:55.551463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-088b34dc-afea-405a-81d7-51347786b0df tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:55.551914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-088b34dc-afea-405a-81d7-51347786b0df tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:55.552691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-088b34dc-afea-405a-81d7-51347786b0df tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:55.553129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-088b34dc-afea-405a-81d7-51347786b0df tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:55.687847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-088b34dc-afea-405a-81d7-51347786b0df tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:55.697635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-088b34dc-afea-405a-81d7-51347786b0df tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:55.700295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-088b34dc-afea-405a-81d7-51347786b0df tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:55.701679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-088b34dc-afea-405a-81d7-51347786b0df tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.162453 Aug 01 15:38:55.714033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 428/772] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:56.185452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-968faa5c-f1d9-4031-a797-630dfb329617 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:56.186121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-968faa5c-f1d9-4031-a797-630dfb329617 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:56.192942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-968faa5c-f1d9-4031-a797-630dfb329617 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:56.193389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-968faa5c-f1d9-4031-a797-630dfb329617 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:56.194295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-968faa5c-f1d9-4031-a797-630dfb329617 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:56.194730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-968faa5c-f1d9-4031-a797-630dfb329617 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:56.332157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-968faa5c-f1d9-4031-a797-630dfb329617 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:56.341738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-9e742683-aee3-49cb-ab80-0edf33cc15fc req-a5e6dc65-4879-4ebd-9791-7e5b884ff25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6675886-2e34-4d44-b8df-0d31d3b19c02", "name": "network-vif-unplugged", "status": "completed", "tag": "6c6d11cc-7ba5-440d-b123-0214fb8dd8a2"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:38:56.342405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-968faa5c-f1d9-4031-a797-630dfb329617 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1549 microversion: 2.1 time: 0.161454 Aug 01 15:38:56.343178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 345/773] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:56 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:56.352149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-9e742683-aee3-49cb-ab80-0edf33cc15fc req-a5e6dc65-4879-4ebd-9791-7e5b884ff25e service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:56.352740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-9e742683-aee3-49cb-ab80-0edf33cc15fc req-a5e6dc65-4879-4ebd-9791-7e5b884ff25e service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:56.367765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-9e742683-aee3-49cb-ab80-0edf33cc15fc req-a5e6dc65-4879-4ebd-9791-7e5b884ff25e service nova] Creating event network-vif-unplugged:6c6d11cc-7ba5-440d-b123-0214fb8dd8a2 for instance d6675886-2e34-4d44-b8df-0d31d3b19c02 on hv-cinder-84753 Aug 01 15:38:56.374807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-9e742683-aee3-49cb-ab80-0edf33cc15fc req-a5e6dc65-4879-4ebd-9791-7e5b884ff25e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037534 Aug 01 15:38:56.375879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 429/774] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:38:56.379001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b99957e4-cf57-421b-81d2-44da0ca5c5fb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:56.380477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b99957e4-cf57-421b-81d2-44da0ca5c5fb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:56.381614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5420ecfb-865c-40d6-b139-11c20be66f38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:56.382566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5420ecfb-865c-40d6-b139-11c20be66f38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:56.391006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b99957e4-cf57-421b-81d2-44da0ca5c5fb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:56.391704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b99957e4-cf57-421b-81d2-44da0ca5c5fb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:56.392787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b99957e4-cf57-421b-81d2-44da0ca5c5fb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:56.393371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b99957e4-cf57-421b-81d2-44da0ca5c5fb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:56.394476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5420ecfb-865c-40d6-b139-11c20be66f38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:56.397642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5420ecfb-865c-40d6-b139-11c20be66f38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:56.398551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5420ecfb-865c-40d6-b139-11c20be66f38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:56.399010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5420ecfb-865c-40d6-b139-11c20be66f38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:56.443878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:38:56.720367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b99957e4-cf57-421b-81d2-44da0ca5c5fb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:56.731010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b99957e4-cf57-421b-81d2-44da0ca5c5fb tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1549 microversion: 2.1 time: 0.361827 Aug 01 15:38:56.731630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 346/775] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:56 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1549 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:56.746184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5420ecfb-865c-40d6-b139-11c20be66f38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:56.752205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9314e92e-4a1f-41eb-8e36-57ccaf95eecd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:56.753147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9314e92e-4a1f-41eb-8e36-57ccaf95eecd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:56.754343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5420ecfb-865c-40d6-b139-11c20be66f38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1260 microversion: 2.1 time: 0.376271 Aug 01 15:38:56.755227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 430/776] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:56 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1260 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:56.760756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-93c8a675-d0de-42f9-a23b-5866178f090f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:56.762143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-93c8a675-d0de-42f9-a23b-5866178f090f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:56.770223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93c8a675-d0de-42f9-a23b-5866178f090f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:56.770674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93c8a675-d0de-42f9-a23b-5866178f090f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:56.771463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93c8a675-d0de-42f9-a23b-5866178f090f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:56.772142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93c8a675-d0de-42f9-a23b-5866178f090f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:56.777036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9314e92e-4a1f-41eb-8e36-57ccaf95eecd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:56.777488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9314e92e-4a1f-41eb-8e36-57ccaf95eecd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:56.778307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9314e92e-4a1f-41eb-8e36-57ccaf95eecd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:56.778946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9314e92e-4a1f-41eb-8e36-57ccaf95eecd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:57.128389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9314e92e-4a1f-41eb-8e36-57ccaf95eecd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:57.133220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-93c8a675-d0de-42f9-a23b-5866178f090f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:57.136440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9314e92e-4a1f-41eb-8e36-57ccaf95eecd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1680 microversion: 2.1 time: 0.388646 Aug 01 15:38:57.137122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 347/777] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:56 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1680 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:57.142894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-270f813d-b075-4d02-a7d6-ab4c6e2f5e7c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:57.143700 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-93c8a675-d0de-42f9-a23b-5866178f090f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:57.145368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-93c8a675-d0de-42f9-a23b-5866178f090f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:57.146586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-93c8a675-d0de-42f9-a23b-5866178f090f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.390359 Aug 01 15:38:57.150035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-270f813d-b075-4d02-a7d6-ab4c6e2f5e7c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:57.151088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-270f813d-b075-4d02-a7d6-ab4c6e2f5e7c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Searching by: {'deleted': False, 'project_id': '3762799522514a268a4c8b8069baa882'} {{(pid=124526) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 15:38:57.155559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 431/778] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:57.159409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-270f813d-b075-4d02-a7d6-ab4c6e2f5e7c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:57.159956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-270f813d-b075-4d02-a7d6-ab4c6e2f5e7c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:57.160860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-270f813d-b075-4d02-a7d6-ab4c6e2f5e7c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:57.161428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-270f813d-b075-4d02-a7d6-ab4c6e2f5e7c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:57.261980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.multi_cell_list [None req-270f813d-b075-4d02-a7d6-ab4c6e2f5e7c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124526) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 15:38:57.367393 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-270f813d-b075-4d02-a7d6-ab4c6e2f5e7c tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.229184 Aug 01 15:38:57.368124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 348/779] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 1 15:38:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:38:57.381958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b8d8f96e-e891-469a-887f-9d6e0bd78260 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:57.382579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b8d8f96e-e891-469a-887f-9d6e0bd78260 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:57.392173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b8d8f96e-e891-469a-887f-9d6e0bd78260 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:57.392872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b8d8f96e-e891-469a-887f-9d6e0bd78260 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:57.395554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b8d8f96e-e891-469a-887f-9d6e0bd78260 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:57.396474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b8d8f96e-e891-469a-887f-9d6e0bd78260 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:57.631392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b8d8f96e-e891-469a-887f-9d6e0bd78260 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:57.639849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b8d8f96e-e891-469a-887f-9d6e0bd78260 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1549 microversion: 2.1 time: 0.262904 Aug 01 15:38:57.640417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 432/780] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:57 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1549 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:57.721784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-04e944a5-22a1-4954-9e1b-c2525954beb5 req-86a157f2-98b3-4fe6-9794-44edca2856f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6675886-2e34-4d44-b8df-0d31d3b19c02", "name": "network-vif-deleted", "tag": "6c6d11cc-7ba5-440d-b123-0214fb8dd8a2"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:38:57.733082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-04e944a5-22a1-4954-9e1b-c2525954beb5 req-86a157f2-98b3-4fe6-9794-44edca2856f8 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:57.733519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-04e944a5-22a1-4954-9e1b-c2525954beb5 req-86a157f2-98b3-4fe6-9794-44edca2856f8 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:57.744752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-04e944a5-22a1-4954-9e1b-c2525954beb5 req-86a157f2-98b3-4fe6-9794-44edca2856f8 service nova] Creating event network-vif-deleted:6c6d11cc-7ba5-440d-b123-0214fb8dd8a2 for instance d6675886-2e34-4d44-b8df-0d31d3b19c02 on hv-cinder-84753 Aug 01 15:38:57.750354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-04e944a5-22a1-4954-9e1b-c2525954beb5 req-86a157f2-98b3-4fe6-9794-44edca2856f8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032713 Aug 01 15:38:57.751286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 349/781] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:38:57.777368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3e89f74f-7112-4225-be6d-2b669e72dbcc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:57.779228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3e89f74f-7112-4225-be6d-2b669e72dbcc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:57.785710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3e89f74f-7112-4225-be6d-2b669e72dbcc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:57.786505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3e89f74f-7112-4225-be6d-2b669e72dbcc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:57.789935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3e89f74f-7112-4225-be6d-2b669e72dbcc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:57.790781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3e89f74f-7112-4225-be6d-2b669e72dbcc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:57.978670 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3e89f74f-7112-4225-be6d-2b669e72dbcc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:57.988318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3e89f74f-7112-4225-be6d-2b669e72dbcc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1444 microversion: 2.1 time: 0.215458 Aug 01 15:38:58.015392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-511e57a0-9459-408f-b0bd-72406395b01e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:58.016274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-511e57a0-9459-408f-b0bd-72406395b01e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:58.018948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 433/782] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:57 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1444 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:58.024276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-511e57a0-9459-408f-b0bd-72406395b01e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:58.026180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-511e57a0-9459-408f-b0bd-72406395b01e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:58.027036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-511e57a0-9459-408f-b0bd-72406395b01e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:58.027485 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-511e57a0-9459-408f-b0bd-72406395b01e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:58.164844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1c0404f2-4d57-496f-b9fa-6afd48cb5e97 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:58.167397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1c0404f2-4d57-496f-b9fa-6afd48cb5e97 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:58.206272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c0404f2-4d57-496f-b9fa-6afd48cb5e97 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:58.206940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c0404f2-4d57-496f-b9fa-6afd48cb5e97 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:58.208708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c0404f2-4d57-496f-b9fa-6afd48cb5e97 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:58.210868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c0404f2-4d57-496f-b9fa-6afd48cb5e97 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:58.263115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c0404f2-4d57-496f-b9fa-6afd48cb5e97 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:58.263721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c0404f2-4d57-496f-b9fa-6afd48cb5e97 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:58.264309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-1c0404f2-4d57-496f-b9fa-6afd48cb5e97 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lazy-loading 'fault' on Instance uuid d6675886-2e34-4d44-b8df-0d31d3b19c02 {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:38:58.274856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-511e57a0-9459-408f-b0bd-72406395b01e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:58.286898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-511e57a0-9459-408f-b0bd-72406395b01e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1444 microversion: 2.1 time: 0.276366 Aug 01 15:38:58.287907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 350/783] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:58 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1444 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:58.311659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d94e2a82-6abe-4c9e-a395-79ccbd065ab5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:58.312372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d94e2a82-6abe-4c9e-a395-79ccbd065ab5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:58.319584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d94e2a82-6abe-4c9e-a395-79ccbd065ab5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:58.320120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d94e2a82-6abe-4c9e-a395-79ccbd065ab5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:58.320973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d94e2a82-6abe-4c9e-a395-79ccbd065ab5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:58.321479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d94e2a82-6abe-4c9e-a395-79ccbd065ab5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:58.359476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c0404f2-4d57-496f-b9fa-6afd48cb5e97 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:58.369569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1c0404f2-4d57-496f-b9fa-6afd48cb5e97 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1330 microversion: 2.1 time: 0.211413 Aug 01 15:38:58.370885 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 434/784] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:58 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1330 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:58.492905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d94e2a82-6abe-4c9e-a395-79ccbd065ab5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:58.502257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d94e2a82-6abe-4c9e-a395-79ccbd065ab5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:58.504498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d94e2a82-6abe-4c9e-a395-79ccbd065ab5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:58.505748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d94e2a82-6abe-4c9e-a395-79ccbd065ab5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.213554 Aug 01 15:38:58.520192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 351/785] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:38:58.700287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-a084e0da-a976-4743-a659-4dc646a912e4 req-e671fbd3-c27f-4d94-b11e-066b115f51a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df", "name": "network-vif-plugged", "status": "completed", "tag": "ce819b69-03c1-4584-9ef2-0228b13d3351"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:38:58.730679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-a084e0da-a976-4743-a659-4dc646a912e4 req-e671fbd3-c27f-4d94-b11e-066b115f51a5 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:58.731298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-a084e0da-a976-4743-a659-4dc646a912e4 req-e671fbd3-c27f-4d94-b11e-066b115f51a5 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:58.743507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-a084e0da-a976-4743-a659-4dc646a912e4 req-e671fbd3-c27f-4d94-b11e-066b115f51a5 service nova] Creating event network-vif-plugged:ce819b69-03c1-4584-9ef2-0228b13d3351 for instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df on hv-cinder-84753 Aug 01 15:38:58.749631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-a084e0da-a976-4743-a659-4dc646a912e4 req-e671fbd3-c27f-4d94-b11e-066b115f51a5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052997 Aug 01 15:38:58.750848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 435/786] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:38:59.174798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:38:59.176814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:38:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:38:59.391594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-185fef77-78fe-4533-8ea9-a07fa95fb7c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:59.392554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-185fef77-78fe-4533-8ea9-a07fa95fb7c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:59.403487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-185fef77-78fe-4533-8ea9-a07fa95fb7c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:59.404400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-185fef77-78fe-4533-8ea9-a07fa95fb7c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:59.405567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-185fef77-78fe-4533-8ea9-a07fa95fb7c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:59.406266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-185fef77-78fe-4533-8ea9-a07fa95fb7c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:59.462674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-185fef77-78fe-4533-8ea9-a07fa95fb7c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:59.463112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-185fef77-78fe-4533-8ea9-a07fa95fb7c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:59.463568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.objects.instance [None req-185fef77-78fe-4533-8ea9-a07fa95fb7c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lazy-loading 'fault' on Instance uuid d6675886-2e34-4d44-b8df-0d31d3b19c02 {{(pid=124526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:38:59.516781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-185fef77-78fe-4533-8ea9-a07fa95fb7c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:59.527815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-185fef77-78fe-4533-8ea9-a07fa95fb7c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 200 len: 1330 microversion: 2.1 time: 0.138381 Aug 01 15:38:59.533263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 352/787] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:38:59 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 1330 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:38:59.535775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-611c675d-9c73-4d85-b0ca-f08cdda41303 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:38:59.536662 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-611c675d-9c73-4d85-b0ca-f08cdda41303 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:38:59.544224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-611c675d-9c73-4d85-b0ca-f08cdda41303 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:59.544866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-611c675d-9c73-4d85-b0ca-f08cdda41303 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:59.545649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-611c675d-9c73-4d85-b0ca-f08cdda41303 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:38:59.546275 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-611c675d-9c73-4d85-b0ca-f08cdda41303 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:38:59.739485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-611c675d-9c73-4d85-b0ca-f08cdda41303 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:59.751204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-611c675d-9c73-4d85-b0ca-f08cdda41303 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:59.753289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-611c675d-9c73-4d85-b0ca-f08cdda41303 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:38:59.754890 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-611c675d-9c73-4d85-b0ca-f08cdda41303 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.223461 Aug 01 15:38:59.755458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 436/788] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:38:59 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:39:00.356657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-7c25a776-1eb8-462d-b16f-869842fa871d req-161d1d26-55e4-4635-81da-648bb15ac4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f0755f-45c5-4c98-96b7-9c4b6415d331", "tag": "6c507929-7001-4435-a0b5-2d19c503a391"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:39:00.366360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-7c25a776-1eb8-462d-b16f-869842fa871d req-161d1d26-55e4-4635-81da-648bb15ac4cf service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:00.366800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-7c25a776-1eb8-462d-b16f-869842fa871d req-161d1d26-55e4-4635-81da-648bb15ac4cf service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:00.380996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-7c25a776-1eb8-462d-b16f-869842fa871d req-161d1d26-55e4-4635-81da-648bb15ac4cf service nova] Creating event network-changed:6c507929-7001-4435-a0b5-2d19c503a391 for instance 58f0755f-45c5-4c98-96b7-9c4b6415d331 on hv-cinder-84753 Aug 01 15:39:00.386592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-7c25a776-1eb8-462d-b16f-869842fa871d req-161d1d26-55e4-4635-81da-648bb15ac4cf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033786 Aug 01 15:39:00.387201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 353/789] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:00.548871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-af8fd020-2c07-4d90-8b82-46a2bfc65d70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:00.549961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-af8fd020-2c07-4d90-8b82-46a2bfc65d70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:00.556575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af8fd020-2c07-4d90-8b82-46a2bfc65d70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:00.557097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af8fd020-2c07-4d90-8b82-46a2bfc65d70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:00.558649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af8fd020-2c07-4d90-8b82-46a2bfc65d70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:00.559108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af8fd020-2c07-4d90-8b82-46a2bfc65d70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:00.572967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-af8fd020-2c07-4d90-8b82-46a2bfc65d70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] HTTP exception thrown: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-af8fd020-2c07-4d90-8b82-46a2bfc65d70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Request method failure captured: Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 HTTP/1.1 Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_Jxd-2ufNMN6bINeUmVCl_C9neMK8VdVzqFhqxrGaNIW-B6K_BKgRY4QYs-OcVvyfk27GiPKwGgK9Vq2wAaDj7GUJJEXHP3a9XGW-l3GNaaACveTa98UrKY44ovMddLQPKJR39OU0WJEqLcH2PIF975xCsK1INaNMVRtS4ciRy7eWQ Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:39:00.574631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:39:00.576268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}] Aug 01 15:39:00.576268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeNegativeTest-358638272 Aug 01 15:39:00.576268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 15:39:00.576268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 15:39:00.576268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 15:39:00.576268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:39:00.576268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:39:00.576268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 4001e8ec57b34f57aae1654fad9217f8 Aug 01 15:39:00.576268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 15:39:00.576268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 15:39:00.576268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 15:39:00.576268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': 'd6675886-2e34-4d44-b8df-0d31d3b19c02'} Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:39:00.577110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 15:39:00.578452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:39:00.579560 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-af8fd020-2c07-4d90-8b82-46a2bfc65d70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Returning 404 to user: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:39:00.579560 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-af8fd020-2c07-4d90-8b82-46a2bfc65d70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 404 len: 111 microversion: 2.1 time: 0.031083 Aug 01 15:39:00.579560 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 437/790] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:39:00 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:39:00.585612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c08cfa6a-0c97-41f5-afa4-21b5a8d99570 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '.version_select at 0x7feb160e7310>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:00.606849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c08cfa6a-0c97-41f5-afa4-21b5a8d99570 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-241029234" status: 202 len: 0 microversion: 2.1 time: 0.025249 Aug 01 15:39:00.607435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 354/791] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 1 15:39:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-241029234 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:39:00.790983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-26073b1e-9850-46b0-8185-19148a5ae253 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:00.793734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-26073b1e-9850-46b0-8185-19148a5ae253 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:00.804008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26073b1e-9850-46b0-8185-19148a5ae253 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:00.804737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26073b1e-9850-46b0-8185-19148a5ae253 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:00.805682 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26073b1e-9850-46b0-8185-19148a5ae253 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:00.806559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26073b1e-9850-46b0-8185-19148a5ae253 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:01.115268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-26073b1e-9850-46b0-8185-19148a5ae253 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:39:01.131548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-26073b1e-9850-46b0-8185-19148a5ae253 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:39:01.134297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-26073b1e-9850-46b0-8185-19148a5ae253 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:39:01.135800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-26073b1e-9850-46b0-8185-19148a5ae253 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.360523 Aug 01 15:39:01.136358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 438/792] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:39:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:39:01.560631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-064c7d8f-a644-40c7-b775-6de3703c503b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:01.561262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-064c7d8f-a644-40c7-b775-6de3703c503b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:01.570133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-064c7d8f-a644-40c7-b775-6de3703c503b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:01.570654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-064c7d8f-a644-40c7-b775-6de3703c503b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:01.571497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-064c7d8f-a644-40c7-b775-6de3703c503b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:01.572079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-064c7d8f-a644-40c7-b775-6de3703c503b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:01.716098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.objects.instance [None req-064c7d8f-a644-40c7-b775-6de3703c503b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lazy-loading 'services' on Instance uuid 2122c9a8-db75-40b5-bbbe-9c83c983d961 {{(pid=124526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:39:01.889438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-064c7d8f-a644-40c7-b775-6de3703c503b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments/a3a8e36e-425b-4e66-aa20-f5f4927c91e4" status: 202 len: 0 microversion: 2.1 time: 0.333432 Aug 01 15:39:01.890324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 355/793] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 1 15:39:01 2022] DELETE /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments/a3a8e36e-425b-4e66-aa20-f5f4927c91e4 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:39:01.902394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ca3032b3-b002-46be-80b1-c4cb197fd134 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:01.902394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ca3032b3-b002-46be-80b1-c4cb197fd134 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:01.909178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca3032b3-b002-46be-80b1-c4cb197fd134 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:01.909635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca3032b3-b002-46be-80b1-c4cb197fd134 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:01.910453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca3032b3-b002-46be-80b1-c4cb197fd134 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:01.910892 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca3032b3-b002-46be-80b1-c4cb197fd134 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:01.944870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ca3032b3-b002-46be-80b1-c4cb197fd134 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050165 Aug 01 15:39:01.945578 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 439/794] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:01 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:02.161807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-98262f63-a44a-417d-a709-0e171452913c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:02.162617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-98262f63-a44a-417d-a709-0e171452913c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:02.169521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98262f63-a44a-417d-a709-0e171452913c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:02.170010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98262f63-a44a-417d-a709-0e171452913c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:02.170780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98262f63-a44a-417d-a709-0e171452913c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:02.171218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98262f63-a44a-417d-a709-0e171452913c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:02.319010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-98262f63-a44a-417d-a709-0e171452913c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:39:02.327671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-98262f63-a44a-417d-a709-0e171452913c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:39:02.329161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-98262f63-a44a-417d-a709-0e171452913c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:39:02.330348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-98262f63-a44a-417d-a709-0e171452913c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1809 microversion: 2.20 time: 0.173287 Aug 01 15:39:02.330905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 356/795] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:39:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:39:02.958136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cd0d86f4-bc7d-44c2-8889-1969e1668ec4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:02.960354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cd0d86f4-bc7d-44c2-8889-1969e1668ec4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:02.967771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd0d86f4-bc7d-44c2-8889-1969e1668ec4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:02.968227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd0d86f4-bc7d-44c2-8889-1969e1668ec4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:02.968993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd0d86f4-bc7d-44c2-8889-1969e1668ec4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:02.969428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd0d86f4-bc7d-44c2-8889-1969e1668ec4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:02.998415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cd0d86f4-bc7d-44c2-8889-1969e1668ec4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Aug 01 15:39:02.998973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 440/796] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:02 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:03.455998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-af2e6711-737b-4163-809b-80a3aee85b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:03.456619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-af2e6711-737b-4163-809b-80a3aee85b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:03.463458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af2e6711-737b-4163-809b-80a3aee85b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:03.463929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af2e6711-737b-4163-809b-80a3aee85b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:03.464703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af2e6711-737b-4163-809b-80a3aee85b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:03.465396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af2e6711-737b-4163-809b-80a3aee85b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:03.612939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-af2e6711-737b-4163-809b-80a3aee85b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:39:03.622098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-af2e6711-737b-4163-809b-80a3aee85b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:39:03.623597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-af2e6711-737b-4163-809b-80a3aee85b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:39:03.624750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-af2e6711-737b-4163-809b-80a3aee85b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1796 microversion: 2.20 time: 0.275315 Aug 01 15:39:03.625358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 357/797] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:39:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1796 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:39:04.010894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ad1cfd12-c067-47c0-99bc-0a0f26655a69 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:04.013053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ad1cfd12-c067-47c0-99bc-0a0f26655a69 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:04.019639 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad1cfd12-c067-47c0-99bc-0a0f26655a69 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:04.020090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad1cfd12-c067-47c0-99bc-0a0f26655a69 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:04.020859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad1cfd12-c067-47c0-99bc-0a0f26655a69 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:04.021296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad1cfd12-c067-47c0-99bc-0a0f26655a69 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:04.051043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ad1cfd12-c067-47c0-99bc-0a0f26655a69 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044081 Aug 01 15:39:04.051607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 441/798] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:04 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:05.063251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1c85a383-dfab-4252-bd91-083b2ca76c90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:05.065686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1c85a383-dfab-4252-bd91-083b2ca76c90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:05.072291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c85a383-dfab-4252-bd91-083b2ca76c90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:05.072737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c85a383-dfab-4252-bd91-083b2ca76c90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:05.073506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c85a383-dfab-4252-bd91-083b2ca76c90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:05.074001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c85a383-dfab-4252-bd91-083b2ca76c90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:05.107409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1c85a383-dfab-4252-bd91-083b2ca76c90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048812 Aug 01 15:39:05.107962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 358/799] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:05 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:06.119440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5b4f9c76-a3fd-4e9f-9109-406adc8cea52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:06.121559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5b4f9c76-a3fd-4e9f-9109-406adc8cea52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:06.128236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b4f9c76-a3fd-4e9f-9109-406adc8cea52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:06.128681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b4f9c76-a3fd-4e9f-9109-406adc8cea52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:06.129556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b4f9c76-a3fd-4e9f-9109-406adc8cea52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:06.130016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b4f9c76-a3fd-4e9f-9109-406adc8cea52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:06.160220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5b4f9c76-a3fd-4e9f-9109-406adc8cea52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044680 Aug 01 15:39:06.160773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 442/800] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:06 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:06.179116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:39:06.179601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:39:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:39:07.173633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1edcc4e0-de9a-4b23-9ad2-93df8e58446a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:07.175770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1edcc4e0-de9a-4b23-9ad2-93df8e58446a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:07.182517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1edcc4e0-de9a-4b23-9ad2-93df8e58446a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:07.183063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1edcc4e0-de9a-4b23-9ad2-93df8e58446a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:07.183783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1edcc4e0-de9a-4b23-9ad2-93df8e58446a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:07.184220 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1edcc4e0-de9a-4b23-9ad2-93df8e58446a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:07.197833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=2 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:07.214654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1edcc4e0-de9a-4b23-9ad2-93df8e58446a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045075 Aug 01 15:39:07.215736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 359/801] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:07 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:08.227285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bf5b55e3-d59a-4aed-a321-31bdb1802383 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:08.229484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bf5b55e3-d59a-4aed-a321-31bdb1802383 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:08.237485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf5b55e3-d59a-4aed-a321-31bdb1802383 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:08.238030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf5b55e3-d59a-4aed-a321-31bdb1802383 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:08.238802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf5b55e3-d59a-4aed-a321-31bdb1802383 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:08.239230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf5b55e3-d59a-4aed-a321-31bdb1802383 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:08.268391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bf5b55e3-d59a-4aed-a321-31bdb1802383 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Aug 01 15:39:08.269236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 443/802] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:08 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:09.281237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8e208093-79d9-48d4-9bc7-3305c5821e3d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:09.283391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8e208093-79d9-48d4-9bc7-3305c5821e3d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:09.289972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e208093-79d9-48d4-9bc7-3305c5821e3d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:09.290420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e208093-79d9-48d4-9bc7-3305c5821e3d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:09.291182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e208093-79d9-48d4-9bc7-3305c5821e3d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:09.291615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e208093-79d9-48d4-9bc7-3305c5821e3d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:09.296054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:09.323665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8e208093-79d9-48d4-9bc7-3305c5821e3d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046862 Aug 01 15:39:09.324210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 360/803] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:09 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:10.335958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d5c0a8bf-73c1-4baa-9281-b13e9f14f59a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:10.338063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d5c0a8bf-73c1-4baa-9281-b13e9f14f59a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:10.344859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5c0a8bf-73c1-4baa-9281-b13e9f14f59a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:10.345309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5c0a8bf-73c1-4baa-9281-b13e9f14f59a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:10.346108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5c0a8bf-73c1-4baa-9281-b13e9f14f59a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:10.346545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5c0a8bf-73c1-4baa-9281-b13e9f14f59a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:10.383294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d5c0a8bf-73c1-4baa-9281-b13e9f14f59a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051285 Aug 01 15:39:10.383872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 444/804] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:10 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:11.496862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-01c6d689-4079-4906-94ee-69cb908c2d4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:11.499021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-01c6d689-4079-4906-94ee-69cb908c2d4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:11.504962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-01c6d689-4079-4906-94ee-69cb908c2d4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:11.505417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-01c6d689-4079-4906-94ee-69cb908c2d4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:11.506215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-01c6d689-4079-4906-94ee-69cb908c2d4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:11.506653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-01c6d689-4079-4906-94ee-69cb908c2d4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:11.536317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-01c6d689-4079-4906-94ee-69cb908c2d4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144506 Aug 01 15:39:11.536899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 361/805] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:11 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:12.549083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-401503ce-10b1-4be1-b2c1-cc1bd5064062 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:12.551340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-401503ce-10b1-4be1-b2c1-cc1bd5064062 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:12.558033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-401503ce-10b1-4be1-b2c1-cc1bd5064062 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:12.558491 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-401503ce-10b1-4be1-b2c1-cc1bd5064062 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:12.559918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-401503ce-10b1-4be1-b2c1-cc1bd5064062 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:12.560354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-401503ce-10b1-4be1-b2c1-cc1bd5064062 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:12.738311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-401503ce-10b1-4be1-b2c1-cc1bd5064062 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193123 Aug 01 15:39:12.738877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 445/806] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:12 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:13.751153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5f9b9e71-9dfc-4a95-ae41-2cb91a040f54 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:13.753290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5f9b9e71-9dfc-4a95-ae41-2cb91a040f54 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:13.759990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f9b9e71-9dfc-4a95-ae41-2cb91a040f54 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:13.760455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f9b9e71-9dfc-4a95-ae41-2cb91a040f54 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:13.761207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f9b9e71-9dfc-4a95-ae41-2cb91a040f54 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:13.762744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f9b9e71-9dfc-4a95-ae41-2cb91a040f54 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:13.803377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5f9b9e71-9dfc-4a95-ae41-2cb91a040f54 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055957 Aug 01 15:39:13.803880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 362/807] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:13 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:14.818567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e6fb349b-4c7d-4ffb-9cfb-78b9b699fc0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:14.820582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e6fb349b-4c7d-4ffb-9cfb-78b9b699fc0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:14.827214 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e6fb349b-4c7d-4ffb-9cfb-78b9b699fc0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:14.827665 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e6fb349b-4c7d-4ffb-9cfb-78b9b699fc0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:14.828430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e6fb349b-4c7d-4ffb-9cfb-78b9b699fc0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:14.828870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e6fb349b-4c7d-4ffb-9cfb-78b9b699fc0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:14.859164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e6fb349b-4c7d-4ffb-9cfb-78b9b699fc0e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Aug 01 15:39:14.859709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 446/808] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:14 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:15.871212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-35ce9b63-3cb5-4d5e-9623-271be8fa16f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:15.873847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-35ce9b63-3cb5-4d5e-9623-271be8fa16f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:15.880332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35ce9b63-3cb5-4d5e-9623-271be8fa16f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:15.880784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35ce9b63-3cb5-4d5e-9623-271be8fa16f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:15.881547 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35ce9b63-3cb5-4d5e-9623-271be8fa16f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:15.882014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35ce9b63-3cb5-4d5e-9623-271be8fa16f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:15.914004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-35ce9b63-3cb5-4d5e-9623-271be8fa16f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046530 Aug 01 15:39:15.914567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 363/809] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:15 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:16.927206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-48f8e543-d257-4c73-892c-d30cf327b527 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:16.929237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-48f8e543-d257-4c73-892c-d30cf327b527 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:16.935488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-48f8e543-d257-4c73-892c-d30cf327b527 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:16.935936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-48f8e543-d257-4c73-892c-d30cf327b527 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:16.936694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-48f8e543-d257-4c73-892c-d30cf327b527 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:16.937131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-48f8e543-d257-4c73-892c-d30cf327b527 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:16.965877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-48f8e543-d257-4c73-892c-d30cf327b527 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042433 Aug 01 15:39:16.966436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 447/810] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:16 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:17.978954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4e873ae2-5ee2-429d-b0b4-3d867a6503b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:17.981027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4e873ae2-5ee2-429d-b0b4-3d867a6503b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:17.983915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:17.989415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e873ae2-5ee2-429d-b0b4-3d867a6503b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:17.989864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e873ae2-5ee2-429d-b0b4-3d867a6503b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:17.990687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e873ae2-5ee2-429d-b0b4-3d867a6503b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:17.991119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e873ae2-5ee2-429d-b0b4-3d867a6503b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:18.021180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4e873ae2-5ee2-429d-b0b4-3d867a6503b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046203 Aug 01 15:39:18.021738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 364/811] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:17 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:19.033856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cc007ccc-4756-4c55-baae-63c7379d7aa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:19.036004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cc007ccc-4756-4c55-baae-63c7379d7aa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:19.042631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc007ccc-4756-4c55-baae-63c7379d7aa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:19.043024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc007ccc-4756-4c55-baae-63c7379d7aa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:19.043788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc007ccc-4756-4c55-baae-63c7379d7aa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:19.044224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc007ccc-4756-4c55-baae-63c7379d7aa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:19.047922 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:19.074959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cc007ccc-4756-4c55-baae-63c7379d7aa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Aug 01 15:39:19.075511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 448/812] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:19 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:20.088105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5c504e9d-d173-4cb8-a926-711c30f5dcad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:20.090647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5c504e9d-d173-4cb8-a926-711c30f5dcad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:20.097835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c504e9d-d173-4cb8-a926-711c30f5dcad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:20.098283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c504e9d-d173-4cb8-a926-711c30f5dcad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:20.099048 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c504e9d-d173-4cb8-a926-711c30f5dcad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:20.099486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c504e9d-d173-4cb8-a926-711c30f5dcad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:20.128932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5c504e9d-d173-4cb8-a926-711c30f5dcad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044777 Aug 01 15:39:20.129492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 365/813] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:20 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:21.141953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b7b3bc37-7d46-47f7-936d-b98a69fe0a14 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:21.144085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b7b3bc37-7d46-47f7-936d-b98a69fe0a14 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:21.150750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7b3bc37-7d46-47f7-936d-b98a69fe0a14 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:21.151145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7b3bc37-7d46-47f7-936d-b98a69fe0a14 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:21.151911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7b3bc37-7d46-47f7-936d-b98a69fe0a14 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:21.152349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7b3bc37-7d46-47f7-936d-b98a69fe0a14 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:21.180798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b7b3bc37-7d46-47f7-936d-b98a69fe0a14 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043464 Aug 01 15:39:21.181345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 449/814] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:21 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:21.798893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:39:21.799111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:39:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:39:22.192870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f4923435-1023-495e-869c-8a43e9984151 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:22.195328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f4923435-1023-495e-869c-8a43e9984151 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:22.202634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4923435-1023-495e-869c-8a43e9984151 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:22.203076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4923435-1023-495e-869c-8a43e9984151 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:22.203839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4923435-1023-495e-869c-8a43e9984151 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:22.204278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4923435-1023-495e-869c-8a43e9984151 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:22.234334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f4923435-1023-495e-869c-8a43e9984151 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045350 Aug 01 15:39:22.234808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 366/815] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:22 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:23.246644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0356eaf3-4ad0-4488-92c9-967d722f54f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:23.248766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0356eaf3-4ad0-4488-92c9-967d722f54f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:23.255440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0356eaf3-4ad0-4488-92c9-967d722f54f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:23.255889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0356eaf3-4ad0-4488-92c9-967d722f54f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:23.256644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0356eaf3-4ad0-4488-92c9-967d722f54f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:23.257072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0356eaf3-4ad0-4488-92c9-967d722f54f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:23.286574 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0356eaf3-4ad0-4488-92c9-967d722f54f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 Aug 01 15:39:23.287046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 450/816] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:23 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:24.299299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c2c0dea1-2ecb-4100-9a85-7df30f50e13d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:24.301461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c2c0dea1-2ecb-4100-9a85-7df30f50e13d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:24.308061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c2c0dea1-2ecb-4100-9a85-7df30f50e13d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:24.308448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c2c0dea1-2ecb-4100-9a85-7df30f50e13d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:24.309207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c2c0dea1-2ecb-4100-9a85-7df30f50e13d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:24.309670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c2c0dea1-2ecb-4100-9a85-7df30f50e13d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:24.338298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c2c0dea1-2ecb-4100-9a85-7df30f50e13d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043537 Aug 01 15:39:24.338853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 367/817] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:24 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:25.350847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cd8903df-c99d-4846-92f1-82c904b58b24 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:25.352964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cd8903df-c99d-4846-92f1-82c904b58b24 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:25.359944 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd8903df-c99d-4846-92f1-82c904b58b24 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:25.360390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd8903df-c99d-4846-92f1-82c904b58b24 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:25.361152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd8903df-c99d-4846-92f1-82c904b58b24 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:25.361588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd8903df-c99d-4846-92f1-82c904b58b24 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:25.391952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cd8903df-c99d-4846-92f1-82c904b58b24 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044974 Aug 01 15:39:25.392411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 451/818] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:25 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:26.404194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7aec374d-01cd-45b0-9b6c-5cd4511de903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:26.406886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7aec374d-01cd-45b0-9b6c-5cd4511de903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:26.413386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aec374d-01cd-45b0-9b6c-5cd4511de903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:26.413842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aec374d-01cd-45b0-9b6c-5cd4511de903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:26.414706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aec374d-01cd-45b0-9b6c-5cd4511de903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:26.415144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aec374d-01cd-45b0-9b6c-5cd4511de903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:26.444529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7aec374d-01cd-45b0-9b6c-5cd4511de903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Aug 01 15:39:26.445012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 368/819] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:26 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:27.457585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d4503969-9031-4389-a70e-a7ed2c82b33c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:27.459780 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d4503969-9031-4389-a70e-a7ed2c82b33c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:27.462200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=50 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:27.468077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d4503969-9031-4389-a70e-a7ed2c82b33c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:27.468525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d4503969-9031-4389-a70e-a7ed2c82b33c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:27.469307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d4503969-9031-4389-a70e-a7ed2c82b33c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:27.469743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d4503969-9031-4389-a70e-a7ed2c82b33c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:27.500170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d4503969-9031-4389-a70e-a7ed2c82b33c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046655 Aug 01 15:39:27.500630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 452/820] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:27 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:28.512606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bf2223fb-60ff-4a16-8efc-f63aedde232e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:28.515193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bf2223fb-60ff-4a16-8efc-f63aedde232e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:28.521771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf2223fb-60ff-4a16-8efc-f63aedde232e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:28.522247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf2223fb-60ff-4a16-8efc-f63aedde232e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:28.523001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf2223fb-60ff-4a16-8efc-f63aedde232e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:28.523431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf2223fb-60ff-4a16-8efc-f63aedde232e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:28.552703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bf2223fb-60ff-4a16-8efc-f63aedde232e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Aug 01 15:39:28.553171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 369/821] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:28 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:29.564958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4d1c3002-25f3-42bd-8a46-00c2e8f72cb3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:29.567109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4d1c3002-25f3-42bd-8a46-00c2e8f72cb3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:29.573694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d1c3002-25f3-42bd-8a46-00c2e8f72cb3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:29.574186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d1c3002-25f3-42bd-8a46-00c2e8f72cb3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:29.574949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d1c3002-25f3-42bd-8a46-00c2e8f72cb3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:29.575385 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d1c3002-25f3-42bd-8a46-00c2e8f72cb3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:29.604302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4d1c3002-25f3-42bd-8a46-00c2e8f72cb3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Aug 01 15:39:29.604845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 453/822] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:29 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:30.618176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4f95d655-7036-4b36-b9fb-c0a83ee25c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:30.620341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4f95d655-7036-4b36-b9fb-c0a83ee25c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:30.627635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f95d655-7036-4b36-b9fb-c0a83ee25c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:30.628117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f95d655-7036-4b36-b9fb-c0a83ee25c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:30.628894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f95d655-7036-4b36-b9fb-c0a83ee25c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:30.629329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f95d655-7036-4b36-b9fb-c0a83ee25c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:30.659788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4f95d655-7036-4b36-b9fb-c0a83ee25c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Aug 01 15:39:30.660489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 370/823] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:39:31.672061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2b713e76-b9c6-4280-a728-c58d4e163552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:31.674219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2b713e76-b9c6-4280-a728-c58d4e163552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:31.681539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b713e76-b9c6-4280-a728-c58d4e163552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:31.682035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b713e76-b9c6-4280-a728-c58d4e163552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:31.682817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b713e76-b9c6-4280-a728-c58d4e163552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:31.683256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b713e76-b9c6-4280-a728-c58d4e163552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:31.718832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2b713e76-b9c6-4280-a728-c58d4e163552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050640 Aug 01 15:39:31.719402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 454/824] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:31 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:32.731517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1fd5470f-1ff9-420c-8812-d638b4648ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:32.734205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1fd5470f-1ff9-420c-8812-d638b4648ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:32.740720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fd5470f-1ff9-420c-8812-d638b4648ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:32.741160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fd5470f-1ff9-420c-8812-d638b4648ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:32.741934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fd5470f-1ff9-420c-8812-d638b4648ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:32.742363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fd5470f-1ff9-420c-8812-d638b4648ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:32.772760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1fd5470f-1ff9-420c-8812-d638b4648ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Aug 01 15:39:32.773332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 371/825] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:32 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:33.786870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c40b2b4b-1446-44dd-8ee3-9271f5119d19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:33.789025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c40b2b4b-1446-44dd-8ee3-9271f5119d19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:33.795148 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c40b2b4b-1446-44dd-8ee3-9271f5119d19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:33.795595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c40b2b4b-1446-44dd-8ee3-9271f5119d19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:33.796358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c40b2b4b-1446-44dd-8ee3-9271f5119d19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:33.796796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c40b2b4b-1446-44dd-8ee3-9271f5119d19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:33.825265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c40b2b4b-1446-44dd-8ee3-9271f5119d19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043031 Aug 01 15:39:33.825823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 455/826] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:33 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:34.838647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0178dd44-cd16-4eea-87f2-9f757b810af2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:34.841065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0178dd44-cd16-4eea-87f2-9f757b810af2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:34.848030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0178dd44-cd16-4eea-87f2-9f757b810af2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:34.848459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0178dd44-cd16-4eea-87f2-9f757b810af2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:34.849214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0178dd44-cd16-4eea-87f2-9f757b810af2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:34.849644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0178dd44-cd16-4eea-87f2-9f757b810af2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:34.878825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0178dd44-cd16-4eea-87f2-9f757b810af2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Aug 01 15:39:34.879387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 372/827] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:34 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:35.890480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6f7afdf0-4eab-4385-80d5-73212b4043d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:35.892635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6f7afdf0-4eab-4385-80d5-73212b4043d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:35.899265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f7afdf0-4eab-4385-80d5-73212b4043d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:35.899714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f7afdf0-4eab-4385-80d5-73212b4043d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:35.900481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f7afdf0-4eab-4385-80d5-73212b4043d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:35.900918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f7afdf0-4eab-4385-80d5-73212b4043d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:35.930786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6f7afdf0-4eab-4385-80d5-73212b4043d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044197 Aug 01 15:39:35.931341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 456/828] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:35 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:36.943700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2ad5feec-1110-4604-9a31-0f379f539af8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:36.945880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2ad5feec-1110-4604-9a31-0f379f539af8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:36.952355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ad5feec-1110-4604-9a31-0f379f539af8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:36.953446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ad5feec-1110-4604-9a31-0f379f539af8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:36.954249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ad5feec-1110-4604-9a31-0f379f539af8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:36.954686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ad5feec-1110-4604-9a31-0f379f539af8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:36.983173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2ad5feec-1110-4604-9a31-0f379f539af8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043505 Aug 01 15:39:36.983732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 373/829] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:36 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:37.995571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-da93d851-bd9e-4b6d-8740-bc600000d4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:37.997704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-da93d851-bd9e-4b6d-8740-bc600000d4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:38.004991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da93d851-bd9e-4b6d-8740-bc600000d4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:38.005439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da93d851-bd9e-4b6d-8740-bc600000d4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:38.006253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da93d851-bd9e-4b6d-8740-bc600000d4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:38.006710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da93d851-bd9e-4b6d-8740-bc600000d4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:38.035884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-da93d851-bd9e-4b6d-8740-bc600000d4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Aug 01 15:39:38.036429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 457/830] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:37 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:39.048184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-935194b8-94b9-4f6c-9148-4910dfd1d5e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:39.050449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-935194b8-94b9-4f6c-9148-4910dfd1d5e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:39.057042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-935194b8-94b9-4f6c-9148-4910dfd1d5e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:39.057497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-935194b8-94b9-4f6c-9148-4910dfd1d5e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:39.058306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-935194b8-94b9-4f6c-9148-4910dfd1d5e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:39.058744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-935194b8-94b9-4f6c-9148-4910dfd1d5e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:39.088793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-935194b8-94b9-4f6c-9148-4910dfd1d5e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044544 Aug 01 15:39:39.089344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 374/831] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:39 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:40.101309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-95bd907c-6963-4450-b48b-965ee9cee5dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:40.103481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-95bd907c-6963-4450-b48b-965ee9cee5dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:40.110684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95bd907c-6963-4450-b48b-965ee9cee5dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:40.111131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95bd907c-6963-4450-b48b-965ee9cee5dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:40.111898 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95bd907c-6963-4450-b48b-965ee9cee5dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:40.112334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95bd907c-6963-4450-b48b-965ee9cee5dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:40.140627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-95bd907c-6963-4450-b48b-965ee9cee5dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043215 Aug 01 15:39:40.141325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 458/832] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:40 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:41.152795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c15669f9-9c0a-4a9f-8027-ff602a71bc53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:41.155096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c15669f9-9c0a-4a9f-8027-ff602a71bc53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:41.161599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c15669f9-9c0a-4a9f-8027-ff602a71bc53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:41.162088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c15669f9-9c0a-4a9f-8027-ff602a71bc53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:41.162855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c15669f9-9c0a-4a9f-8027-ff602a71bc53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:41.163289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c15669f9-9c0a-4a9f-8027-ff602a71bc53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:41.165644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=89 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:41.194963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c15669f9-9c0a-4a9f-8027-ff602a71bc53 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046088 Aug 01 15:39:41.195535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 375/833] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:42.207922 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2700ae18-f1c3-4dcf-814b-03d559a3069f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:42.210099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2700ae18-f1c3-4dcf-814b-03d559a3069f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:42.216836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2700ae18-f1c3-4dcf-814b-03d559a3069f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:42.217293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2700ae18-f1c3-4dcf-814b-03d559a3069f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:42.218180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2700ae18-f1c3-4dcf-814b-03d559a3069f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:42.218666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2700ae18-f1c3-4dcf-814b-03d559a3069f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:42.247746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2700ae18-f1c3-4dcf-814b-03d559a3069f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Aug 01 15:39:42.248302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 459/834] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:42 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:43.260795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5a86dddd-cad8-4817-8a59-352bcd325277 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:43.263018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5a86dddd-cad8-4817-8a59-352bcd325277 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:43.270075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a86dddd-cad8-4817-8a59-352bcd325277 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:43.270526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a86dddd-cad8-4817-8a59-352bcd325277 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:43.271299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a86dddd-cad8-4817-8a59-352bcd325277 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:43.271731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a86dddd-cad8-4817-8a59-352bcd325277 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:43.300524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5a86dddd-cad8-4817-8a59-352bcd325277 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Aug 01 15:39:43.301075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 376/835] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:43 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:44.312806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-19036e13-7eb9-4a91-97e3-fc46d919f21e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:44.315057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-19036e13-7eb9-4a91-97e3-fc46d919f21e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:44.321979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-19036e13-7eb9-4a91-97e3-fc46d919f21e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:44.322433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-19036e13-7eb9-4a91-97e3-fc46d919f21e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:44.323195 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-19036e13-7eb9-4a91-97e3-fc46d919f21e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:44.323633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-19036e13-7eb9-4a91-97e3-fc46d919f21e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:44.352842 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-19036e13-7eb9-4a91-97e3-fc46d919f21e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044083 Aug 01 15:39:44.353389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 460/836] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:44 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:44.962877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b0d1fe2b-cc15-4850-8fe0-e8a14b36442e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:44.963404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b0d1fe2b-cc15-4850-8fe0-e8a14b36442e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:44.970419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0d1fe2b-cc15-4850-8fe0-e8a14b36442e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:44.970872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0d1fe2b-cc15-4850-8fe0-e8a14b36442e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:44.971649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0d1fe2b-cc15-4850-8fe0-e8a14b36442e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:44.972089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0d1fe2b-cc15-4850-8fe0-e8a14b36442e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:45.000902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b0d1fe2b-cc15-4850-8fe0-e8a14b36442e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments/a9d194cf-178b-4b66-8943-721e91fa2995" status: 200 len: 194 microversion: 2.20 time: 0.041846 Aug 01 15:39:45.001480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 377/837] 10.222.0.83 () {60 vars in 1454 bytes} [Mon Aug 1 15:39:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments/a9d194cf-178b-4b66-8943-721e91fa2995 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:45.068337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1321b9d9-2498-401d-9d99-a27037a25b4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:45.068837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1321b9d9-2498-401d-9d99-a27037a25b4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:45.074928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1321b9d9-2498-401d-9d99-a27037a25b4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:45.075381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1321b9d9-2498-401d-9d99-a27037a25b4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:45.076141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1321b9d9-2498-401d-9d99-a27037a25b4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:45.076581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1321b9d9-2498-401d-9d99-a27037a25b4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:45.155809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-1321b9d9-2498-401d-9d99-a27037a25b4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lazy-loading 'services' on Instance uuid 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:39:45.239132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1321b9d9-2498-401d-9d99-a27037a25b4f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments/a9d194cf-178b-4b66-8943-721e91fa2995" status: 202 len: 0 microversion: 2.20 time: 0.174477 Aug 01 15:39:45.240435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 461/838] 10.222.0.83 () {60 vars in 1457 bytes} [Mon Aug 1 15:39:45 2022] DELETE /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments/a9d194cf-178b-4b66-8943-721e91fa2995 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:39:45.253758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-81fa1681-5c21-4944-b9b2-742ac80b5662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:45.257379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-81fa1681-5c21-4944-b9b2-742ac80b5662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:45.301075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-81fa1681-5c21-4944-b9b2-742ac80b5662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:45.301715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-81fa1681-5c21-4944-b9b2-742ac80b5662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:45.302869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-81fa1681-5c21-4944-b9b2-742ac80b5662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:45.303257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-81fa1681-5c21-4944-b9b2-742ac80b5662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:45.334452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-81fa1681-5c21-4944-b9b2-742ac80b5662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087044 Aug 01 15:39:45.335025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 378/839] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:45.365099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3a6a56c1-c541-4ebe-b279-ad3054be1da2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:45.367463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3a6a56c1-c541-4ebe-b279-ad3054be1da2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:45.373679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a6a56c1-c541-4ebe-b279-ad3054be1da2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:45.374167 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a6a56c1-c541-4ebe-b279-ad3054be1da2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:45.374929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a6a56c1-c541-4ebe-b279-ad3054be1da2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:45.375966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a6a56c1-c541-4ebe-b279-ad3054be1da2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:45.404987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3a6a56c1-c541-4ebe-b279-ad3054be1da2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Aug 01 15:39:45.405533 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 462/840] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:45 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:46.347930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6fe6d562-9b67-44fb-b0e8-c031039bfae2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:46.350103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6fe6d562-9b67-44fb-b0e8-c031039bfae2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:46.356703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6fe6d562-9b67-44fb-b0e8-c031039bfae2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:46.357155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6fe6d562-9b67-44fb-b0e8-c031039bfae2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:46.358152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6fe6d562-9b67-44fb-b0e8-c031039bfae2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:46.359065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6fe6d562-9b67-44fb-b0e8-c031039bfae2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:46.396226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6fe6d562-9b67-44fb-b0e8-c031039bfae2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052943 Aug 01 15:39:46.396815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 379/841] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:46.416919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8c6f98f5-574a-4d07-b3c5-5134997aa862 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:46.419122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8c6f98f5-574a-4d07-b3c5-5134997aa862 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:46.425692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8c6f98f5-574a-4d07-b3c5-5134997aa862 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:46.426183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8c6f98f5-574a-4d07-b3c5-5134997aa862 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:46.426953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8c6f98f5-574a-4d07-b3c5-5134997aa862 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:46.427395 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8c6f98f5-574a-4d07-b3c5-5134997aa862 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:46.457481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8c6f98f5-574a-4d07-b3c5-5134997aa862 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044586 Aug 01 15:39:46.458073 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 463/842] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:46 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:47.409131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-450c5d0c-b2d6-4562-96cb-764474ace484 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:47.411333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-450c5d0c-b2d6-4562-96cb-764474ace484 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:47.417811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-450c5d0c-b2d6-4562-96cb-764474ace484 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:47.418300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-450c5d0c-b2d6-4562-96cb-764474ace484 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:47.419068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-450c5d0c-b2d6-4562-96cb-764474ace484 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:47.419506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-450c5d0c-b2d6-4562-96cb-764474ace484 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:47.448433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-450c5d0c-b2d6-4562-96cb-764474ace484 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043736 Aug 01 15:39:47.448989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 380/843] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:47.470504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-60f865f4-cb9b-4468-9860-39817ab55af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:47.472640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-60f865f4-cb9b-4468-9860-39817ab55af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:47.479344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60f865f4-cb9b-4468-9860-39817ab55af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:47.479799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60f865f4-cb9b-4468-9860-39817ab55af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:47.480564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60f865f4-cb9b-4468-9860-39817ab55af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:47.481006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60f865f4-cb9b-4468-9860-39817ab55af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:47.485583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:47.511718 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-60f865f4-cb9b-4468-9860-39817ab55af4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045874 Aug 01 15:39:47.512271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 464/844] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:47 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:48.460868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a31328df-c09f-40a9-99ac-a10334359957 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:48.463049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a31328df-c09f-40a9-99ac-a10334359957 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:48.465381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=34 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:48.471822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a31328df-c09f-40a9-99ac-a10334359957 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:48.471822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a31328df-c09f-40a9-99ac-a10334359957 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:48.472244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a31328df-c09f-40a9-99ac-a10334359957 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:48.472677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a31328df-c09f-40a9-99ac-a10334359957 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:48.503685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a31328df-c09f-40a9-99ac-a10334359957 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046780 Aug 01 15:39:48.504249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 381/845] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:48.523223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4ff99a2e-da31-4d13-81a3-c63ee6a9d7d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:48.525340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4ff99a2e-da31-4d13-81a3-c63ee6a9d7d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:48.531843 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4ff99a2e-da31-4d13-81a3-c63ee6a9d7d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:48.532286 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4ff99a2e-da31-4d13-81a3-c63ee6a9d7d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:48.533042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4ff99a2e-da31-4d13-81a3-c63ee6a9d7d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:48.533474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4ff99a2e-da31-4d13-81a3-c63ee6a9d7d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:48.563381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4ff99a2e-da31-4d13-81a3-c63ee6a9d7d2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043398 Aug 01 15:39:48.563934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 465/846] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:48 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:49.516040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eaa1d3c4-b9b5-495b-8181-6ec575fd75ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:49.518424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eaa1d3c4-b9b5-495b-8181-6ec575fd75ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:49.524751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaa1d3c4-b9b5-495b-8181-6ec575fd75ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:49.525201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaa1d3c4-b9b5-495b-8181-6ec575fd75ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:49.525995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaa1d3c4-b9b5-495b-8181-6ec575fd75ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:49.526431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaa1d3c4-b9b5-495b-8181-6ec575fd75ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:49.556295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eaa1d3c4-b9b5-495b-8181-6ec575fd75ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044230 Aug 01 15:39:49.556843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 382/847] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:49.575754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f4949260-814d-4121-9394-abe2f3d2e829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:49.577997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f4949260-814d-4121-9394-abe2f3d2e829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:49.584646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4949260-814d-4121-9394-abe2f3d2e829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:49.585092 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4949260-814d-4121-9394-abe2f3d2e829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:49.585863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4949260-814d-4121-9394-abe2f3d2e829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:49.586333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4949260-814d-4121-9394-abe2f3d2e829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:49.615825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f4949260-814d-4121-9394-abe2f3d2e829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Aug 01 15:39:49.616367 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 466/848] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:50.568629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c98eda28-6d52-47a8-9bf6-e439f236ff04 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:50.572210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c98eda28-6d52-47a8-9bf6-e439f236ff04 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:50.578438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c98eda28-6d52-47a8-9bf6-e439f236ff04 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:50.578888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c98eda28-6d52-47a8-9bf6-e439f236ff04 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:50.579693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c98eda28-6d52-47a8-9bf6-e439f236ff04 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:50.580130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c98eda28-6d52-47a8-9bf6-e439f236ff04 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:50.610224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c98eda28-6d52-47a8-9bf6-e439f236ff04 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044813 Aug 01 15:39:50.610778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 383/849] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:50.627964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7b347374-50db-438f-a886-744cbac33958 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:50.630266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7b347374-50db-438f-a886-744cbac33958 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:50.636751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7b347374-50db-438f-a886-744cbac33958 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:50.637199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7b347374-50db-438f-a886-744cbac33958 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:50.637985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7b347374-50db-438f-a886-744cbac33958 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:50.638421 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7b347374-50db-438f-a886-744cbac33958 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:50.667543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7b347374-50db-438f-a886-744cbac33958 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043502 Aug 01 15:39:50.668087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 467/850] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:50 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:51.622806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ec1328aa-ef83-4e40-9056-fb99920add30 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:51.624829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ec1328aa-ef83-4e40-9056-fb99920add30 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:51.631443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ec1328aa-ef83-4e40-9056-fb99920add30 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:51.631877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ec1328aa-ef83-4e40-9056-fb99920add30 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:51.632636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ec1328aa-ef83-4e40-9056-fb99920add30 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:51.633062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ec1328aa-ef83-4e40-9056-fb99920add30 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:51.662391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ec1328aa-ef83-4e40-9056-fb99920add30 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043565 Aug 01 15:39:51.662945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 384/851] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:51.680471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f8aadbd9-dd22-4aa9-8888-df167b1bfae1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:51.682676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f8aadbd9-dd22-4aa9-8888-df167b1bfae1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:51.689338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8aadbd9-dd22-4aa9-8888-df167b1bfae1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:51.689793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8aadbd9-dd22-4aa9-8888-df167b1bfae1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:51.690608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8aadbd9-dd22-4aa9-8888-df167b1bfae1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:51.691047 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8aadbd9-dd22-4aa9-8888-df167b1bfae1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:51.722039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f8aadbd9-dd22-4aa9-8888-df167b1bfae1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045986 Aug 01 15:39:51.722595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 468/852] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:51 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:52.675186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-580aee10-8104-4795-98d0-45b0408b6b7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:52.677463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-580aee10-8104-4795-98d0-45b0408b6b7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:52.684845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-580aee10-8104-4795-98d0-45b0408b6b7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:52.685284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-580aee10-8104-4795-98d0-45b0408b6b7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:52.686078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-580aee10-8104-4795-98d0-45b0408b6b7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:52.686504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-580aee10-8104-4795-98d0-45b0408b6b7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:52.722311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-580aee10-8104-4795-98d0-45b0408b6b7a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051483 Aug 01 15:39:52.722887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 385/853] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:52.735040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cc34fc61-175f-4ba5-9cda-ce3dddbf81d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:52.737297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cc34fc61-175f-4ba5-9cda-ce3dddbf81d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:52.743796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc34fc61-175f-4ba5-9cda-ce3dddbf81d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:52.744238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc34fc61-175f-4ba5-9cda-ce3dddbf81d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:52.744996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc34fc61-175f-4ba5-9cda-ce3dddbf81d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:52.745426 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc34fc61-175f-4ba5-9cda-ce3dddbf81d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:52.774056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cc34fc61-175f-4ba5-9cda-ce3dddbf81d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043695 Aug 01 15:39:52.774605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 469/854] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:52 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:53.735759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3deb5788-a454-4d4a-9ac5-5ca91f4b5dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:53.738149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3deb5788-a454-4d4a-9ac5-5ca91f4b5dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:53.744786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3deb5788-a454-4d4a-9ac5-5ca91f4b5dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:53.745229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3deb5788-a454-4d4a-9ac5-5ca91f4b5dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:53.746012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3deb5788-a454-4d4a-9ac5-5ca91f4b5dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:53.746443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3deb5788-a454-4d4a-9ac5-5ca91f4b5dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:53.775974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3deb5788-a454-4d4a-9ac5-5ca91f4b5dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045297 Aug 01 15:39:53.776519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 386/855] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:53.786274 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fff9eb0e-97b7-472e-b1bd-bf42e70f34ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:53.788397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fff9eb0e-97b7-472e-b1bd-bf42e70f34ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:53.795053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fff9eb0e-97b7-472e-b1bd-bf42e70f34ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:53.795502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fff9eb0e-97b7-472e-b1bd-bf42e70f34ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:53.796264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fff9eb0e-97b7-472e-b1bd-bf42e70f34ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:53.796698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fff9eb0e-97b7-472e-b1bd-bf42e70f34ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:53.826142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fff9eb0e-97b7-472e-b1bd-bf42e70f34ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043802 Aug 01 15:39:53.826689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 470/856] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:53 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:54.788821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-62123843-6f97-4591-bd2a-71d00cb9c5e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:54.791011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-62123843-6f97-4591-bd2a-71d00cb9c5e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:54.797540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-62123843-6f97-4591-bd2a-71d00cb9c5e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:54.798022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-62123843-6f97-4591-bd2a-71d00cb9c5e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:54.798792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-62123843-6f97-4591-bd2a-71d00cb9c5e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:54.799295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-62123843-6f97-4591-bd2a-71d00cb9c5e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:54.827970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-62123843-6f97-4591-bd2a-71d00cb9c5e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043046 Aug 01 15:39:54.829311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 387/857] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:54.839984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-46d185c1-b91d-4aba-855d-06d8cde28b7f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:54.842545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-46d185c1-b91d-4aba-855d-06d8cde28b7f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:54.849180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-46d185c1-b91d-4aba-855d-06d8cde28b7f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:54.849636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-46d185c1-b91d-4aba-855d-06d8cde28b7f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:54.850438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-46d185c1-b91d-4aba-855d-06d8cde28b7f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:54.850881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-46d185c1-b91d-4aba-855d-06d8cde28b7f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:54.880280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-46d185c1-b91d-4aba-855d-06d8cde28b7f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045170 Aug 01 15:39:54.880828 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 471/858] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:54 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:55.841701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-24465da9-e7e0-45f6-b834-c8251de45fc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:55.844665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-24465da9-e7e0-45f6-b834-c8251de45fc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:55.851339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24465da9-e7e0-45f6-b834-c8251de45fc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:55.851860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24465da9-e7e0-45f6-b834-c8251de45fc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:55.852858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24465da9-e7e0-45f6-b834-c8251de45fc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:55.853345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24465da9-e7e0-45f6-b834-c8251de45fc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:55.883272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-24465da9-e7e0-45f6-b834-c8251de45fc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046451 Aug 01 15:39:55.883854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 388/859] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:39:55.892702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5725337a-08d5-4db0-bef1-af0f80ec6978 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:55.894950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5725337a-08d5-4db0-bef1-af0f80ec6978 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:55.901674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5725337a-08d5-4db0-bef1-af0f80ec6978 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:55.902167 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5725337a-08d5-4db0-bef1-af0f80ec6978 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:55.902961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5725337a-08d5-4db0-bef1-af0f80ec6978 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:55.903394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5725337a-08d5-4db0-bef1-af0f80ec6978 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:55.933500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5725337a-08d5-4db0-bef1-af0f80ec6978 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 Aug 01 15:39:55.934077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 472/860] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:55 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:56.896360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c93ba60c-a1b2-4ca2-89eb-1e0e31fa3efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:56.898592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c93ba60c-a1b2-4ca2-89eb-1e0e31fa3efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:56.907416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c93ba60c-a1b2-4ca2-89eb-1e0e31fa3efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:56.908081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c93ba60c-a1b2-4ca2-89eb-1e0e31fa3efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:56.908723 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c93ba60c-a1b2-4ca2-89eb-1e0e31fa3efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:56.909209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c93ba60c-a1b2-4ca2-89eb-1e0e31fa3efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:56.938364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c93ba60c-a1b2-4ca2-89eb-1e0e31fa3efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045934 Aug 01 15:39:56.938922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 389/861] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:56.944542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-edd64384-6ee1-4e08-815a-d16603b7db02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:56.946708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-edd64384-6ee1-4e08-815a-d16603b7db02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:56.953056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-edd64384-6ee1-4e08-815a-d16603b7db02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:56.954077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-edd64384-6ee1-4e08-815a-d16603b7db02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:56.954801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-edd64384-6ee1-4e08-815a-d16603b7db02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:56.955228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-edd64384-6ee1-4e08-815a-d16603b7db02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:56.988887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-edd64384-6ee1-4e08-815a-d16603b7db02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048110 Aug 01 15:39:56.989447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 473/862] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:56 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:57.951599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ff869a67-585e-463b-a79b-6a92a9cb1eaa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:57.954601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ff869a67-585e-463b-a79b-6a92a9cb1eaa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:57.962363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ff869a67-585e-463b-a79b-6a92a9cb1eaa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:57.962889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ff869a67-585e-463b-a79b-6a92a9cb1eaa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:57.963564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ff869a67-585e-463b-a79b-6a92a9cb1eaa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:57.964000 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ff869a67-585e-463b-a79b-6a92a9cb1eaa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:57.994329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ff869a67-585e-463b-a79b-6a92a9cb1eaa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047244 Aug 01 15:39:57.994921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 390/863] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:58.001432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-967908ed-bfba-4112-bd91-11348b9745e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:58.003637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-967908ed-bfba-4112-bd91-11348b9745e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:58.006049 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=44 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:58.011501 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-967908ed-bfba-4112-bd91-11348b9745e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:58.012090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-967908ed-bfba-4112-bd91-11348b9745e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:58.012863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-967908ed-bfba-4112-bd91-11348b9745e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:58.013301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-967908ed-bfba-4112-bd91-11348b9745e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:58.042752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-967908ed-bfba-4112-bd91-11348b9745e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045812 Aug 01 15:39:58.043301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 474/864] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:57 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:39:59.019688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-13b877f2-13eb-44f4-97c4-11adc9ec4d15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:59.025035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-13b877f2-13eb-44f4-97c4-11adc9ec4d15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:59.036985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13b877f2-13eb-44f4-97c4-11adc9ec4d15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:59.037526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13b877f2-13eb-44f4-97c4-11adc9ec4d15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:59.038700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13b877f2-13eb-44f4-97c4-11adc9ec4d15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:59.039234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13b877f2-13eb-44f4-97c4-11adc9ec4d15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:59.055185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-315c93fd-5846-4b87-9e7c-f3a1932413c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:39:59.057344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-315c93fd-5846-4b87-9e7c-f3a1932413c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:39:59.064611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-315c93fd-5846-4b87-9e7c-f3a1932413c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:59.065348 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-315c93fd-5846-4b87-9e7c-f3a1932413c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:59.066171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-315c93fd-5846-4b87-9e7c-f3a1932413c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:39:59.066770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-315c93fd-5846-4b87-9e7c-f3a1932413c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:39:59.075544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:39:59.079035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-13b877f2-13eb-44f4-97c4-11adc9ec4d15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063960 Aug 01 15:39:59.079769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 391/865] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:39:59 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:39:59.099360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-315c93fd-5846-4b87-9e7c-f3a1932413c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048110 Aug 01 15:39:59.099918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 475/866] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:39:59 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:00.091834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0f3cb95b-3321-4226-84c8-9e6fe801a33f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:00.094114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0f3cb95b-3321-4226-84c8-9e6fe801a33f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:00.101390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0f3cb95b-3321-4226-84c8-9e6fe801a33f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:00.101836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0f3cb95b-3321-4226-84c8-9e6fe801a33f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:00.102639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0f3cb95b-3321-4226-84c8-9e6fe801a33f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:00.103074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0f3cb95b-3321-4226-84c8-9e6fe801a33f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:00.111624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f56df234-e073-490d-b21d-7e4bfe329c04 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:00.113782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f56df234-e073-490d-b21d-7e4bfe329c04 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:00.120259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f56df234-e073-490d-b21d-7e4bfe329c04 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:00.120654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f56df234-e073-490d-b21d-7e4bfe329c04 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:00.121416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f56df234-e073-490d-b21d-7e4bfe329c04 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:00.121850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f56df234-e073-490d-b21d-7e4bfe329c04 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:00.132681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0f3cb95b-3321-4226-84c8-9e6fe801a33f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045053 Aug 01 15:40:00.133257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 392/867] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:00.151597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f56df234-e073-490d-b21d-7e4bfe329c04 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043866 Aug 01 15:40:00.152146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 476/868] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:00 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:01.146956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-552cc5d5-1a6f-4070-acbb-6ffc955903a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:01.149144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-552cc5d5-1a6f-4070-acbb-6ffc955903a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:01.155719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-552cc5d5-1a6f-4070-acbb-6ffc955903a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:01.156162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-552cc5d5-1a6f-4070-acbb-6ffc955903a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:01.156928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-552cc5d5-1a6f-4070-acbb-6ffc955903a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:01.157363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-552cc5d5-1a6f-4070-acbb-6ffc955903a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:01.164041 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f43b18e3-a6e8-4682-a43c-7a44ad13ae19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:01.166322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f43b18e3-a6e8-4682-a43c-7a44ad13ae19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:01.173789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f43b18e3-a6e8-4682-a43c-7a44ad13ae19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:01.174254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f43b18e3-a6e8-4682-a43c-7a44ad13ae19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:01.175037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f43b18e3-a6e8-4682-a43c-7a44ad13ae19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:01.175472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f43b18e3-a6e8-4682-a43c-7a44ad13ae19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:01.188784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-552cc5d5-1a6f-4070-acbb-6ffc955903a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046319 Aug 01 15:40:01.189359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 393/869] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:01.206664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f43b18e3-a6e8-4682-a43c-7a44ad13ae19 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046479 Aug 01 15:40:01.207259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 477/870] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:01 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:02.200845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4ab83317-9838-4d3f-bc36-09699803f979 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:02.203082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4ab83317-9838-4d3f-bc36-09699803f979 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:02.209690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ab83317-9838-4d3f-bc36-09699803f979 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:02.210286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ab83317-9838-4d3f-bc36-09699803f979 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:02.211052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ab83317-9838-4d3f-bc36-09699803f979 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:02.211487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ab83317-9838-4d3f-bc36-09699803f979 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:02.219413 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5a15d488-652a-46f6-9ed8-b44b0c30f649 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:02.221851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5a15d488-652a-46f6-9ed8-b44b0c30f649 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:02.228553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a15d488-652a-46f6-9ed8-b44b0c30f649 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:02.229227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a15d488-652a-46f6-9ed8-b44b0c30f649 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:02.230040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a15d488-652a-46f6-9ed8-b44b0c30f649 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:02.230479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a15d488-652a-46f6-9ed8-b44b0c30f649 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:02.241396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4ab83317-9838-4d3f-bc36-09699803f979 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044404 Aug 01 15:40:02.241992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 394/871] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:40:02.260951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5a15d488-652a-46f6-9ed8-b44b0c30f649 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045936 Aug 01 15:40:02.261499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 478/872] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:02 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:03.253602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1ddf3aed-af4d-4f7e-a2c9-eb4f9eeac6dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:03.255770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1ddf3aed-af4d-4f7e-a2c9-eb4f9eeac6dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:03.262309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ddf3aed-af4d-4f7e-a2c9-eb4f9eeac6dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:03.262760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ddf3aed-af4d-4f7e-a2c9-eb4f9eeac6dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:03.263529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ddf3aed-af4d-4f7e-a2c9-eb4f9eeac6dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:03.263969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ddf3aed-af4d-4f7e-a2c9-eb4f9eeac6dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:03.272512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c72bf8ed-6f6a-428c-a65a-bd0d47039628 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:03.274680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c72bf8ed-6f6a-428c-a65a-bd0d47039628 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:03.281196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c72bf8ed-6f6a-428c-a65a-bd0d47039628 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:03.282171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c72bf8ed-6f6a-428c-a65a-bd0d47039628 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:03.282943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c72bf8ed-6f6a-428c-a65a-bd0d47039628 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:03.283380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c72bf8ed-6f6a-428c-a65a-bd0d47039628 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:03.293514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1ddf3aed-af4d-4f7e-a2c9-eb4f9eeac6dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043752 Aug 01 15:40:03.294119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 395/873] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:03.312825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c72bf8ed-6f6a-428c-a65a-bd0d47039628 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044118 Aug 01 15:40:03.313382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 479/874] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:03 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:04.306268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b91ec325-e2d7-4db3-ab96-cc62911fb549 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:04.308975 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b91ec325-e2d7-4db3-ab96-cc62911fb549 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:04.315270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b91ec325-e2d7-4db3-ab96-cc62911fb549 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:04.315713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b91ec325-e2d7-4db3-ab96-cc62911fb549 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:04.316466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b91ec325-e2d7-4db3-ab96-cc62911fb549 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:04.316894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b91ec325-e2d7-4db3-ab96-cc62911fb549 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:04.324664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a168873c-cc0b-480b-a1ad-6cc88a4746c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:04.327398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a168873c-cc0b-480b-a1ad-6cc88a4746c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:04.334546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a168873c-cc0b-480b-a1ad-6cc88a4746c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:04.334994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a168873c-cc0b-480b-a1ad-6cc88a4746c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:04.335756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a168873c-cc0b-480b-a1ad-6cc88a4746c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:04.336188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a168873c-cc0b-480b-a1ad-6cc88a4746c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:04.346990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b91ec325-e2d7-4db3-ab96-cc62911fb549 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044452 Aug 01 15:40:04.347553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 396/875] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:04 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:04.362101 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:04.367098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a168873c-cc0b-480b-a1ad-6cc88a4746c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046420 Aug 01 15:40:04.367653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 480/876] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:04 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:05.358549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1efceead-6508-40fb-9deb-c21affede882 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:05.361491 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1efceead-6508-40fb-9deb-c21affede882 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:05.367722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1efceead-6508-40fb-9deb-c21affede882 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:05.368175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1efceead-6508-40fb-9deb-c21affede882 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:05.368953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1efceead-6508-40fb-9deb-c21affede882 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:05.369394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1efceead-6508-40fb-9deb-c21affede882 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:05.380184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-36e04e37-99d7-4c41-9f81-30e91e1d89c4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:05.382613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-36e04e37-99d7-4c41-9f81-30e91e1d89c4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:05.389123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-36e04e37-99d7-4c41-9f81-30e91e1d89c4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:05.389582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-36e04e37-99d7-4c41-9f81-30e91e1d89c4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:05.390387 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-36e04e37-99d7-4c41-9f81-30e91e1d89c4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:05.390859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-36e04e37-99d7-4c41-9f81-30e91e1d89c4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:05.400256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1efceead-6508-40fb-9deb-c21affede882 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045488 Aug 01 15:40:05.400830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 397/877] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:05.420285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-36e04e37-99d7-4c41-9f81-30e91e1d89c4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Aug 01 15:40:05.420831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 481/878] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:05 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:06.423900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-70c3d520-98a2-4658-a819-8c3885c332cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:06.426483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-70c3d520-98a2-4658-a819-8c3885c332cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:06.432609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-480a2ee9-0fd1-40a7-98ef-5befe73c707d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:06.433534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70c3d520-98a2-4658-a819-8c3885c332cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:06.434015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70c3d520-98a2-4658-a819-8c3885c332cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:06.435590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-480a2ee9-0fd1-40a7-98ef-5befe73c707d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:06.435725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70c3d520-98a2-4658-a819-8c3885c332cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:06.435725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70c3d520-98a2-4658-a819-8c3885c332cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:06.441264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-480a2ee9-0fd1-40a7-98ef-5befe73c707d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:06.441712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-480a2ee9-0fd1-40a7-98ef-5befe73c707d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:06.442524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-480a2ee9-0fd1-40a7-98ef-5befe73c707d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:06.442964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-480a2ee9-0fd1-40a7-98ef-5befe73c707d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:06.465660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-70c3d520-98a2-4658-a819-8c3885c332cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046064 Aug 01 15:40:06.466536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 398/879] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:40:06.473179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-480a2ee9-0fd1-40a7-98ef-5befe73c707d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044402 Aug 01 15:40:06.473735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 482/880] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:06 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:07.481030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d904cd9e-e705-48ca-bb73-3c470739450f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:07.483599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d904cd9e-e705-48ca-bb73-3c470739450f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:07.486225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4faffcc8-373f-4ca9-82e4-a0f74dd69c1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:07.488450 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4faffcc8-373f-4ca9-82e4-a0f74dd69c1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:07.490575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d904cd9e-e705-48ca-bb73-3c470739450f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:07.491023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d904cd9e-e705-48ca-bb73-3c470739450f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:07.491877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d904cd9e-e705-48ca-bb73-3c470739450f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:07.492217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d904cd9e-e705-48ca-bb73-3c470739450f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:07.495015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4faffcc8-373f-4ca9-82e4-a0f74dd69c1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:07.495465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4faffcc8-373f-4ca9-82e4-a0f74dd69c1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:07.496237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4faffcc8-373f-4ca9-82e4-a0f74dd69c1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:07.496668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4faffcc8-373f-4ca9-82e4-a0f74dd69c1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:07.522187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d904cd9e-e705-48ca-bb73-3c470739450f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046738 Aug 01 15:40:07.522758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 399/881] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:07 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:40:07.526126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4faffcc8-373f-4ca9-82e4-a0f74dd69c1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044282 Aug 01 15:40:07.526677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 483/882] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:07 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:08.543116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9e037052-6d05-49cc-874b-619cd065239c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:08.543674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e5c4af6e-854e-470b-88c7-71296f6ab695 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:08.545319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e5c4af6e-854e-470b-88c7-71296f6ab695 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:08.545455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9e037052-6d05-49cc-874b-619cd065239c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:08.552019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e5c4af6e-854e-470b-88c7-71296f6ab695 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:08.552478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e5c4af6e-854e-470b-88c7-71296f6ab695 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:08.553249 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e5c4af6e-854e-470b-88c7-71296f6ab695 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:08.553690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e5c4af6e-854e-470b-88c7-71296f6ab695 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:08.556356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e037052-6d05-49cc-874b-619cd065239c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:08.556842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e037052-6d05-49cc-874b-619cd065239c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:08.557616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e037052-6d05-49cc-874b-619cd065239c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:08.558079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e037052-6d05-49cc-874b-619cd065239c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:08.583914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e5c4af6e-854e-470b-88c7-71296f6ab695 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044660 Aug 01 15:40:08.589038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9e037052-6d05-49cc-874b-619cd065239c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049782 Aug 01 15:40:08.589607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 400/883] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:08.589703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 484/884] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:08 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:09.599416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ee48a3b8-5015-478f-a3e4-7891b81e73c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:09.601212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-db3b51bd-54fe-4bf7-81d3-84f3952f23d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:09.601652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ee48a3b8-5015-478f-a3e4-7891b81e73c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:09.604168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-db3b51bd-54fe-4bf7-81d3-84f3952f23d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:09.611334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db3b51bd-54fe-4bf7-81d3-84f3952f23d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:09.611788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db3b51bd-54fe-4bf7-81d3-84f3952f23d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:09.612563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db3b51bd-54fe-4bf7-81d3-84f3952f23d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:09.613007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db3b51bd-54fe-4bf7-81d3-84f3952f23d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:09.613116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee48a3b8-5015-478f-a3e4-7891b81e73c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:09.613476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee48a3b8-5015-478f-a3e4-7891b81e73c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:09.614271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee48a3b8-5015-478f-a3e4-7891b81e73c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:09.614703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee48a3b8-5015-478f-a3e4-7891b81e73c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:09.643433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-db3b51bd-54fe-4bf7-81d3-84f3952f23d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046098 Aug 01 15:40:09.644191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 485/885] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:09.644594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ee48a3b8-5015-478f-a3e4-7891b81e73c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050460 Aug 01 15:40:09.645112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 401/886] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:09 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:10.656922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ce990993-90d2-4921-aa5d-2429e0f0ff44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:10.657507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-522b31ed-c1e1-425d-a2da-bfefaf3c4fb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:10.659136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ce990993-90d2-4921-aa5d-2429e0f0ff44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:10.659971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-522b31ed-c1e1-425d-a2da-bfefaf3c4fb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:10.665694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce990993-90d2-4921-aa5d-2429e0f0ff44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:10.666184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce990993-90d2-4921-aa5d-2429e0f0ff44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:10.666798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-522b31ed-c1e1-425d-a2da-bfefaf3c4fb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:10.666955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce990993-90d2-4921-aa5d-2429e0f0ff44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:10.667247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-522b31ed-c1e1-425d-a2da-bfefaf3c4fb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:10.667570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce990993-90d2-4921-aa5d-2429e0f0ff44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:10.668118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-522b31ed-c1e1-425d-a2da-bfefaf3c4fb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:10.668553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-522b31ed-c1e1-425d-a2da-bfefaf3c4fb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:10.698683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ce990993-90d2-4921-aa5d-2429e0f0ff44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046121 Aug 01 15:40:10.699254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 402/887] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:10 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:10.699699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-522b31ed-c1e1-425d-a2da-bfefaf3c4fb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047209 Aug 01 15:40:10.700250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 486/888] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:10 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:11.712684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4e16febb-c3df-4b88-acc3-02a3d68c765f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:11.713395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ad6001b3-3461-43be-8fec-ebff02fe597d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:11.716201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ad6001b3-3461-43be-8fec-ebff02fe597d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:11.716783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4e16febb-c3df-4b88-acc3-02a3d68c765f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:11.725707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad6001b3-3461-43be-8fec-ebff02fe597d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:11.725820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e16febb-c3df-4b88-acc3-02a3d68c765f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:11.725967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad6001b3-3461-43be-8fec-ebff02fe597d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:11.726082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e16febb-c3df-4b88-acc3-02a3d68c765f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:11.726173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad6001b3-3461-43be-8fec-ebff02fe597d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:11.726253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e16febb-c3df-4b88-acc3-02a3d68c765f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:11.726343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad6001b3-3461-43be-8fec-ebff02fe597d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:11.726439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e16febb-c3df-4b88-acc3-02a3d68c765f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:11.755785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ad6001b3-3461-43be-8fec-ebff02fe597d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048336 Aug 01 15:40:11.756040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4e16febb-c3df-4b88-acc3-02a3d68c765f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047187 Aug 01 15:40:11.756357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 487/890] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:11 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:11.756529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 403/890] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:11 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:12.774623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-62eaea15-da3a-445f-8b83-077947e55f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:12.775075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7f495332-68a8-42a5-bcbd-1569c5446187 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:12.775430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-62eaea15-da3a-445f-8b83-077947e55f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:12.775531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7f495332-68a8-42a5-bcbd-1569c5446187 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:12.778600 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62eaea15-da3a-445f-8b83-077947e55f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:12.779042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62eaea15-da3a-445f-8b83-077947e55f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:12.779935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62eaea15-da3a-445f-8b83-077947e55f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:12.780349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f495332-68a8-42a5-bcbd-1569c5446187 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:12.780484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62eaea15-da3a-445f-8b83-077947e55f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:12.780992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f495332-68a8-42a5-bcbd-1569c5446187 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:12.782488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f495332-68a8-42a5-bcbd-1569c5446187 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:12.782958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f495332-68a8-42a5-bcbd-1569c5446187 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:12.812866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7f495332-68a8-42a5-bcbd-1569c5446187 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048382 Aug 01 15:40:12.813248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-62eaea15-da3a-445f-8b83-077947e55f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049031 Aug 01 15:40:12.813437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 404/891] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:12 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:12.813994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 488/892] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:13.824589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ab1eafd4-5c12-48fd-bc7c-a4a21c283246 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:13.826420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4577e5f6-fede-4b2c-831d-883264de4a3b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:13.828963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ab1eafd4-5c12-48fd-bc7c-a4a21c283246 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:13.830802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4577e5f6-fede-4b2c-831d-883264de4a3b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:13.836302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab1eafd4-5c12-48fd-bc7c-a4a21c283246 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:13.837074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab1eafd4-5c12-48fd-bc7c-a4a21c283246 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:13.837635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4577e5f6-fede-4b2c-831d-883264de4a3b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:13.838128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4577e5f6-fede-4b2c-831d-883264de4a3b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:13.838733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab1eafd4-5c12-48fd-bc7c-a4a21c283246 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:13.838890 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4577e5f6-fede-4b2c-831d-883264de4a3b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:13.839160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab1eafd4-5c12-48fd-bc7c-a4a21c283246 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:13.839695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4577e5f6-fede-4b2c-831d-883264de4a3b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:13.869553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ab1eafd4-5c12-48fd-bc7c-a4a21c283246 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048831 Aug 01 15:40:13.870151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 405/893] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:13 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:13.870508 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4577e5f6-fede-4b2c-831d-883264de4a3b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048507 Aug 01 15:40:13.871158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 489/894] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:14.883635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8e7aa1df-aeea-4011-be83-eed810447287 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:14.884239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-35ec9504-e2d4-4d45-980b-8bebaa14c979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:14.885825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8e7aa1df-aeea-4011-be83-eed810447287 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:14.885971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-35ec9504-e2d4-4d45-980b-8bebaa14c979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:14.892705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e7aa1df-aeea-4011-be83-eed810447287 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:14.893170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e7aa1df-aeea-4011-be83-eed810447287 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:14.893555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35ec9504-e2d4-4d45-980b-8bebaa14c979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:14.894087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e7aa1df-aeea-4011-be83-eed810447287 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:14.894220 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35ec9504-e2d4-4d45-980b-8bebaa14c979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:14.894516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e7aa1df-aeea-4011-be83-eed810447287 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:14.895214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35ec9504-e2d4-4d45-980b-8bebaa14c979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:14.895581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35ec9504-e2d4-4d45-980b-8bebaa14c979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:14.936215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8e7aa1df-aeea-4011-be83-eed810447287 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056684 Aug 01 15:40:14.936779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 490/895] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:40:14.939609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-35ec9504-e2d4-4d45-980b-8bebaa14c979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060107 Aug 01 15:40:14.940204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 406/896] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:14 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:15.952799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f25ca612-b566-4bba-91a7-9abc5721c4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:15.955217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f25ca612-b566-4bba-91a7-9abc5721c4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:15.957071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b01f3b63-3242-44e4-b170-a7161aad1646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:15.960013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b01f3b63-3242-44e4-b170-a7161aad1646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:15.962334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f25ca612-b566-4bba-91a7-9abc5721c4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:15.962642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f25ca612-b566-4bba-91a7-9abc5721c4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:15.963462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f25ca612-b566-4bba-91a7-9abc5721c4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:15.965791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f25ca612-b566-4bba-91a7-9abc5721c4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:15.970792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b01f3b63-3242-44e4-b170-a7161aad1646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:15.971861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b01f3b63-3242-44e4-b170-a7161aad1646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:15.973312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b01f3b63-3242-44e4-b170-a7161aad1646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:15.974110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b01f3b63-3242-44e4-b170-a7161aad1646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:16.012426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b01f3b63-3242-44e4-b170-a7161aad1646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059640 Aug 01 15:40:16.012796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f25ca612-b566-4bba-91a7-9abc5721c4fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064529 Aug 01 15:40:16.012995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 407/897] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:16.013428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 491/898] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:15 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:17.024555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-03757570-85b0-4087-98c1-0a374c3278ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:17.025297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e3cd71d6-057c-4a9a-b4e1-eb2487420894 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:17.027116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-03757570-85b0-4087-98c1-0a374c3278ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:17.027780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e3cd71d6-057c-4a9a-b4e1-eb2487420894 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:17.033551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03757570-85b0-4087-98c1-0a374c3278ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:17.038067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03757570-85b0-4087-98c1-0a374c3278ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:17.038067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03757570-85b0-4087-98c1-0a374c3278ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:17.038483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3cd71d6-057c-4a9a-b4e1-eb2487420894 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:17.038577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03757570-85b0-4087-98c1-0a374c3278ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:17.038667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3cd71d6-057c-4a9a-b4e1-eb2487420894 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:17.038667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3cd71d6-057c-4a9a-b4e1-eb2487420894 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:17.038667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3cd71d6-057c-4a9a-b4e1-eb2487420894 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:17.053184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:17.071106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e3cd71d6-057c-4a9a-b4e1-eb2487420894 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051060 Aug 01 15:40:17.071677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 408/899] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:17.073642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-03757570-85b0-4087-98c1-0a374c3278ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053047 Aug 01 15:40:17.074425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 492/900] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:17 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:18.083038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bb55ef5c-2d1e-4b86-abcc-c009b412ead9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:18.085149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bb55ef5c-2d1e-4b86-abcc-c009b412ead9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:18.085876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-af0400c2-59bb-4135-bfaf-13e129d226c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:18.088519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-af0400c2-59bb-4135-bfaf-13e129d226c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:18.091883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb55ef5c-2d1e-4b86-abcc-c009b412ead9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:18.092927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb55ef5c-2d1e-4b86-abcc-c009b412ead9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:18.094366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb55ef5c-2d1e-4b86-abcc-c009b412ead9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:18.095023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb55ef5c-2d1e-4b86-abcc-c009b412ead9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:18.096522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af0400c2-59bb-4135-bfaf-13e129d226c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:18.096979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af0400c2-59bb-4135-bfaf-13e129d226c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:18.097753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af0400c2-59bb-4135-bfaf-13e129d226c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:18.098229 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af0400c2-59bb-4135-bfaf-13e129d226c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:18.126347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bb55ef5c-2d1e-4b86-abcc-c009b412ead9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047166 Aug 01 15:40:18.126915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 409/901] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:18.128321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-af0400c2-59bb-4135-bfaf-13e129d226c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046262 Aug 01 15:40:18.128879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 493/902] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:18 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:19.139109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-89e75a0f-fb8a-4f59-9448-e8560bc727b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:19.141693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e33d2b54-494a-4319-af2c-0cd7d0e1939e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:19.142162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-89e75a0f-fb8a-4f59-9448-e8560bc727b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:19.143858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=58 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:19.144003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e33d2b54-494a-4319-af2c-0cd7d0e1939e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:19.150275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89e75a0f-fb8a-4f59-9448-e8560bc727b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:19.150730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89e75a0f-fb8a-4f59-9448-e8560bc727b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:19.150907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e33d2b54-494a-4319-af2c-0cd7d0e1939e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:19.151507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89e75a0f-fb8a-4f59-9448-e8560bc727b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:19.151694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e33d2b54-494a-4319-af2c-0cd7d0e1939e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:19.152036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89e75a0f-fb8a-4f59-9448-e8560bc727b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:19.152885 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e33d2b54-494a-4319-af2c-0cd7d0e1939e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:19.153569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e33d2b54-494a-4319-af2c-0cd7d0e1939e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:19.183392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-89e75a0f-fb8a-4f59-9448-e8560bc727b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048535 Aug 01 15:40:19.183961 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 410/903] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:19.187058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e33d2b54-494a-4319-af2c-0cd7d0e1939e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050473 Aug 01 15:40:19.187617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 494/904] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:19 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:20.195821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ee9c244e-dfcb-4906-b884-6ee662d555b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:20.198334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ee9c244e-dfcb-4906-b884-6ee662d555b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:20.199641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-60894141-f436-4e04-b364-bf2e86dfe329 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:20.201851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-60894141-f436-4e04-b364-bf2e86dfe329 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:20.204888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee9c244e-dfcb-4906-b884-6ee662d555b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:20.205306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee9c244e-dfcb-4906-b884-6ee662d555b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:20.206102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee9c244e-dfcb-4906-b884-6ee662d555b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:20.206552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee9c244e-dfcb-4906-b884-6ee662d555b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:20.208427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60894141-f436-4e04-b364-bf2e86dfe329 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:20.209138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60894141-f436-4e04-b364-bf2e86dfe329 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:20.210227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60894141-f436-4e04-b364-bf2e86dfe329 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:20.210912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60894141-f436-4e04-b364-bf2e86dfe329 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:20.240108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ee9c244e-dfcb-4906-b884-6ee662d555b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048274 Aug 01 15:40:20.245281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 411/905] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:20.249420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-60894141-f436-4e04-b364-bf2e86dfe329 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053934 Aug 01 15:40:20.250734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 495/906] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:20 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:21.252591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6e05c1ec-7488-434d-9f1c-e63d8039c51d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:21.254770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6e05c1ec-7488-434d-9f1c-e63d8039c51d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:21.261756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e05c1ec-7488-434d-9f1c-e63d8039c51d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:21.262124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e05c1ec-7488-434d-9f1c-e63d8039c51d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:21.262603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5c81c2f2-2150-46a2-813a-5d6c9eb708c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:21.263097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e05c1ec-7488-434d-9f1c-e63d8039c51d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:21.263329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e05c1ec-7488-434d-9f1c-e63d8039c51d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:21.264772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5c81c2f2-2150-46a2-813a-5d6c9eb708c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:21.272154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5c81c2f2-2150-46a2-813a-5d6c9eb708c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:21.272746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5c81c2f2-2150-46a2-813a-5d6c9eb708c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:21.273527 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5c81c2f2-2150-46a2-813a-5d6c9eb708c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:21.274127 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5c81c2f2-2150-46a2-813a-5d6c9eb708c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:21.295421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6e05c1ec-7488-434d-9f1c-e63d8039c51d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046830 Aug 01 15:40:21.296224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 412/907] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:21.314372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5c81c2f2-2150-46a2-813a-5d6c9eb708c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055994 Aug 01 15:40:21.314947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 496/908] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:21 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:22.310462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dd73bd2f-2094-43f5-992b-b42c223196e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:22.312652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dd73bd2f-2094-43f5-992b-b42c223196e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:22.319065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd73bd2f-2094-43f5-992b-b42c223196e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:22.319510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd73bd2f-2094-43f5-992b-b42c223196e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:22.320274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd73bd2f-2094-43f5-992b-b42c223196e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:22.320726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd73bd2f-2094-43f5-992b-b42c223196e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:22.326690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9afbff57-b99d-4e43-8bd2-75b954339e70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:22.329396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9afbff57-b99d-4e43-8bd2-75b954339e70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:22.336238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9afbff57-b99d-4e43-8bd2-75b954339e70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:22.336696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9afbff57-b99d-4e43-8bd2-75b954339e70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:22.337477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9afbff57-b99d-4e43-8bd2-75b954339e70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:22.337943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9afbff57-b99d-4e43-8bd2-75b954339e70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:22.357136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:22.359065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dd73bd2f-2094-43f5-992b-b42c223196e3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052234 Aug 01 15:40:22.359716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 413/909] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:22 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:22.371010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9afbff57-b99d-4e43-8bd2-75b954339e70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048122 Aug 01 15:40:22.371577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 497/910] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:22 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:23.371429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8a708254-8039-4288-bd0e-12e0cf796901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:23.373618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8a708254-8039-4288-bd0e-12e0cf796901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:23.380431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a708254-8039-4288-bd0e-12e0cf796901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:23.380884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a708254-8039-4288-bd0e-12e0cf796901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:23.381657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a708254-8039-4288-bd0e-12e0cf796901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:23.382123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a708254-8039-4288-bd0e-12e0cf796901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:23.383771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-535c5c52-e494-4c26-b720-266a801e8256 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:23.385962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-535c5c52-e494-4c26-b720-266a801e8256 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:23.392798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-535c5c52-e494-4c26-b720-266a801e8256 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:23.393862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-535c5c52-e494-4c26-b720-266a801e8256 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:23.394911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-535c5c52-e494-4c26-b720-266a801e8256 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:23.395507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-535c5c52-e494-4c26-b720-266a801e8256 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:23.412581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8a708254-8039-4288-bd0e-12e0cf796901 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045019 Aug 01 15:40:23.413153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 414/911] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:23.426749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-535c5c52-e494-4c26-b720-266a801e8256 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046939 Aug 01 15:40:23.427303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 498/912] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:23 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:24.425378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e7e70f27-19b6-40a8-939c-98a61ea69ee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:24.427527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e7e70f27-19b6-40a8-939c-98a61ea69ee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:24.433955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e7e70f27-19b6-40a8-939c-98a61ea69ee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:24.434360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e7e70f27-19b6-40a8-939c-98a61ea69ee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:24.435171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e7e70f27-19b6-40a8-939c-98a61ea69ee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:24.435548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e7e70f27-19b6-40a8-939c-98a61ea69ee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:24.439851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-574b5b2c-400d-4a5e-aaaa-f2831d6cfa57 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:24.442604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-574b5b2c-400d-4a5e-aaaa-f2831d6cfa57 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:24.449862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-574b5b2c-400d-4a5e-aaaa-f2831d6cfa57 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:24.450438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-574b5b2c-400d-4a5e-aaaa-f2831d6cfa57 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:24.451486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-574b5b2c-400d-4a5e-aaaa-f2831d6cfa57 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:24.451988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-574b5b2c-400d-4a5e-aaaa-f2831d6cfa57 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:24.468144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e7e70f27-19b6-40a8-939c-98a61ea69ee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047430 Aug 01 15:40:24.472688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 415/913] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:24.496306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-574b5b2c-400d-4a5e-aaaa-f2831d6cfa57 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061542 Aug 01 15:40:24.496851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 499/914] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:24 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:25.480264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-70093066-2c64-4061-8e0d-35ccee9dfc77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:25.482440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-70093066-2c64-4061-8e0d-35ccee9dfc77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:25.488718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70093066-2c64-4061-8e0d-35ccee9dfc77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:25.489225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70093066-2c64-4061-8e0d-35ccee9dfc77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:25.490083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70093066-2c64-4061-8e0d-35ccee9dfc77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:25.490376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70093066-2c64-4061-8e0d-35ccee9dfc77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:25.509679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-235b296d-2f39-4675-9253-96170bdfe150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:25.512459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-235b296d-2f39-4675-9253-96170bdfe150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:25.523597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-235b296d-2f39-4675-9253-96170bdfe150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:25.524265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-235b296d-2f39-4675-9253-96170bdfe150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:25.525155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-235b296d-2f39-4675-9253-96170bdfe150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:25.525578 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-235b296d-2f39-4675-9253-96170bdfe150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:25.526788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-70093066-2c64-4061-8e0d-35ccee9dfc77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050282 Aug 01 15:40:25.527370 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 416/915] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:25 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:25.559079 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-235b296d-2f39-4675-9253-96170bdfe150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053851 Aug 01 15:40:25.559620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 500/916] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:25 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:26.540151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8e1e618b-29d1-40b1-ad8f-38f8dfc2f230 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:26.542640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8e1e618b-29d1-40b1-ad8f-38f8dfc2f230 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:26.549744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e1e618b-29d1-40b1-ad8f-38f8dfc2f230 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:26.550274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e1e618b-29d1-40b1-ad8f-38f8dfc2f230 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:26.551008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e1e618b-29d1-40b1-ad8f-38f8dfc2f230 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:26.551444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e1e618b-29d1-40b1-ad8f-38f8dfc2f230 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:26.571756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5cad2e5a-a32f-4113-b886-e18d91a65575 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:26.573940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5cad2e5a-a32f-4113-b886-e18d91a65575 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:26.580612 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5cad2e5a-a32f-4113-b886-e18d91a65575 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:26.581061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5cad2e5a-a32f-4113-b886-e18d91a65575 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:26.582057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5cad2e5a-a32f-4113-b886-e18d91a65575 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:26.582498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5cad2e5a-a32f-4113-b886-e18d91a65575 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:26.589097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8e1e618b-29d1-40b1-ad8f-38f8dfc2f230 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053183 Aug 01 15:40:26.594487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 417/917] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:26.615994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5cad2e5a-a32f-4113-b886-e18d91a65575 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048152 Aug 01 15:40:26.616550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 501/918] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:26 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:27.603366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b4af372e-ee9b-4b9d-94b7-89994966356c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:27.607637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b4af372e-ee9b-4b9d-94b7-89994966356c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:27.614348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b4af372e-ee9b-4b9d-94b7-89994966356c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:27.614795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b4af372e-ee9b-4b9d-94b7-89994966356c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:27.615567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b4af372e-ee9b-4b9d-94b7-89994966356c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:27.615999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b4af372e-ee9b-4b9d-94b7-89994966356c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:27.629384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-39b3f5bf-0f23-4a96-a5ca-8ce2123d978b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:27.631716 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-39b3f5bf-0f23-4a96-a5ca-8ce2123d978b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:27.638368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39b3f5bf-0f23-4a96-a5ca-8ce2123d978b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:27.639063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39b3f5bf-0f23-4a96-a5ca-8ce2123d978b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:27.639915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39b3f5bf-0f23-4a96-a5ca-8ce2123d978b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:27.640516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39b3f5bf-0f23-4a96-a5ca-8ce2123d978b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:27.659411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b4af372e-ee9b-4b9d-94b7-89994966356c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061183 Aug 01 15:40:27.663845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 418/919] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:27.675753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-39b3f5bf-0f23-4a96-a5ca-8ce2123d978b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052076 Aug 01 15:40:27.676303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 502/920] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:27 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:28.671935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8edfb21a-6136-46bd-9e50-8ccec5189b8f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:28.674218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8edfb21a-6136-46bd-9e50-8ccec5189b8f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:28.680774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8edfb21a-6136-46bd-9e50-8ccec5189b8f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:28.681266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8edfb21a-6136-46bd-9e50-8ccec5189b8f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:28.682148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8edfb21a-6136-46bd-9e50-8ccec5189b8f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:28.682685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8edfb21a-6136-46bd-9e50-8ccec5189b8f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:28.689938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-353833dd-a009-4f88-9592-65bd15255be1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:28.692107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-353833dd-a009-4f88-9592-65bd15255be1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:28.695581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=58 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:28.699512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-353833dd-a009-4f88-9592-65bd15255be1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:28.699646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-353833dd-a009-4f88-9592-65bd15255be1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:28.700320 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-353833dd-a009-4f88-9592-65bd15255be1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:28.704595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-353833dd-a009-4f88-9592-65bd15255be1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:28.723511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8edfb21a-6136-46bd-9e50-8ccec5189b8f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055720 Aug 01 15:40:28.724858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 419/921] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:28.743360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-353833dd-a009-4f88-9592-65bd15255be1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058997 Aug 01 15:40:28.743920 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 503/922] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:28 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:29.736748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fcf6b4f0-e28e-46d1-bad7-ee71f28fdd73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:29.738963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fcf6b4f0-e28e-46d1-bad7-ee71f28fdd73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:29.745398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fcf6b4f0-e28e-46d1-bad7-ee71f28fdd73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:29.745850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fcf6b4f0-e28e-46d1-bad7-ee71f28fdd73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:29.746653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fcf6b4f0-e28e-46d1-bad7-ee71f28fdd73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:29.747084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fcf6b4f0-e28e-46d1-bad7-ee71f28fdd73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:29.756409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-108460e2-6cee-44a5-8792-010f77104d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:29.758984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-108460e2-6cee-44a5-8792-010f77104d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:29.775733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-108460e2-6cee-44a5-8792-010f77104d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:29.775733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-108460e2-6cee-44a5-8792-010f77104d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:29.775733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-108460e2-6cee-44a5-8792-010f77104d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:29.775733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-108460e2-6cee-44a5-8792-010f77104d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:29.781529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fcf6b4f0-e28e-46d1-bad7-ee71f28fdd73 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049326 Aug 01 15:40:29.782326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 420/923] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:29.798403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-108460e2-6cee-44a5-8792-010f77104d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045894 Aug 01 15:40:29.798949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 504/924] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:29 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:30.793350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f2a4a0df-9498-49fc-9f8b-be64f7adfb77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:30.795876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f2a4a0df-9498-49fc-9f8b-be64f7adfb77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:30.803114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2a4a0df-9498-49fc-9f8b-be64f7adfb77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:30.803568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2a4a0df-9498-49fc-9f8b-be64f7adfb77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:30.804495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2a4a0df-9498-49fc-9f8b-be64f7adfb77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:30.804798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2a4a0df-9498-49fc-9f8b-be64f7adfb77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:30.810844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5208930c-1a88-4f06-8bec-0d8fe4062a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:30.813212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5208930c-1a88-4f06-8bec-0d8fe4062a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:30.819964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5208930c-1a88-4f06-8bec-0d8fe4062a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:30.820152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5208930c-1a88-4f06-8bec-0d8fe4062a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:30.820884 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5208930c-1a88-4f06-8bec-0d8fe4062a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:30.821522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5208930c-1a88-4f06-8bec-0d8fe4062a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:30.836462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f2a4a0df-9498-49fc-9f8b-be64f7adfb77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047055 Aug 01 15:40:30.837178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 421/925] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:30.867894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5208930c-1a88-4f06-8bec-0d8fe4062a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062034 Aug 01 15:40:30.868455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 505/926] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:31.850649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d6b31713-5917-4ebd-bddf-14feae4e5008 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:31.852844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d6b31713-5917-4ebd-bddf-14feae4e5008 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:31.859646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6b31713-5917-4ebd-bddf-14feae4e5008 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:31.860090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6b31713-5917-4ebd-bddf-14feae4e5008 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:31.860883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6b31713-5917-4ebd-bddf-14feae4e5008 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:31.861314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6b31713-5917-4ebd-bddf-14feae4e5008 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:31.894417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d6b31713-5917-4ebd-bddf-14feae4e5008 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047517 Aug 01 15:40:31.894622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6081c86b-ede6-4b4d-8c99-ebc0f5dbee17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:31.898127 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6081c86b-ede6-4b4d-8c99-ebc0f5dbee17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:31.899277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 422/927] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:40:31.905393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6081c86b-ede6-4b4d-8c99-ebc0f5dbee17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:31.905852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6081c86b-ede6-4b4d-8c99-ebc0f5dbee17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:31.906667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6081c86b-ede6-4b4d-8c99-ebc0f5dbee17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:31.907106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6081c86b-ede6-4b4d-8c99-ebc0f5dbee17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:31.939999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6081c86b-ede6-4b4d-8c99-ebc0f5dbee17 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063315 Aug 01 15:40:31.940556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 506/928] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:31 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:40:32.905868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1396452d-46a0-4e2d-b093-1824a12eea87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:32.909107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1396452d-46a0-4e2d-b093-1824a12eea87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:32.915655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1396452d-46a0-4e2d-b093-1824a12eea87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:32.916102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1396452d-46a0-4e2d-b093-1824a12eea87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:32.916861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1396452d-46a0-4e2d-b093-1824a12eea87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:32.917292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1396452d-46a0-4e2d-b093-1824a12eea87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:32.947215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1396452d-46a0-4e2d-b093-1824a12eea87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045228 Aug 01 15:40:32.951744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 423/929] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:32.958861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ba8d4682-163b-40ea-9181-5f33093ab70e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:32.961340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ba8d4682-163b-40ea-9181-5f33093ab70e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:32.969554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba8d4682-163b-40ea-9181-5f33093ab70e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:32.970013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba8d4682-163b-40ea-9181-5f33093ab70e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:32.970793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba8d4682-163b-40ea-9181-5f33093ab70e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:32.971228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba8d4682-163b-40ea-9181-5f33093ab70e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:33.002671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ba8d4682-163b-40ea-9181-5f33093ab70e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048697 Aug 01 15:40:33.003346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 507/930] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:32 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:33.959793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2954c80c-5d79-400e-afc4-55f52c2fcb06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:33.961953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2954c80c-5d79-400e-afc4-55f52c2fcb06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:33.969356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2954c80c-5d79-400e-afc4-55f52c2fcb06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:33.969801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2954c80c-5d79-400e-afc4-55f52c2fcb06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:33.970613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2954c80c-5d79-400e-afc4-55f52c2fcb06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:33.971112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2954c80c-5d79-400e-afc4-55f52c2fcb06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:34.000836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2954c80c-5d79-400e-afc4-55f52c2fcb06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045002 Aug 01 15:40:34.001489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 424/931] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:34.016137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0e638b25-ca7d-493a-9f68-52a6695d731c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:34.018411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0e638b25-ca7d-493a-9f68-52a6695d731c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:34.024955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e638b25-ca7d-493a-9f68-52a6695d731c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:34.025401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e638b25-ca7d-493a-9f68-52a6695d731c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:34.026212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e638b25-ca7d-493a-9f68-52a6695d731c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:34.026647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e638b25-ca7d-493a-9f68-52a6695d731c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:34.056354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0e638b25-ca7d-493a-9f68-52a6695d731c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044081 Aug 01 15:40:34.056912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 508/932] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:34 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:35.021299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8911fdde-4378-4d55-910d-26e75c29b04d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:35.023452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8911fdde-4378-4d55-910d-26e75c29b04d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:35.029552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8911fdde-4378-4d55-910d-26e75c29b04d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:35.030025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8911fdde-4378-4d55-910d-26e75c29b04d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:35.030792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8911fdde-4378-4d55-910d-26e75c29b04d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:35.031951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8911fdde-4378-4d55-910d-26e75c29b04d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:35.033694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:35.061709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8911fdde-4378-4d55-910d-26e75c29b04d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044328 Aug 01 15:40:35.069101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 425/933] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:35.069489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-575c38bc-68e5-45d2-8365-c927b20ba7a8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:35.071933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-575c38bc-68e5-45d2-8365-c927b20ba7a8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:35.078956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-575c38bc-68e5-45d2-8365-c927b20ba7a8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:35.079614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-575c38bc-68e5-45d2-8365-c927b20ba7a8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:35.081001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-575c38bc-68e5-45d2-8365-c927b20ba7a8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:35.081001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-575c38bc-68e5-45d2-8365-c927b20ba7a8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:35.112393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-575c38bc-68e5-45d2-8365-c927b20ba7a8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046899 Aug 01 15:40:35.112955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 509/934] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:35 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:36.077041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5c69f781-694e-4b0b-920a-eb64a759c92b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:36.079212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5c69f781-694e-4b0b-920a-eb64a759c92b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:36.086004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c69f781-694e-4b0b-920a-eb64a759c92b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:36.086568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c69f781-694e-4b0b-920a-eb64a759c92b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:36.087241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c69f781-694e-4b0b-920a-eb64a759c92b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:36.087678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c69f781-694e-4b0b-920a-eb64a759c92b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:36.119013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5c69f781-694e-4b0b-920a-eb64a759c92b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045223 Aug 01 15:40:36.120132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 426/935] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:36.128812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-417bd375-832b-4dce-a319-bd72b53c2988 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:36.131083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-417bd375-832b-4dce-a319-bd72b53c2988 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:36.137496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-417bd375-832b-4dce-a319-bd72b53c2988 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:36.138106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-417bd375-832b-4dce-a319-bd72b53c2988 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:36.138880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-417bd375-832b-4dce-a319-bd72b53c2988 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:36.139325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-417bd375-832b-4dce-a319-bd72b53c2988 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:36.168725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-417bd375-832b-4dce-a319-bd72b53c2988 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Aug 01 15:40:36.169427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 510/936] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:36 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:37.131409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d14a4c05-3a70-4288-a754-e6c3854cdb5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:37.133580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d14a4c05-3a70-4288-a754-e6c3854cdb5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:37.140131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d14a4c05-3a70-4288-a754-e6c3854cdb5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:37.141073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d14a4c05-3a70-4288-a754-e6c3854cdb5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:37.141847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d14a4c05-3a70-4288-a754-e6c3854cdb5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:37.142314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d14a4c05-3a70-4288-a754-e6c3854cdb5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:37.174916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d14a4c05-3a70-4288-a754-e6c3854cdb5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047468 Aug 01 15:40:37.179573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 427/937] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:37.184463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4e6d601c-4c1c-4246-8a01-555445b9efee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:37.186731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4e6d601c-4c1c-4246-8a01-555445b9efee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:37.193028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e6d601c-4c1c-4246-8a01-555445b9efee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:37.193476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e6d601c-4c1c-4246-8a01-555445b9efee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:37.194345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e6d601c-4c1c-4246-8a01-555445b9efee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:37.194821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4e6d601c-4c1c-4246-8a01-555445b9efee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:37.225854 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4e6d601c-4c1c-4246-8a01-555445b9efee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047774 Aug 01 15:40:37.226520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 511/938] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:37 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:38.187447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b0c7c87e-c4d2-41d2-950f-2b76172271dc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:38.189620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b0c7c87e-c4d2-41d2-950f-2b76172271dc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:38.196184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0c7c87e-c4d2-41d2-950f-2b76172271dc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:38.196624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0c7c87e-c4d2-41d2-950f-2b76172271dc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:38.197381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0c7c87e-c4d2-41d2-950f-2b76172271dc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:38.197807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0c7c87e-c4d2-41d2-950f-2b76172271dc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:38.228489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b0c7c87e-c4d2-41d2-950f-2b76172271dc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044928 Aug 01 15:40:38.229064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 428/939] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:38.251698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3f464533-8a8a-482d-bde3-190a070aae18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:38.254045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3f464533-8a8a-482d-bde3-190a070aae18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:38.260969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3f464533-8a8a-482d-bde3-190a070aae18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:38.261449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3f464533-8a8a-482d-bde3-190a070aae18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:38.262252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3f464533-8a8a-482d-bde3-190a070aae18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:38.262688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3f464533-8a8a-482d-bde3-190a070aae18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:38.293630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3f464533-8a8a-482d-bde3-190a070aae18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046266 Aug 01 15:40:38.294264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 512/940] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:38 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:39.241063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8217fd58-1fb7-4e68-89c1-273ae7a188f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:39.243158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8217fd58-1fb7-4e68-89c1-273ae7a188f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:39.249636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8217fd58-1fb7-4e68-89c1-273ae7a188f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:39.250126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8217fd58-1fb7-4e68-89c1-273ae7a188f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:39.251469 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8217fd58-1fb7-4e68-89c1-273ae7a188f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:39.252971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8217fd58-1fb7-4e68-89c1-273ae7a188f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:39.283916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8217fd58-1fb7-4e68-89c1-273ae7a188f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046899 Aug 01 15:40:39.284698 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 429/941] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:39.306787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3e3354c9-8246-4a87-9fc9-a040b9bee14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:39.308953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3e3354c9-8246-4a87-9fc9-a040b9bee14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:39.315156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3e3354c9-8246-4a87-9fc9-a040b9bee14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:39.315610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3e3354c9-8246-4a87-9fc9-a040b9bee14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:39.316388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3e3354c9-8246-4a87-9fc9-a040b9bee14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:39.316830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3e3354c9-8246-4a87-9fc9-a040b9bee14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:39.347578 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3e3354c9-8246-4a87-9fc9-a040b9bee14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045920 Aug 01 15:40:39.348141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 513/942] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:39 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:40.296502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8a578017-17d5-48ff-9264-1f1c6852b736 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:40.299317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8a578017-17d5-48ff-9264-1f1c6852b736 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:40.305957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a578017-17d5-48ff-9264-1f1c6852b736 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:40.306407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a578017-17d5-48ff-9264-1f1c6852b736 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:40.307170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a578017-17d5-48ff-9264-1f1c6852b736 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:40.307605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a578017-17d5-48ff-9264-1f1c6852b736 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:40.347289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8a578017-17d5-48ff-9264-1f1c6852b736 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054762 Aug 01 15:40:40.348032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 430/943] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:40.361109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8ee18bf6-8aa1-4cf4-89fb-70723b9f11e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:40.363295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8ee18bf6-8aa1-4cf4-89fb-70723b9f11e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:40.371183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ee18bf6-8aa1-4cf4-89fb-70723b9f11e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:40.371810 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ee18bf6-8aa1-4cf4-89fb-70723b9f11e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:40.372753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ee18bf6-8aa1-4cf4-89fb-70723b9f11e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:40.373191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ee18bf6-8aa1-4cf4-89fb-70723b9f11e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:40.377713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:40.405950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8ee18bf6-8aa1-4cf4-89fb-70723b9f11e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049878 Aug 01 15:40:40.406516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 514/944] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:40 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:41.359903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e9262530-bbab-4cc1-912f-2621d9a33a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:41.361994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e9262530-bbab-4cc1-912f-2621d9a33a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:41.368440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e9262530-bbab-4cc1-912f-2621d9a33a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:41.368875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e9262530-bbab-4cc1-912f-2621d9a33a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:41.369630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e9262530-bbab-4cc1-912f-2621d9a33a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:41.370098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e9262530-bbab-4cc1-912f-2621d9a33a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:41.399851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e9262530-bbab-4cc1-912f-2621d9a33a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043954 Aug 01 15:40:41.400599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 431/945] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:41.417005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8fbc5583-b343-4995-88d3-773f1fa81775 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:41.419228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8fbc5583-b343-4995-88d3-773f1fa81775 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:41.425788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8fbc5583-b343-4995-88d3-773f1fa81775 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:41.426264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8fbc5583-b343-4995-88d3-773f1fa81775 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:41.427023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8fbc5583-b343-4995-88d3-773f1fa81775 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:41.427456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8fbc5583-b343-4995-88d3-773f1fa81775 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:41.458123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8fbc5583-b343-4995-88d3-773f1fa81775 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Aug 01 15:40:41.458669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 515/946] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:42.412840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-24e807e3-820f-4f35-aaef-d71b51815385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:42.415014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-24e807e3-820f-4f35-aaef-d71b51815385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:42.421494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24e807e3-820f-4f35-aaef-d71b51815385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:42.421968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24e807e3-820f-4f35-aaef-d71b51815385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:42.422722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24e807e3-820f-4f35-aaef-d71b51815385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:42.423157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24e807e3-820f-4f35-aaef-d71b51815385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:42.451833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-24e807e3-820f-4f35-aaef-d71b51815385 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042992 Aug 01 15:40:42.452405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 432/947] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:42 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:42.470368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7d8d318e-23d9-4195-84f7-7aae6641772a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:42.472554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7d8d318e-23d9-4195-84f7-7aae6641772a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:42.478954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d8d318e-23d9-4195-84f7-7aae6641772a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:42.479494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d8d318e-23d9-4195-84f7-7aae6641772a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:42.480145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d8d318e-23d9-4195-84f7-7aae6641772a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:42.480574 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d8d318e-23d9-4195-84f7-7aae6641772a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:42.510148 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7d8d318e-23d9-4195-84f7-7aae6641772a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044618 Aug 01 15:40:42.510704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 516/948] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:42 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:43.464677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3692623e-9aa4-4d8c-a89c-e9bb1916415d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:43.466908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3692623e-9aa4-4d8c-a89c-e9bb1916415d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:43.473819 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3692623e-9aa4-4d8c-a89c-e9bb1916415d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:43.474291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3692623e-9aa4-4d8c-a89c-e9bb1916415d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:43.475054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3692623e-9aa4-4d8c-a89c-e9bb1916415d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:43.475485 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3692623e-9aa4-4d8c-a89c-e9bb1916415d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:43.506681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3692623e-9aa4-4d8c-a89c-e9bb1916415d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045919 Aug 01 15:40:43.507269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 433/949] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:43.521861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f68d15aa-f933-492a-b768-ad0dc29a735b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:43.524608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f68d15aa-f933-492a-b768-ad0dc29a735b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:43.531769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f68d15aa-f933-492a-b768-ad0dc29a735b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:43.532712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f68d15aa-f933-492a-b768-ad0dc29a735b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:43.533478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f68d15aa-f933-492a-b768-ad0dc29a735b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:43.534044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f68d15aa-f933-492a-b768-ad0dc29a735b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:43.577312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f68d15aa-f933-492a-b768-ad0dc29a735b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059406 Aug 01 15:40:43.577877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 517/950] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:43 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:44.519270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4ea692f3-73c5-41d5-b3fa-8a13c296bacd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:44.521362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4ea692f3-73c5-41d5-b3fa-8a13c296bacd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:44.528070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ea692f3-73c5-41d5-b3fa-8a13c296bacd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:44.528522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ea692f3-73c5-41d5-b3fa-8a13c296bacd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:44.529282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ea692f3-73c5-41d5-b3fa-8a13c296bacd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:44.529718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ea692f3-73c5-41d5-b3fa-8a13c296bacd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:44.560316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4ea692f3-73c5-41d5-b3fa-8a13c296bacd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045069 Aug 01 15:40:44.560894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 434/951] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:44.592416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c3a6affa-178e-4127-99fc-984515724715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:44.595155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c3a6affa-178e-4127-99fc-984515724715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:44.602061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3a6affa-178e-4127-99fc-984515724715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:44.602509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3a6affa-178e-4127-99fc-984515724715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:44.603273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3a6affa-178e-4127-99fc-984515724715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:44.603700 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3a6affa-178e-4127-99fc-984515724715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:44.636624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c3a6affa-178e-4127-99fc-984515724715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048317 Aug 01 15:40:44.637197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 518/952] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:44 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:45.572779 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2fa04d50-6099-4e7a-a402-471d845a2086 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:45.574962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2fa04d50-6099-4e7a-a402-471d845a2086 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:45.582047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2fa04d50-6099-4e7a-a402-471d845a2086 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:45.582501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2fa04d50-6099-4e7a-a402-471d845a2086 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:45.583269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2fa04d50-6099-4e7a-a402-471d845a2086 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:45.583715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2fa04d50-6099-4e7a-a402-471d845a2086 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:45.614608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2fa04d50-6099-4e7a-a402-471d845a2086 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045694 Aug 01 15:40:45.615183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 435/953] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:45.654757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-07c31357-e73a-4265-aea3-e9886443f650 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:45.656906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-07c31357-e73a-4265-aea3-e9886443f650 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:45.663580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07c31357-e73a-4265-aea3-e9886443f650 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:45.664066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07c31357-e73a-4265-aea3-e9886443f650 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:45.664844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07c31357-e73a-4265-aea3-e9886443f650 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:45.665311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07c31357-e73a-4265-aea3-e9886443f650 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:45.695849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-07c31357-e73a-4265-aea3-e9886443f650 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Aug 01 15:40:45.696566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 519/954] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:45 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:46.627614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c73f2643-792d-4113-8c37-935058413f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:46.629747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c73f2643-792d-4113-8c37-935058413f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:46.636528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c73f2643-792d-4113-8c37-935058413f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:46.636977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c73f2643-792d-4113-8c37-935058413f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:46.637741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c73f2643-792d-4113-8c37-935058413f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:46.638201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c73f2643-792d-4113-8c37-935058413f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:46.667231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c73f2643-792d-4113-8c37-935058413f75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044177 Aug 01 15:40:46.667231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 436/955] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:46.709150 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-007794d5-1a0b-41ef-8899-cd298d1eeac4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:46.711328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-007794d5-1a0b-41ef-8899-cd298d1eeac4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:46.718282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-007794d5-1a0b-41ef-8899-cd298d1eeac4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:46.718731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-007794d5-1a0b-41ef-8899-cd298d1eeac4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:46.719554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-007794d5-1a0b-41ef-8899-cd298d1eeac4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:46.719987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-007794d5-1a0b-41ef-8899-cd298d1eeac4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:46.750016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-007794d5-1a0b-41ef-8899-cd298d1eeac4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044459 Aug 01 15:40:46.750564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 520/956] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:46 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:47.679641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-be5c7dab-b603-4f67-afe7-97651f84f534 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:47.681881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-be5c7dab-b603-4f67-afe7-97651f84f534 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:47.688654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be5c7dab-b603-4f67-afe7-97651f84f534 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:47.689086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be5c7dab-b603-4f67-afe7-97651f84f534 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:47.689849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be5c7dab-b603-4f67-afe7-97651f84f534 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:47.690306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be5c7dab-b603-4f67-afe7-97651f84f534 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:47.720205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-be5c7dab-b603-4f67-afe7-97651f84f534 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044196 Aug 01 15:40:47.720763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 437/957] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:47.762573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5a7a74e9-e285-4027-b1f2-0a4bc19f31d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:47.764749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5a7a74e9-e285-4027-b1f2-0a4bc19f31d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:47.771953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a7a74e9-e285-4027-b1f2-0a4bc19f31d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:47.772411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a7a74e9-e285-4027-b1f2-0a4bc19f31d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:47.773185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a7a74e9-e285-4027-b1f2-0a4bc19f31d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:47.773624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a7a74e9-e285-4027-b1f2-0a4bc19f31d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:47.804673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5a7a74e9-e285-4027-b1f2-0a4bc19f31d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046112 Aug 01 15:40:47.805376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 521/958] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:47 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:48.732258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cdf010f1-9446-4764-866d-afe60c1ce780 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:48.734553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cdf010f1-9446-4764-866d-afe60c1ce780 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:48.744645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cdf010f1-9446-4764-866d-afe60c1ce780 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:48.745442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cdf010f1-9446-4764-866d-afe60c1ce780 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:48.746849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cdf010f1-9446-4764-866d-afe60c1ce780 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:48.747644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cdf010f1-9446-4764-866d-afe60c1ce780 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:48.778520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cdf010f1-9446-4764-866d-afe60c1ce780 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050087 Aug 01 15:40:48.779081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 438/959] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:48.819400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6eed62fa-7036-4815-9f40-1c6e6c81fb1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:48.826440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6eed62fa-7036-4815-9f40-1c6e6c81fb1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:48.836076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6eed62fa-7036-4815-9f40-1c6e6c81fb1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:48.836760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6eed62fa-7036-4815-9f40-1c6e6c81fb1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:48.837530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6eed62fa-7036-4815-9f40-1c6e6c81fb1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:48.838187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6eed62fa-7036-4815-9f40-1c6e6c81fb1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:48.870635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6eed62fa-7036-4815-9f40-1c6e6c81fb1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055021 Aug 01 15:40:48.871140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 522/960] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:48 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:49.791272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d7dd45bd-80cf-4759-9898-58b312d38646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:49.793339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d7dd45bd-80cf-4759-9898-58b312d38646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:49.795410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=58 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:49.800734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7dd45bd-80cf-4759-9898-58b312d38646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:49.801183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7dd45bd-80cf-4759-9898-58b312d38646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:49.801968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7dd45bd-80cf-4759-9898-58b312d38646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:49.802404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7dd45bd-80cf-4759-9898-58b312d38646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:49.832207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d7dd45bd-80cf-4759-9898-58b312d38646 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045221 Aug 01 15:40:49.832763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 439/961] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:49.883203 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cc8715d9-d083-4198-bf2a-cd268c05743c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:49.885469 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cc8715d9-d083-4198-bf2a-cd268c05743c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:49.892177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc8715d9-d083-4198-bf2a-cd268c05743c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:49.892619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc8715d9-d083-4198-bf2a-cd268c05743c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:49.893393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc8715d9-d083-4198-bf2a-cd268c05743c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:49.893832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc8715d9-d083-4198-bf2a-cd268c05743c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:49.925319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cc8715d9-d083-4198-bf2a-cd268c05743c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 Aug 01 15:40:49.925916 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 523/962] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:50.844725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c86f60f1-d802-4b83-9e9e-7baf2f803d2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:50.847497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c86f60f1-d802-4b83-9e9e-7baf2f803d2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:50.854201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c86f60f1-d802-4b83-9e9e-7baf2f803d2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:50.854784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c86f60f1-d802-4b83-9e9e-7baf2f803d2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:50.855413 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c86f60f1-d802-4b83-9e9e-7baf2f803d2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:50.855844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c86f60f1-d802-4b83-9e9e-7baf2f803d2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:50.884329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c86f60f1-d802-4b83-9e9e-7baf2f803d2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044205 Aug 01 15:40:50.885042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 440/963] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:50.938271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b1166219-4acf-41e6-bfef-11b30562d5ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:50.940566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b1166219-4acf-41e6-bfef-11b30562d5ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:50.947237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1166219-4acf-41e6-bfef-11b30562d5ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:50.947681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1166219-4acf-41e6-bfef-11b30562d5ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:50.948435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1166219-4acf-41e6-bfef-11b30562d5ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:50.948862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1166219-4acf-41e6-bfef-11b30562d5ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:50.989534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b1166219-4acf-41e6-bfef-11b30562d5ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055020 Aug 01 15:40:50.990131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 524/964] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:50 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:51.897265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b27069bf-a0a6-40a9-836f-4690720bcf87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:51.899529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b27069bf-a0a6-40a9-836f-4690720bcf87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:51.906269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b27069bf-a0a6-40a9-836f-4690720bcf87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:51.906729 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b27069bf-a0a6-40a9-836f-4690720bcf87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:51.908158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b27069bf-a0a6-40a9-836f-4690720bcf87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:51.908604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b27069bf-a0a6-40a9-836f-4690720bcf87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:51.934357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:51.939188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b27069bf-a0a6-40a9-836f-4690720bcf87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046102 Aug 01 15:40:51.939753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 441/965] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:52.002085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-faebad31-df9c-4e4a-83a8-a97e02dfcfa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:52.004337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-faebad31-df9c-4e4a-83a8-a97e02dfcfa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:52.011061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-faebad31-df9c-4e4a-83a8-a97e02dfcfa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:52.011481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-faebad31-df9c-4e4a-83a8-a97e02dfcfa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:52.012247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-faebad31-df9c-4e4a-83a8-a97e02dfcfa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:52.012679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-faebad31-df9c-4e4a-83a8-a97e02dfcfa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:52.060048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-faebad31-df9c-4e4a-83a8-a97e02dfcfa6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061957 Aug 01 15:40:52.060957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 525/966] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:51 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:52.952072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f4e08d43-995c-46e2-8759-b66b40dff5a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:52.954169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f4e08d43-995c-46e2-8759-b66b40dff5a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:52.960908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4e08d43-995c-46e2-8759-b66b40dff5a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:52.961348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4e08d43-995c-46e2-8759-b66b40dff5a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:52.962137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4e08d43-995c-46e2-8759-b66b40dff5a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:52.962569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4e08d43-995c-46e2-8759-b66b40dff5a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:52.991675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f4e08d43-995c-46e2-8759-b66b40dff5a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043626 Aug 01 15:40:52.992230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 442/967] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:53.074813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-60bd4e6e-37f5-437d-b6bb-095c6d6f2d8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:53.076938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-60bd4e6e-37f5-437d-b6bb-095c6d6f2d8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:53.083444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60bd4e6e-37f5-437d-b6bb-095c6d6f2d8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:53.083889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60bd4e6e-37f5-437d-b6bb-095c6d6f2d8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:53.084642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60bd4e6e-37f5-437d-b6bb-095c6d6f2d8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:53.085066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60bd4e6e-37f5-437d-b6bb-095c6d6f2d8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:53.122011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-60bd4e6e-37f5-437d-b6bb-095c6d6f2d8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051286 Aug 01 15:40:53.127120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 526/968] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:53 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:54.004697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-02f4db55-7af8-4893-9ecd-60593c993a85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:54.006858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-02f4db55-7af8-4893-9ecd-60593c993a85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:54.013267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02f4db55-7af8-4893-9ecd-60593c993a85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:54.013716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02f4db55-7af8-4893-9ecd-60593c993a85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:54.014523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02f4db55-7af8-4893-9ecd-60593c993a85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:54.014959 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02f4db55-7af8-4893-9ecd-60593c993a85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:54.044431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-02f4db55-7af8-4893-9ecd-60593c993a85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044291 Aug 01 15:40:54.044991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 443/969] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:54.134741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8b1699c1-db0a-434f-9ef6-41621286fbd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:54.136912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8b1699c1-db0a-434f-9ef6-41621286fbd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:54.144071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b1699c1-db0a-434f-9ef6-41621286fbd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:54.144518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b1699c1-db0a-434f-9ef6-41621286fbd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:54.145346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b1699c1-db0a-434f-9ef6-41621286fbd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:54.145790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b1699c1-db0a-434f-9ef6-41621286fbd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:54.175653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8b1699c1-db0a-434f-9ef6-41621286fbd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044921 Aug 01 15:40:54.176206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 527/970] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:54 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:55.057095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b2ee7f03-7252-45d4-85cf-f2b5532e8e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:55.059252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b2ee7f03-7252-45d4-85cf-f2b5532e8e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:55.065970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2ee7f03-7252-45d4-85cf-f2b5532e8e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:55.066424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2ee7f03-7252-45d4-85cf-f2b5532e8e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:55.067205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2ee7f03-7252-45d4-85cf-f2b5532e8e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:55.067642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2ee7f03-7252-45d4-85cf-f2b5532e8e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:55.098214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b2ee7f03-7252-45d4-85cf-f2b5532e8e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045105 Aug 01 15:40:55.098788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 444/971] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:55.188971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fc9d26dc-2c72-43a8-881f-220fc3c2aae9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:55.191161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fc9d26dc-2c72-43a8-881f-220fc3c2aae9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:55.197744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc9d26dc-2c72-43a8-881f-220fc3c2aae9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:55.198233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc9d26dc-2c72-43a8-881f-220fc3c2aae9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:55.199198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc9d26dc-2c72-43a8-881f-220fc3c2aae9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:55.199434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc9d26dc-2c72-43a8-881f-220fc3c2aae9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:55.231059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fc9d26dc-2c72-43a8-881f-220fc3c2aae9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046924 Aug 01 15:40:55.231715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 528/972] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:55 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:56.111607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-16555286-aad8-4733-b570-4b5b834dd3f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:56.113678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-16555286-aad8-4733-b570-4b5b834dd3f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:56.120089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16555286-aad8-4733-b570-4b5b834dd3f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:56.120528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16555286-aad8-4733-b570-4b5b834dd3f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:56.121280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16555286-aad8-4733-b570-4b5b834dd3f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:56.121706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16555286-aad8-4733-b570-4b5b834dd3f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:56.150986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-16555286-aad8-4733-b570-4b5b834dd3f5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043901 Aug 01 15:40:56.151535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 445/973] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:56.243317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cd497671-f964-4e0b-a62c-a79ee110c44a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:56.245584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cd497671-f964-4e0b-a62c-a79ee110c44a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:56.252328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd497671-f964-4e0b-a62c-a79ee110c44a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:56.252779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd497671-f964-4e0b-a62c-a79ee110c44a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:56.253553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd497671-f964-4e0b-a62c-a79ee110c44a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:56.254022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd497671-f964-4e0b-a62c-a79ee110c44a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:56.284401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cd497671-f964-4e0b-a62c-a79ee110c44a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044934 Aug 01 15:40:56.285275 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 529/974] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:56 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:57.162767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ae5078f6-2743-4ac8-8087-f1480074c60a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:57.164907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ae5078f6-2743-4ac8-8087-f1480074c60a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:57.171777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae5078f6-2743-4ac8-8087-f1480074c60a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:57.172224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae5078f6-2743-4ac8-8087-f1480074c60a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:57.172988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae5078f6-2743-4ac8-8087-f1480074c60a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:57.173420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae5078f6-2743-4ac8-8087-f1480074c60a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:57.202315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ae5078f6-2743-4ac8-8087-f1480074c60a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043534 Aug 01 15:40:57.202866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 446/975] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:57.298295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1b79860c-333a-4ff8-9fe6-337b4e0e96a5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:57.300641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1b79860c-333a-4ff8-9fe6-337b4e0e96a5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:57.307244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b79860c-333a-4ff8-9fe6-337b4e0e96a5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:57.307692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b79860c-333a-4ff8-9fe6-337b4e0e96a5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:57.308453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b79860c-333a-4ff8-9fe6-337b4e0e96a5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:57.308881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b79860c-333a-4ff8-9fe6-337b4e0e96a5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:57.335481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:57.341400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1b79860c-333a-4ff8-9fe6-337b4e0e96a5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047063 Aug 01 15:40:57.345952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 530/976] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:57 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:58.215706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-30a479bf-2b76-4ae9-b180-8bcf7b155c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:58.218073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-30a479bf-2b76-4ae9-b180-8bcf7b155c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:58.225498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30a479bf-2b76-4ae9-b180-8bcf7b155c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:58.225971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30a479bf-2b76-4ae9-b180-8bcf7b155c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:58.226742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30a479bf-2b76-4ae9-b180-8bcf7b155c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:58.227210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30a479bf-2b76-4ae9-b180-8bcf7b155c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:58.255721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-30a479bf-2b76-4ae9-b180-8bcf7b155c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044068 Aug 01 15:40:58.256289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 447/977] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:58.353732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-01a3f436-c3af-40a4-afa0-82264247b6a1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:58.355954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-01a3f436-c3af-40a4-afa0-82264247b6a1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:58.362814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01a3f436-c3af-40a4-afa0-82264247b6a1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:58.363262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01a3f436-c3af-40a4-afa0-82264247b6a1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:58.364031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01a3f436-c3af-40a4-afa0-82264247b6a1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:58.364464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-01a3f436-c3af-40a4-afa0-82264247b6a1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:58.394587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-01a3f436-c3af-40a4-afa0-82264247b6a1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Aug 01 15:40:58.395152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 531/978] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:58 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:40:59.268597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f2ad3cdf-8c16-496a-b902-9d238076b3c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:59.270796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f2ad3cdf-8c16-496a-b902-9d238076b3c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:59.277303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2ad3cdf-8c16-496a-b902-9d238076b3c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:59.277755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2ad3cdf-8c16-496a-b902-9d238076b3c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:59.278566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2ad3cdf-8c16-496a-b902-9d238076b3c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:59.279002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2ad3cdf-8c16-496a-b902-9d238076b3c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:59.308595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f2ad3cdf-8c16-496a-b902-9d238076b3c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044241 Aug 01 15:40:59.309177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 448/979] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:40:59 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:40:59.406777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2a08ab61-6b7f-496e-a0fb-8c58622d20c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:40:59.409575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2a08ab61-6b7f-496e-a0fb-8c58622d20c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:40:59.411981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=58 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:40:59.417292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a08ab61-6b7f-496e-a0fb-8c58622d20c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:59.417731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a08ab61-6b7f-496e-a0fb-8c58622d20c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:59.418518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a08ab61-6b7f-496e-a0fb-8c58622d20c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:40:59.418946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a08ab61-6b7f-496e-a0fb-8c58622d20c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:40:59.451152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2a08ab61-6b7f-496e-a0fb-8c58622d20c7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048187 Aug 01 15:40:59.455964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 532/980] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:40:59 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:00.321291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f1ebca9f-43e4-434c-a815-644e5eafd09b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:00.323375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f1ebca9f-43e4-434c-a815-644e5eafd09b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:00.330542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1ebca9f-43e4-434c-a815-644e5eafd09b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:00.330995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1ebca9f-43e4-434c-a815-644e5eafd09b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:00.331765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1ebca9f-43e4-434c-a815-644e5eafd09b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:00.332202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1ebca9f-43e4-434c-a815-644e5eafd09b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:00.363715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f1ebca9f-43e4-434c-a815-644e5eafd09b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046412 Aug 01 15:41:00.364274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 449/981] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:00.463778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c42847fd-d1f7-45a7-9e8d-e3f0fa109264 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:00.466044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c42847fd-d1f7-45a7-9e8d-e3f0fa109264 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:00.472867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c42847fd-d1f7-45a7-9e8d-e3f0fa109264 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:00.473319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c42847fd-d1f7-45a7-9e8d-e3f0fa109264 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:00.474125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c42847fd-d1f7-45a7-9e8d-e3f0fa109264 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:00.474565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c42847fd-d1f7-45a7-9e8d-e3f0fa109264 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:00.506296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c42847fd-d1f7-45a7-9e8d-e3f0fa109264 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046799 Aug 01 15:41:00.506877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 533/982] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:00 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:01.376142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3cee0b47-2a14-4975-91a6-d2d73c941a15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:01.378317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3cee0b47-2a14-4975-91a6-d2d73c941a15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:01.384933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cee0b47-2a14-4975-91a6-d2d73c941a15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:01.385385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cee0b47-2a14-4975-91a6-d2d73c941a15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:01.386202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cee0b47-2a14-4975-91a6-d2d73c941a15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:01.386637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cee0b47-2a14-4975-91a6-d2d73c941a15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:01.416852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3cee0b47-2a14-4975-91a6-d2d73c941a15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044652 Aug 01 15:41:01.417432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 450/983] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:01.518380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-28da7ef0-1ced-48df-9dcc-7ef201c7a497 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:01.521076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-28da7ef0-1ced-48df-9dcc-7ef201c7a497 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:01.527821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-28da7ef0-1ced-48df-9dcc-7ef201c7a497 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:01.528277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-28da7ef0-1ced-48df-9dcc-7ef201c7a497 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:01.529056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-28da7ef0-1ced-48df-9dcc-7ef201c7a497 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:01.529687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-28da7ef0-1ced-48df-9dcc-7ef201c7a497 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:01.564865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-28da7ef0-1ced-48df-9dcc-7ef201c7a497 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050506 Aug 01 15:41:01.566121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 534/984] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:01 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:02.429649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-49cb20a4-0ff4-4b76-93f2-3b8173d22c95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:02.431851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-49cb20a4-0ff4-4b76-93f2-3b8173d22c95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:02.438302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49cb20a4-0ff4-4b76-93f2-3b8173d22c95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:02.438750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49cb20a4-0ff4-4b76-93f2-3b8173d22c95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:02.439511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49cb20a4-0ff4-4b76-93f2-3b8173d22c95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:02.439955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49cb20a4-0ff4-4b76-93f2-3b8173d22c95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:02.468420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-49cb20a4-0ff4-4b76-93f2-3b8173d22c95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042707 Aug 01 15:41:02.468970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 451/985] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:02.577082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6a80b8c1-db98-44fa-86bc-19a1ec67ca9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:02.579288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6a80b8c1-db98-44fa-86bc-19a1ec67ca9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:02.586265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a80b8c1-db98-44fa-86bc-19a1ec67ca9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:02.586713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a80b8c1-db98-44fa-86bc-19a1ec67ca9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:02.587477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a80b8c1-db98-44fa-86bc-19a1ec67ca9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:02.587911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a80b8c1-db98-44fa-86bc-19a1ec67ca9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:02.618149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6a80b8c1-db98-44fa-86bc-19a1ec67ca9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044850 Aug 01 15:41:02.618863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 535/986] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:02 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:03.480828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bdf3fdf2-e0f5-437a-8b69-8972afd1e075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:03.483049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bdf3fdf2-e0f5-437a-8b69-8972afd1e075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:03.491122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bdf3fdf2-e0f5-437a-8b69-8972afd1e075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:03.491823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bdf3fdf2-e0f5-437a-8b69-8972afd1e075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:03.492650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bdf3fdf2-e0f5-437a-8b69-8972afd1e075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:03.493233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bdf3fdf2-e0f5-437a-8b69-8972afd1e075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:03.522371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bdf3fdf2-e0f5-437a-8b69-8972afd1e075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045466 Aug 01 15:41:03.522924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 452/987] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:03.632282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-85fde702-6330-4421-88a5-2aee32f65aef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:03.634469 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-85fde702-6330-4421-88a5-2aee32f65aef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:03.641137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-85fde702-6330-4421-88a5-2aee32f65aef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:03.641590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-85fde702-6330-4421-88a5-2aee32f65aef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:03.642395 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-85fde702-6330-4421-88a5-2aee32f65aef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:03.642830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-85fde702-6330-4421-88a5-2aee32f65aef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:03.684719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-85fde702-6330-4421-88a5-2aee32f65aef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058124 Aug 01 15:41:03.685577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 536/988] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:03 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:04.534888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-67127afb-a24e-4c3e-b881-805c3b26caed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:04.537060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-67127afb-a24e-4c3e-b881-805c3b26caed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:04.543509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67127afb-a24e-4c3e-b881-805c3b26caed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:04.543951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67127afb-a24e-4c3e-b881-805c3b26caed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:04.544719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67127afb-a24e-4c3e-b881-805c3b26caed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:04.545147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67127afb-a24e-4c3e-b881-805c3b26caed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:04.573985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-67127afb-a24e-4c3e-b881-805c3b26caed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043108 Aug 01 15:41:04.574560 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 453/989] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:04 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:04.698825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5fd8204a-66de-45d3-96fc-3313d84eeaf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:04.701382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5fd8204a-66de-45d3-96fc-3313d84eeaf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:04.708328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5fd8204a-66de-45d3-96fc-3313d84eeaf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:04.708784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5fd8204a-66de-45d3-96fc-3313d84eeaf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:04.709553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5fd8204a-66de-45d3-96fc-3313d84eeaf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:04.710020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5fd8204a-66de-45d3-96fc-3313d84eeaf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:04.739946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5fd8204a-66de-45d3-96fc-3313d84eeaf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046488 Aug 01 15:41:04.740507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 537/990] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:04 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:05.586727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7606910f-2617-4eb1-b25e-3fdf03afe6a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:05.589081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7606910f-2617-4eb1-b25e-3fdf03afe6a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:05.597046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7606910f-2617-4eb1-b25e-3fdf03afe6a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:05.597485 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7606910f-2617-4eb1-b25e-3fdf03afe6a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:05.598490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7606910f-2617-4eb1-b25e-3fdf03afe6a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:05.598919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7606910f-2617-4eb1-b25e-3fdf03afe6a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:05.631190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7606910f-2617-4eb1-b25e-3fdf03afe6a6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048048 Aug 01 15:41:05.631907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 454/991] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:05.751729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-39387af5-fcc9-4a28-ba2c-37cd4844e86c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:05.754077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-39387af5-fcc9-4a28-ba2c-37cd4844e86c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:05.763427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39387af5-fcc9-4a28-ba2c-37cd4844e86c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:05.764354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39387af5-fcc9-4a28-ba2c-37cd4844e86c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:05.765218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39387af5-fcc9-4a28-ba2c-37cd4844e86c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:05.765675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39387af5-fcc9-4a28-ba2c-37cd4844e86c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:05.797268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-39387af5-fcc9-4a28-ba2c-37cd4844e86c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049483 Aug 01 15:41:05.797988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 538/992] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:05 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:05.828723 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-012fcbc5-d266-4a3d-b611-851ae9ff766a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:41:05.829262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-012fcbc5-d266-4a3d-b611-851ae9ff766a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:05.836139 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-012fcbc5-d266-4a3d-b611-851ae9ff766a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:05.837023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-012fcbc5-d266-4a3d-b611-851ae9ff766a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:05.837903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-012fcbc5-d266-4a3d-b611-851ae9ff766a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:05.838439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-012fcbc5-d266-4a3d-b611-851ae9ff766a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:05.862397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.objects.instance [None req-012fcbc5-d266-4a3d-b611-851ae9ff766a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lazy-loading 'flavor' on Instance uuid 58f0755f-45c5-4c98-96b7-9c4b6415d331 {{(pid=124526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:41:06.126237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-012fcbc5-d266-4a3d-b611-851ae9ff766a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "POST /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331/action" status: 202 len: 0 microversion: 2.1 time: 0.301219 Aug 01 15:41:06.126813 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 455/993] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 1 15:41:05 2022] POST /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:41:06.136168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3eb8b557-2ce6-4a63-8b0e-72be072a7b54 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:06.136812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3eb8b557-2ce6-4a63-8b0e-72be072a7b54 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:06.144302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3eb8b557-2ce6-4a63-8b0e-72be072a7b54 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:06.144763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3eb8b557-2ce6-4a63-8b0e-72be072a7b54 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:06.145540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3eb8b557-2ce6-4a63-8b0e-72be072a7b54 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:06.146014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3eb8b557-2ce6-4a63-8b0e-72be072a7b54 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:06.280597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3eb8b557-2ce6-4a63-8b0e-72be072a7b54 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:06.288199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3eb8b557-2ce6-4a63-8b0e-72be072a7b54 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156496 Aug 01 15:41:06.288755 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 539/994] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:06 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:06.645427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-28ace7d3-20d5-4820-89fd-0c3e4971d93e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:06.647661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-28ace7d3-20d5-4820-89fd-0c3e4971d93e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:06.653912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28ace7d3-20d5-4820-89fd-0c3e4971d93e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:06.654383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28ace7d3-20d5-4820-89fd-0c3e4971d93e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:06.655152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28ace7d3-20d5-4820-89fd-0c3e4971d93e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:06.655592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28ace7d3-20d5-4820-89fd-0c3e4971d93e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:06.669909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:06.689212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-28ace7d3-20d5-4820-89fd-0c3e4971d93e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048556 Aug 01 15:41:06.689774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 456/995] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:06.809481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f54c7212-e983-4e34-8f71-8d9eec2a91c1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:06.811750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f54c7212-e983-4e34-8f71-8d9eec2a91c1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:06.818976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f54c7212-e983-4e34-8f71-8d9eec2a91c1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:06.819433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f54c7212-e983-4e34-8f71-8d9eec2a91c1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:06.820202 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f54c7212-e983-4e34-8f71-8d9eec2a91c1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:06.820639 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f54c7212-e983-4e34-8f71-8d9eec2a91c1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:06.851307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f54c7212-e983-4e34-8f71-8d9eec2a91c1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045796 Aug 01 15:41:06.856076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 540/996] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:06 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:07.309588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9fa19fe8-ee3c-4e9f-a997-59a628dce07e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:07.310143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9fa19fe8-ee3c-4e9f-a997-59a628dce07e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:07.316948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9fa19fe8-ee3c-4e9f-a997-59a628dce07e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:07.317401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9fa19fe8-ee3c-4e9f-a997-59a628dce07e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:07.318197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9fa19fe8-ee3c-4e9f-a997-59a628dce07e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:07.318716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9fa19fe8-ee3c-4e9f-a997-59a628dce07e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:07.686632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9fa19fe8-ee3c-4e9f-a997-59a628dce07e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:07.694469 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9fa19fe8-ee3c-4e9f-a997-59a628dce07e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.388666 Aug 01 15:41:07.695326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 457/997] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:07 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:07.702019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c9d60092-ee9c-486a-9024-68672fa721d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:07.704156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c9d60092-ee9c-486a-9024-68672fa721d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:07.710307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c9d60092-ee9c-486a-9024-68672fa721d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:07.710762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c9d60092-ee9c-486a-9024-68672fa721d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:07.711528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c9d60092-ee9c-486a-9024-68672fa721d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:07.711967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c9d60092-ee9c-486a-9024-68672fa721d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:07.742729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c9d60092-ee9c-486a-9024-68672fa721d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044519 Aug 01 15:41:07.743325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 541/998] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:07 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:07.863026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-db1b0d14-d29d-4568-81c3-41d4385f91a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:07.865250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-db1b0d14-d29d-4568-81c3-41d4385f91a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:07.871916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db1b0d14-d29d-4568-81c3-41d4385f91a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:07.872373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db1b0d14-d29d-4568-81c3-41d4385f91a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:07.873192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db1b0d14-d29d-4568-81c3-41d4385f91a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:07.874810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db1b0d14-d29d-4568-81c3-41d4385f91a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:07.921306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-db1b0d14-d29d-4568-81c3-41d4385f91a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062089 Aug 01 15:41:07.921905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 458/999] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:07 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:08.716104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-74ebb1ff-b2ed-4479-9ee6-7f3ba52b8ed9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:08.716707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-74ebb1ff-b2ed-4479-9ee6-7f3ba52b8ed9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:08.723688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-74ebb1ff-b2ed-4479-9ee6-7f3ba52b8ed9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:08.724137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-74ebb1ff-b2ed-4479-9ee6-7f3ba52b8ed9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:08.724906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-74ebb1ff-b2ed-4479-9ee6-7f3ba52b8ed9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:08.725344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-74ebb1ff-b2ed-4479-9ee6-7f3ba52b8ed9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:08.755110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8a9655e0-e255-4627-9e84-ee26e73fae98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:08.757364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8a9655e0-e255-4627-9e84-ee26e73fae98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:08.764124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a9655e0-e255-4627-9e84-ee26e73fae98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:08.764573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a9655e0-e255-4627-9e84-ee26e73fae98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:08.765349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a9655e0-e255-4627-9e84-ee26e73fae98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:08.765789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a9655e0-e255-4627-9e84-ee26e73fae98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:08.795372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8a9655e0-e255-4627-9e84-ee26e73fae98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044769 Aug 01 15:41:08.795848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 459/1000] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:41:08.858875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-74ebb1ff-b2ed-4479-9ee6-7f3ba52b8ed9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:08.866894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-74ebb1ff-b2ed-4479-9ee6-7f3ba52b8ed9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154739 Aug 01 15:41:08.867441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 542/1001] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:08 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:08.932583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8bdbed00-415b-44b4-a85c-57702cc67ae8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:08.934770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8bdbed00-415b-44b4-a85c-57702cc67ae8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:08.941312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8bdbed00-415b-44b4-a85c-57702cc67ae8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:08.941752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8bdbed00-415b-44b4-a85c-57702cc67ae8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:08.942542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8bdbed00-415b-44b4-a85c-57702cc67ae8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:08.942974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8bdbed00-415b-44b4-a85c-57702cc67ae8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:08.973036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8bdbed00-415b-44b4-a85c-57702cc67ae8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044298 Aug 01 15:41:08.973924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 460/1002] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:08 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:09.808298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5530ae8b-1394-454f-bf19-71cff93ac569 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:09.810404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5530ae8b-1394-454f-bf19-71cff93ac569 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:09.817464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5530ae8b-1394-454f-bf19-71cff93ac569 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:09.817940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5530ae8b-1394-454f-bf19-71cff93ac569 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:09.818727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5530ae8b-1394-454f-bf19-71cff93ac569 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:09.819169 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5530ae8b-1394-454f-bf19-71cff93ac569 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:09.852219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5530ae8b-1394-454f-bf19-71cff93ac569 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047959 Aug 01 15:41:09.852782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 543/1003] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:09.889060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5aa2af8e-a381-4186-bf2a-0f704c765568 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:09.889732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5aa2af8e-a381-4186-bf2a-0f704c765568 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:09.896846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5aa2af8e-a381-4186-bf2a-0f704c765568 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:09.897338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5aa2af8e-a381-4186-bf2a-0f704c765568 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:09.898132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5aa2af8e-a381-4186-bf2a-0f704c765568 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:09.898574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5aa2af8e-a381-4186-bf2a-0f704c765568 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:09.985363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-18b5f300-e442-4097-8edd-be3bd18866eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:09.988544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-18b5f300-e442-4097-8edd-be3bd18866eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:09.997227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18b5f300-e442-4097-8edd-be3bd18866eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:09.997779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18b5f300-e442-4097-8edd-be3bd18866eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:09.998591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18b5f300-e442-4097-8edd-be3bd18866eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:09.999031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18b5f300-e442-4097-8edd-be3bd18866eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:10.041295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-18b5f300-e442-4097-8edd-be3bd18866eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060488 Aug 01 15:41:10.042116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 544/1004] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:09 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:10.044039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5aa2af8e-a381-4186-bf2a-0f704c765568 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:10.052053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5aa2af8e-a381-4186-bf2a-0f704c765568 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.166822 Aug 01 15:41:10.054212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 461/1005] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:09 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:10.864618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-237c1b1f-e45c-4887-be4f-e92dc5164024 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:10.866784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-237c1b1f-e45c-4887-be4f-e92dc5164024 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:10.873390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-237c1b1f-e45c-4887-be4f-e92dc5164024 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:10.873846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-237c1b1f-e45c-4887-be4f-e92dc5164024 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:10.874656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-237c1b1f-e45c-4887-be4f-e92dc5164024 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:10.875095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-237c1b1f-e45c-4887-be4f-e92dc5164024 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:10.905678 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-237c1b1f-e45c-4887-be4f-e92dc5164024 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044871 Aug 01 15:41:10.906198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 545/1006] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:10 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:11.053192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-14e4362f-5d5e-41f5-b4f0-be8b89fadc6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:11.055417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-14e4362f-5d5e-41f5-b4f0-be8b89fadc6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:11.062341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14e4362f-5d5e-41f5-b4f0-be8b89fadc6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:11.063081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14e4362f-5d5e-41f5-b4f0-be8b89fadc6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:11.064284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14e4362f-5d5e-41f5-b4f0-be8b89fadc6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:11.065059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14e4362f-5d5e-41f5-b4f0-be8b89fadc6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:11.073677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fadd273e-d1dc-459f-b7ae-6dcda1ec9e55 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:11.074349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fadd273e-d1dc-459f-b7ae-6dcda1ec9e55 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:11.081369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fadd273e-d1dc-459f-b7ae-6dcda1ec9e55 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:11.081824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fadd273e-d1dc-459f-b7ae-6dcda1ec9e55 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:11.082647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fadd273e-d1dc-459f-b7ae-6dcda1ec9e55 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:11.083090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fadd273e-d1dc-459f-b7ae-6dcda1ec9e55 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:11.099927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-14e4362f-5d5e-41f5-b4f0-be8b89fadc6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051075 Aug 01 15:41:11.100649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 462/1007] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:11 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:11.229598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fadd273e-d1dc-459f-b7ae-6dcda1ec9e55 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:11.237412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fadd273e-d1dc-459f-b7ae-6dcda1ec9e55 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.167631 Aug 01 15:41:11.237990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 546/1008] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:11 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:11.917811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c69e927b-3c13-41d9-8172-977e175dc4d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:11.920060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c69e927b-3c13-41d9-8172-977e175dc4d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:11.928106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c69e927b-3c13-41d9-8172-977e175dc4d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:11.928606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c69e927b-3c13-41d9-8172-977e175dc4d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:11.929575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c69e927b-3c13-41d9-8172-977e175dc4d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:11.930203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c69e927b-3c13-41d9-8172-977e175dc4d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:11.961161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c69e927b-3c13-41d9-8172-977e175dc4d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047188 Aug 01 15:41:11.961630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 463/1009] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:11 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:12.112528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1d44bd8e-85cd-4cea-94fb-c00827f14d4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:12.115476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1d44bd8e-85cd-4cea-94fb-c00827f14d4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:12.122787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d44bd8e-85cd-4cea-94fb-c00827f14d4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:12.123266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d44bd8e-85cd-4cea-94fb-c00827f14d4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:12.124104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d44bd8e-85cd-4cea-94fb-c00827f14d4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:12.124472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d44bd8e-85cd-4cea-94fb-c00827f14d4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:12.141660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:12.156267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1d44bd8e-85cd-4cea-94fb-c00827f14d4c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048151 Aug 01 15:41:12.161381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 547/1010] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:12 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:12.258777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-195fdcf4-7fa6-4859-9500-7e97632a30a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:12.259392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-195fdcf4-7fa6-4859-9500-7e97632a30a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:12.266174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-195fdcf4-7fa6-4859-9500-7e97632a30a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:12.266627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-195fdcf4-7fa6-4859-9500-7e97632a30a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:12.267401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-195fdcf4-7fa6-4859-9500-7e97632a30a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:12.267844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-195fdcf4-7fa6-4859-9500-7e97632a30a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:12.403473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-195fdcf4-7fa6-4859-9500-7e97632a30a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:12.411675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-195fdcf4-7fa6-4859-9500-7e97632a30a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156688 Aug 01 15:41:12.412237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 464/1011] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:12 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:12.973434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-524ef3e0-7ff0-4fcb-96b8-84d9825c16c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:12.975595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-524ef3e0-7ff0-4fcb-96b8-84d9825c16c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:12.981588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-524ef3e0-7ff0-4fcb-96b8-84d9825c16c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:12.982068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-524ef3e0-7ff0-4fcb-96b8-84d9825c16c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:12.982815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-524ef3e0-7ff0-4fcb-96b8-84d9825c16c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:12.983274 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-524ef3e0-7ff0-4fcb-96b8-84d9825c16c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:13.011746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-524ef3e0-7ff0-4fcb-96b8-84d9825c16c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042428 Aug 01 15:41:13.012295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 548/1012] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:13.169092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ca97cdcb-7ced-4f49-86ab-e6ef4a0cba0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:13.171388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ca97cdcb-7ced-4f49-86ab-e6ef4a0cba0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:13.178260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ca97cdcb-7ced-4f49-86ab-e6ef4a0cba0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:13.178641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ca97cdcb-7ced-4f49-86ab-e6ef4a0cba0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:13.179449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ca97cdcb-7ced-4f49-86ab-e6ef4a0cba0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:13.179888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ca97cdcb-7ced-4f49-86ab-e6ef4a0cba0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:13.210535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ca97cdcb-7ced-4f49-86ab-e6ef4a0cba0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045370 Aug 01 15:41:13.211376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 465/1013] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:13 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:13.433112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c78a4ea7-6b03-4535-83f3-c5bc854216d5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:13.433845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c78a4ea7-6b03-4535-83f3-c5bc854216d5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:13.440346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c78a4ea7-6b03-4535-83f3-c5bc854216d5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:13.440798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c78a4ea7-6b03-4535-83f3-c5bc854216d5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:13.441556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c78a4ea7-6b03-4535-83f3-c5bc854216d5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:13.442025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c78a4ea7-6b03-4535-83f3-c5bc854216d5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:13.573024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c78a4ea7-6b03-4535-83f3-c5bc854216d5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:13.580578 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c78a4ea7-6b03-4535-83f3-c5bc854216d5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151295 Aug 01 15:41:13.581140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 549/1014] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:13 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:14.024034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9aaafa30-4df1-43ac-8509-c0e2c8891fad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:14.026187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9aaafa30-4df1-43ac-8509-c0e2c8891fad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:14.032721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aaafa30-4df1-43ac-8509-c0e2c8891fad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:14.033175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aaafa30-4df1-43ac-8509-c0e2c8891fad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:14.033975 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aaafa30-4df1-43ac-8509-c0e2c8891fad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:14.034407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aaafa30-4df1-43ac-8509-c0e2c8891fad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:14.064358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9aaafa30-4df1-43ac-8509-c0e2c8891fad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044158 Aug 01 15:41:14.064827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 466/1015] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:14.229540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4b1cac54-4866-4fbc-a1e1-6e951085d40e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:14.231717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4b1cac54-4866-4fbc-a1e1-6e951085d40e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:14.238620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b1cac54-4866-4fbc-a1e1-6e951085d40e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:14.239074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b1cac54-4866-4fbc-a1e1-6e951085d40e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:14.239852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b1cac54-4866-4fbc-a1e1-6e951085d40e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:14.240284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b1cac54-4866-4fbc-a1e1-6e951085d40e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:14.281096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4b1cac54-4866-4fbc-a1e1-6e951085d40e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055386 Aug 01 15:41:14.282088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 550/1016] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:14 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:14.601968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e9c1a97d-3b98-4551-a726-aef1327361fd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:14.602511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e9c1a97d-3b98-4551-a726-aef1327361fd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:14.608833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e9c1a97d-3b98-4551-a726-aef1327361fd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:14.609283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e9c1a97d-3b98-4551-a726-aef1327361fd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:14.610100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e9c1a97d-3b98-4551-a726-aef1327361fd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:14.610534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e9c1a97d-3b98-4551-a726-aef1327361fd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:14.750243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e9c1a97d-3b98-4551-a726-aef1327361fd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:14.758514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e9c1a97d-3b98-4551-a726-aef1327361fd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.160524 Aug 01 15:41:14.759066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 467/1017] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:14 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:15.076798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-db214a45-9ac3-4919-b0d6-1000193cc29d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:15.078963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-db214a45-9ac3-4919-b0d6-1000193cc29d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:15.085416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db214a45-9ac3-4919-b0d6-1000193cc29d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:15.085859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db214a45-9ac3-4919-b0d6-1000193cc29d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:15.086647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db214a45-9ac3-4919-b0d6-1000193cc29d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:15.087075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db214a45-9ac3-4919-b0d6-1000193cc29d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:15.115885 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-db214a45-9ac3-4919-b0d6-1000193cc29d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042947 Aug 01 15:41:15.116350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 551/1018] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:15.292965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e60e6a87-0799-4602-95e5-d4fea9dc23bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:15.295631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e60e6a87-0799-4602-95e5-d4fea9dc23bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:15.304279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e60e6a87-0799-4602-95e5-d4fea9dc23bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:15.304736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e60e6a87-0799-4602-95e5-d4fea9dc23bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:15.305526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e60e6a87-0799-4602-95e5-d4fea9dc23bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:15.305993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e60e6a87-0799-4602-95e5-d4fea9dc23bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:15.335961 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e60e6a87-0799-4602-95e5-d4fea9dc23bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046904 Aug 01 15:41:15.336734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 468/1019] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:15 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:15.780530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8b0409cd-1c07-44ad-94e3-7642fadb327b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:15.781069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8b0409cd-1c07-44ad-94e3-7642fadb327b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:15.788067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b0409cd-1c07-44ad-94e3-7642fadb327b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:15.788515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b0409cd-1c07-44ad-94e3-7642fadb327b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:15.789282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b0409cd-1c07-44ad-94e3-7642fadb327b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:15.789712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b0409cd-1c07-44ad-94e3-7642fadb327b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:15.925402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8b0409cd-1c07-44ad-94e3-7642fadb327b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:15.942429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8b0409cd-1c07-44ad-94e3-7642fadb327b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.165907 Aug 01 15:41:15.943238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 552/1020] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:15 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:16.128334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4d099da3-7d38-4249-9e88-9104583a3542 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:16.131012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4d099da3-7d38-4249-9e88-9104583a3542 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:16.137542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d099da3-7d38-4249-9e88-9104583a3542 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:16.138017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d099da3-7d38-4249-9e88-9104583a3542 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:16.138791 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d099da3-7d38-4249-9e88-9104583a3542 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:16.139225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d099da3-7d38-4249-9e88-9104583a3542 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:16.168221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4d099da3-7d38-4249-9e88-9104583a3542 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044016 Aug 01 15:41:16.168768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 469/1021] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:16 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:16.347954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a8c9b51d-39d1-4233-b374-b245e61c4ba2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:16.350204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a8c9b51d-39d1-4233-b374-b245e61c4ba2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:16.356552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a8c9b51d-39d1-4233-b374-b245e61c4ba2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:16.357078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a8c9b51d-39d1-4233-b374-b245e61c4ba2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:16.358054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a8c9b51d-39d1-4233-b374-b245e61c4ba2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:16.358610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a8c9b51d-39d1-4233-b374-b245e61c4ba2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:16.394020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a8c9b51d-39d1-4233-b374-b245e61c4ba2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049982 Aug 01 15:41:16.399614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 553/1022] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:16 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:16.964698 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2e9087e1-e389-45fe-8fae-0d8e8b26bb64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:16.965225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2e9087e1-e389-45fe-8fae-0d8e8b26bb64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:16.972068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e9087e1-e389-45fe-8fae-0d8e8b26bb64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:16.972568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e9087e1-e389-45fe-8fae-0d8e8b26bb64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:16.973287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e9087e1-e389-45fe-8fae-0d8e8b26bb64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:16.974290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e9087e1-e389-45fe-8fae-0d8e8b26bb64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:17.106895 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2e9087e1-e389-45fe-8fae-0d8e8b26bb64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:17.115183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2e9087e1-e389-45fe-8fae-0d8e8b26bb64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154514 Aug 01 15:41:17.115748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 470/1023] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:16 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:17.180981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cf7c390a-557f-4dc9-a051-6ac8ede75430 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:17.183137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cf7c390a-557f-4dc9-a051-6ac8ede75430 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:17.189641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf7c390a-557f-4dc9-a051-6ac8ede75430 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:17.190218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf7c390a-557f-4dc9-a051-6ac8ede75430 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:17.190977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf7c390a-557f-4dc9-a051-6ac8ede75430 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:17.191414 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf7c390a-557f-4dc9-a051-6ac8ede75430 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:17.220719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cf7c390a-557f-4dc9-a051-6ac8ede75430 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044278 Aug 01 15:41:17.221196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 554/1024] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:17.407083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d02fddcc-a8ae-4359-b836-905f319a55af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:17.409282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d02fddcc-a8ae-4359-b836-905f319a55af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:17.416275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d02fddcc-a8ae-4359-b836-905f319a55af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:17.416597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d02fddcc-a8ae-4359-b836-905f319a55af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:17.417372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d02fddcc-a8ae-4359-b836-905f319a55af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:17.417810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d02fddcc-a8ae-4359-b836-905f319a55af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:17.448290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d02fddcc-a8ae-4359-b836-905f319a55af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045135 Aug 01 15:41:17.448856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 471/1025] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:17 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:18.136712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5a6529fe-1f84-4e7c-8c2c-893ba88db4d8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:18.137330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5a6529fe-1f84-4e7c-8c2c-893ba88db4d8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:18.143408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a6529fe-1f84-4e7c-8c2c-893ba88db4d8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:18.143859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a6529fe-1f84-4e7c-8c2c-893ba88db4d8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:18.144627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a6529fe-1f84-4e7c-8c2c-893ba88db4d8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:18.145062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a6529fe-1f84-4e7c-8c2c-893ba88db4d8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:18.233909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-72f12763-3259-47ba-8e59-45ad3a81aa2c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:18.236258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-72f12763-3259-47ba-8e59-45ad3a81aa2c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:18.243373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72f12763-3259-47ba-8e59-45ad3a81aa2c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:18.243820 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72f12763-3259-47ba-8e59-45ad3a81aa2c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:18.244597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72f12763-3259-47ba-8e59-45ad3a81aa2c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:18.245030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72f12763-3259-47ba-8e59-45ad3a81aa2c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:18.275380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-72f12763-3259-47ba-8e59-45ad3a81aa2c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045344 Aug 01 15:41:18.275951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 472/1026] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:41:18.280084 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5a6529fe-1f84-4e7c-8c2c-893ba88db4d8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:18.288317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5a6529fe-1f84-4e7c-8c2c-893ba88db4d8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155392 Aug 01 15:41:18.288885 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 555/1027] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:18 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:18.460686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-564482d5-5945-45fd-ab85-1f1f43367270 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:18.462906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-564482d5-5945-45fd-ab85-1f1f43367270 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:18.469174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-564482d5-5945-45fd-ab85-1f1f43367270 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:18.469620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-564482d5-5945-45fd-ab85-1f1f43367270 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:18.470415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-564482d5-5945-45fd-ab85-1f1f43367270 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:18.470852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-564482d5-5945-45fd-ab85-1f1f43367270 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:18.473229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:18.502316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-564482d5-5945-45fd-ab85-1f1f43367270 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045477 Aug 01 15:41:18.502886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 473/1028] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:18 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:19.287710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-997223f2-6d8a-41f7-b886-a09ff4e93d0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:19.289867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-997223f2-6d8a-41f7-b886-a09ff4e93d0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:19.296433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-997223f2-6d8a-41f7-b886-a09ff4e93d0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:19.296871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-997223f2-6d8a-41f7-b886-a09ff4e93d0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:19.297653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-997223f2-6d8a-41f7-b886-a09ff4e93d0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:19.298114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-997223f2-6d8a-41f7-b886-a09ff4e93d0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:19.311172 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0e14f080-5e4a-4f33-9cb6-221e8a58f18d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:19.311705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0e14f080-5e4a-4f33-9cb6-221e8a58f18d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:19.318305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e14f080-5e4a-4f33-9cb6-221e8a58f18d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:19.318746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e14f080-5e4a-4f33-9cb6-221e8a58f18d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:19.319532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e14f080-5e4a-4f33-9cb6-221e8a58f18d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:19.319950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e14f080-5e4a-4f33-9cb6-221e8a58f18d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:19.328467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-997223f2-6d8a-41f7-b886-a09ff4e93d0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044684 Aug 01 15:41:19.329015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 556/1029] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:19.452278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0e14f080-5e4a-4f33-9cb6-221e8a58f18d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:19.459777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0e14f080-5e4a-4f33-9cb6-221e8a58f18d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152525 Aug 01 15:41:19.460337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 474/1030] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:19 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:41:19.514762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-da063e78-a690-4337-8bed-056323a312b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:19.516958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-da063e78-a690-4337-8bed-056323a312b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:19.522995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da063e78-a690-4337-8bed-056323a312b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:19.523448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da063e78-a690-4337-8bed-056323a312b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:19.524209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da063e78-a690-4337-8bed-056323a312b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:19.524648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da063e78-a690-4337-8bed-056323a312b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:19.555866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-da063e78-a690-4337-8bed-056323a312b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044986 Aug 01 15:41:19.556494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 557/1031] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:19 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:20.341671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-266d2c63-0690-461c-b69c-2c8fb8b50527 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:20.344033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-266d2c63-0690-461c-b69c-2c8fb8b50527 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:20.346459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=72 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:20.352705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-266d2c63-0690-461c-b69c-2c8fb8b50527 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:20.353218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-266d2c63-0690-461c-b69c-2c8fb8b50527 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:20.354037 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-266d2c63-0690-461c-b69c-2c8fb8b50527 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:20.354477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-266d2c63-0690-461c-b69c-2c8fb8b50527 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:20.387403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-266d2c63-0690-461c-b69c-2c8fb8b50527 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049839 Aug 01 15:41:20.387987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 475/1032] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:41:20.481942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-db190761-76b5-41ad-b43c-c81b7daba459 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:20.482537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-db190761-76b5-41ad-b43c-c81b7daba459 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:20.489264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db190761-76b5-41ad-b43c-c81b7daba459 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:20.489704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db190761-76b5-41ad-b43c-c81b7daba459 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:20.490499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db190761-76b5-41ad-b43c-c81b7daba459 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:20.490927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db190761-76b5-41ad-b43c-c81b7daba459 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:20.568729 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bc2b6f8d-5783-45f9-b821-afe1198b0e3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:20.571461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bc2b6f8d-5783-45f9-b821-afe1198b0e3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:20.577343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc2b6f8d-5783-45f9-b821-afe1198b0e3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:20.577795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc2b6f8d-5783-45f9-b821-afe1198b0e3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:20.578618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc2b6f8d-5783-45f9-b821-afe1198b0e3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:20.579057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc2b6f8d-5783-45f9-b821-afe1198b0e3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:20.609612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bc2b6f8d-5783-45f9-b821-afe1198b0e3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045237 Aug 01 15:41:20.610124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 476/1033] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:20 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:41:20.630629 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-db190761-76b5-41ad-b43c-c81b7daba459 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:20.638327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-db190761-76b5-41ad-b43c-c81b7daba459 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.160343 Aug 01 15:41:20.638932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 558/1034] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:20 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:20.913161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:41:20.913432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:41:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:41:21.400977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1734df73-13d8-49ba-a42e-79c71f67df3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:21.403251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1734df73-13d8-49ba-a42e-79c71f67df3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:21.410081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1734df73-13d8-49ba-a42e-79c71f67df3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:21.410540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1734df73-13d8-49ba-a42e-79c71f67df3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:21.412434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1734df73-13d8-49ba-a42e-79c71f67df3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:21.412879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1734df73-13d8-49ba-a42e-79c71f67df3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:21.444314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1734df73-13d8-49ba-a42e-79c71f67df3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047337 Aug 01 15:41:21.444902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 477/1035] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:21.622063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b412f57f-57c4-4cf2-b4c1-f9dff478d851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:21.624205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b412f57f-57c4-4cf2-b4c1-f9dff478d851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:21.631447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b412f57f-57c4-4cf2-b4c1-f9dff478d851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:21.631899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b412f57f-57c4-4cf2-b4c1-f9dff478d851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:21.632669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b412f57f-57c4-4cf2-b4c1-f9dff478d851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:21.633110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b412f57f-57c4-4cf2-b4c1-f9dff478d851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:21.662907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b412f57f-57c4-4cf2-b4c1-f9dff478d851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044807 Aug 01 15:41:21.663484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 559/1036] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:21 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:21.765913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a819a623-62bd-400c-aa8e-809323b3cf22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:21.766568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a819a623-62bd-400c-aa8e-809323b3cf22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:21.773102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a819a623-62bd-400c-aa8e-809323b3cf22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:21.773540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a819a623-62bd-400c-aa8e-809323b3cf22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:21.774341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a819a623-62bd-400c-aa8e-809323b3cf22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:21.774769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a819a623-62bd-400c-aa8e-809323b3cf22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:21.912089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a819a623-62bd-400c-aa8e-809323b3cf22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:21.920354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a819a623-62bd-400c-aa8e-809323b3cf22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.263725 Aug 01 15:41:21.920899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 478/1037] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:21 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:41:22.456956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-91c5ca9a-ec82-4ec3-a4df-26dc23073399 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:22.460028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-91c5ca9a-ec82-4ec3-a4df-26dc23073399 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:22.466315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91c5ca9a-ec82-4ec3-a4df-26dc23073399 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:22.466770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91c5ca9a-ec82-4ec3-a4df-26dc23073399 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:22.467537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91c5ca9a-ec82-4ec3-a4df-26dc23073399 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:22.468230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91c5ca9a-ec82-4ec3-a4df-26dc23073399 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:22.497482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-91c5ca9a-ec82-4ec3-a4df-26dc23073399 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044472 Aug 01 15:41:22.498063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 560/1038] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:22 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:22.675330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a51aac09-d264-48d4-a7e7-2fa50bf220ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:22.677629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a51aac09-d264-48d4-a7e7-2fa50bf220ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:22.684275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a51aac09-d264-48d4-a7e7-2fa50bf220ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:22.684725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a51aac09-d264-48d4-a7e7-2fa50bf220ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:22.685663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a51aac09-d264-48d4-a7e7-2fa50bf220ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:22.686003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a51aac09-d264-48d4-a7e7-2fa50bf220ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:22.714913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a51aac09-d264-48d4-a7e7-2fa50bf220ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Aug 01 15:41:22.715461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 479/1039] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:22 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:22.943132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d9639a9f-026a-4ae2-b0ea-f0a4fb0ee698 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:22.943681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d9639a9f-026a-4ae2-b0ea-f0a4fb0ee698 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:22.950188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9639a9f-026a-4ae2-b0ea-f0a4fb0ee698 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:22.950642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9639a9f-026a-4ae2-b0ea-f0a4fb0ee698 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:22.951409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9639a9f-026a-4ae2-b0ea-f0a4fb0ee698 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:22.951845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9639a9f-026a-4ae2-b0ea-f0a4fb0ee698 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:23.071544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-ea8c59ae-1441-4064-82ba-6a42febfa1b5 req-141d92fd-a1c9-4356-93db-66ae699857ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f0755f-45c5-4c98-96b7-9c4b6415d331", "name": "network-vif-unplugged", "status": "completed", "tag": "6c507929-7001-4435-a0b5-2d19c503a391"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:41:23.081963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-ea8c59ae-1441-4064-82ba-6a42febfa1b5 req-141d92fd-a1c9-4356-93db-66ae699857ac service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:23.082450 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-ea8c59ae-1441-4064-82ba-6a42febfa1b5 req-141d92fd-a1c9-4356-93db-66ae699857ac service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:23.091582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d9639a9f-026a-4ae2-b0ea-f0a4fb0ee698 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:23.096120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-ea8c59ae-1441-4064-82ba-6a42febfa1b5 req-141d92fd-a1c9-4356-93db-66ae699857ac service nova] Creating event network-vif-unplugged:6c507929-7001-4435-a0b5-2d19c503a391 for instance 58f0755f-45c5-4c98-96b7-9c4b6415d331 on hv-cinder-84753 Aug 01 15:41:23.100554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d9639a9f-026a-4ae2-b0ea-f0a4fb0ee698 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.162241 Aug 01 15:41:23.101133 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 561/1040] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:22 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:23.102496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-ea8c59ae-1441-4064-82ba-6a42febfa1b5 req-141d92fd-a1c9-4356-93db-66ae699857ac service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101886 Aug 01 15:41:23.103092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 480/1041] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:41:23.510312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8f38749a-9bd5-4673-8dd9-8c9b3a458d95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:23.512442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8f38749a-9bd5-4673-8dd9-8c9b3a458d95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:23.518521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f38749a-9bd5-4673-8dd9-8c9b3a458d95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:23.518964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f38749a-9bd5-4673-8dd9-8c9b3a458d95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:23.519733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f38749a-9bd5-4673-8dd9-8c9b3a458d95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:23.520167 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f38749a-9bd5-4673-8dd9-8c9b3a458d95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:23.549539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8f38749a-9bd5-4673-8dd9-8c9b3a458d95 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043161 Aug 01 15:41:23.550193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 562/1042] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:23.729960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f85c1e17-fab6-4379-ab44-dbb3d7adc31c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:23.732258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f85c1e17-fab6-4379-ab44-dbb3d7adc31c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:23.738507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f85c1e17-fab6-4379-ab44-dbb3d7adc31c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:23.739544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f85c1e17-fab6-4379-ab44-dbb3d7adc31c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:23.740382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f85c1e17-fab6-4379-ab44-dbb3d7adc31c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:23.740814 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f85c1e17-fab6-4379-ab44-dbb3d7adc31c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:23.770000 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f85c1e17-fab6-4379-ab44-dbb3d7adc31c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045566 Aug 01 15:41:23.770475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 481/1043] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:23 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:24.122100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c1cc166e-b97c-41cd-b6c8-b70e3ee792ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:24.122721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c1cc166e-b97c-41cd-b6c8-b70e3ee792ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:24.129271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1cc166e-b97c-41cd-b6c8-b70e3ee792ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:24.129753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1cc166e-b97c-41cd-b6c8-b70e3ee792ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:24.130546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1cc166e-b97c-41cd-b6c8-b70e3ee792ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:24.130983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1cc166e-b97c-41cd-b6c8-b70e3ee792ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:24.263957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c1cc166e-b97c-41cd-b6c8-b70e3ee792ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:24.272086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c1cc166e-b97c-41cd-b6c8-b70e3ee792ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153950 Aug 01 15:41:24.272654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 563/1044] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:24 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:24.562800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-08a574e8-87ce-496d-a9e4-abf0a4f4d105 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:24.564992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-08a574e8-87ce-496d-a9e4-abf0a4f4d105 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:24.571136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08a574e8-87ce-496d-a9e4-abf0a4f4d105 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:24.571584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08a574e8-87ce-496d-a9e4-abf0a4f4d105 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:24.572347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08a574e8-87ce-496d-a9e4-abf0a4f4d105 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:24.572781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08a574e8-87ce-496d-a9e4-abf0a4f4d105 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:24.602363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-08a574e8-87ce-496d-a9e4-abf0a4f4d105 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043486 Aug 01 15:41:24.602920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 482/1045] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:41:24.785418 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-285f0f95-cd79-4a14-9266-31e1f8c328ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:24.788210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-285f0f95-cd79-4a14-9266-31e1f8c328ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:24.794459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-285f0f95-cd79-4a14-9266-31e1f8c328ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:24.794902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-285f0f95-cd79-4a14-9266-31e1f8c328ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:24.795722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-285f0f95-cd79-4a14-9266-31e1f8c328ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:24.796149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-285f0f95-cd79-4a14-9266-31e1f8c328ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:24.799963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:24.826334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-285f0f95-cd79-4a14-9266-31e1f8c328ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Aug 01 15:41:24.826804 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 564/1046] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:24 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:25.293297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4dd17888-1fa0-422a-b052-e09ee168d8c5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:25.293931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4dd17888-1fa0-422a-b052-e09ee168d8c5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:25.300576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4dd17888-1fa0-422a-b052-e09ee168d8c5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:25.301020 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4dd17888-1fa0-422a-b052-e09ee168d8c5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:25.302408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4dd17888-1fa0-422a-b052-e09ee168d8c5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:25.302829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4dd17888-1fa0-422a-b052-e09ee168d8c5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:25.437948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4dd17888-1fa0-422a-b052-e09ee168d8c5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:25.445573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4dd17888-1fa0-422a-b052-e09ee168d8c5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156094 Aug 01 15:41:25.446171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 483/1047] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:25 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:25.614721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-af2a15bf-40ab-4074-9ac8-e3ac6d63bc15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:25.616852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-af2a15bf-40ab-4074-9ac8-e3ac6d63bc15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:25.623363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af2a15bf-40ab-4074-9ac8-e3ac6d63bc15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:25.623814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af2a15bf-40ab-4074-9ac8-e3ac6d63bc15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:25.624576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af2a15bf-40ab-4074-9ac8-e3ac6d63bc15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:25.625013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af2a15bf-40ab-4074-9ac8-e3ac6d63bc15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:25.653978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-af2a15bf-40ab-4074-9ac8-e3ac6d63bc15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043186 Aug 01 15:41:25.654526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 565/1048] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:25 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:25.837995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-53f8860b-cb8a-4d3c-9631-13672f570032 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:25.840148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-53f8860b-cb8a-4d3c-9631-13672f570032 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:25.846746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53f8860b-cb8a-4d3c-9631-13672f570032 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:25.847196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53f8860b-cb8a-4d3c-9631-13672f570032 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:25.847961 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53f8860b-cb8a-4d3c-9631-13672f570032 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:25.848916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53f8860b-cb8a-4d3c-9631-13672f570032 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:25.878197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-53f8860b-cb8a-4d3c-9631-13672f570032 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Aug 01 15:41:25.878670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 484/1049] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:25 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:26.467181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-66a1444a-3c57-4161-973f-e3d8df2f6ae0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:26.467803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-66a1444a-3c57-4161-973f-e3d8df2f6ae0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:26.474937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66a1444a-3c57-4161-973f-e3d8df2f6ae0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:26.475389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66a1444a-3c57-4161-973f-e3d8df2f6ae0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:26.476154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66a1444a-3c57-4161-973f-e3d8df2f6ae0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:26.476590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66a1444a-3c57-4161-973f-e3d8df2f6ae0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:26.608944 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-66a1444a-3c57-4161-973f-e3d8df2f6ae0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:26.616717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-66a1444a-3c57-4161-973f-e3d8df2f6ae0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153366 Aug 01 15:41:26.617307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 566/1050] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:26 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:26.666990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-70241872-9eb4-4511-9aaf-6536ec865ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:26.669072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-70241872-9eb4-4511-9aaf-6536ec865ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:26.675605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70241872-9eb4-4511-9aaf-6536ec865ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:26.676060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70241872-9eb4-4511-9aaf-6536ec865ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:26.676830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70241872-9eb4-4511-9aaf-6536ec865ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:26.677268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70241872-9eb4-4511-9aaf-6536ec865ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:26.706942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-70241872-9eb4-4511-9aaf-6536ec865ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044029 Aug 01 15:41:26.707499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 485/1051] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:26.890787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f0833c40-2164-445a-9046-1b40cf4a7fd5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:26.892934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f0833c40-2164-445a-9046-1b40cf4a7fd5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:26.900243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f0833c40-2164-445a-9046-1b40cf4a7fd5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:26.900692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f0833c40-2164-445a-9046-1b40cf4a7fd5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:26.901471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f0833c40-2164-445a-9046-1b40cf4a7fd5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:26.901929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f0833c40-2164-445a-9046-1b40cf4a7fd5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:26.931991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f0833c40-2164-445a-9046-1b40cf4a7fd5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045089 Aug 01 15:41:26.932570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 567/1052] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:26 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:27.638350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6c4e738f-be56-4ecc-93c6-73001e7df81a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:27.638991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6c4e738f-be56-4ecc-93c6-73001e7df81a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:27.645789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c4e738f-be56-4ecc-93c6-73001e7df81a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:27.646288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c4e738f-be56-4ecc-93c6-73001e7df81a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:27.647050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c4e738f-be56-4ecc-93c6-73001e7df81a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:27.647486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c4e738f-be56-4ecc-93c6-73001e7df81a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:27.719693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0617920d-1b2a-4974-bc58-797a59c9319b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:27.721956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0617920d-1b2a-4974-bc58-797a59c9319b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:27.728159 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0617920d-1b2a-4974-bc58-797a59c9319b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:27.728605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0617920d-1b2a-4974-bc58-797a59c9319b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:27.729402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0617920d-1b2a-4974-bc58-797a59c9319b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:27.729835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0617920d-1b2a-4974-bc58-797a59c9319b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:27.766373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0617920d-1b2a-4974-bc58-797a59c9319b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050389 Aug 01 15:41:27.767445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 568/1053] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:41:27.792451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6c4e738f-be56-4ecc-93c6-73001e7df81a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:27.799947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6c4e738f-be56-4ecc-93c6-73001e7df81a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.165453 Aug 01 15:41:27.800508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 486/1054] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:27 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:27.944566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3b805249-aa7b-4f9f-b6c0-7d87fc9fe733 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:27.946743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3b805249-aa7b-4f9f-b6c0-7d87fc9fe733 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:27.953259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3b805249-aa7b-4f9f-b6c0-7d87fc9fe733 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:27.953710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3b805249-aa7b-4f9f-b6c0-7d87fc9fe733 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:27.954515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3b805249-aa7b-4f9f-b6c0-7d87fc9fe733 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:27.954951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3b805249-aa7b-4f9f-b6c0-7d87fc9fe733 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:27.983603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3b805249-aa7b-4f9f-b6c0-7d87fc9fe733 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043676 Aug 01 15:41:27.984152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 569/1055] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:27 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:28.781985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-133f44a1-c735-428b-8fbb-5ebc413adf84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:28.784150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-133f44a1-c735-428b-8fbb-5ebc413adf84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:28.791412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-133f44a1-c735-428b-8fbb-5ebc413adf84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:28.791871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-133f44a1-c735-428b-8fbb-5ebc413adf84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:28.792637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-133f44a1-c735-428b-8fbb-5ebc413adf84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:28.793166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-133f44a1-c735-428b-8fbb-5ebc413adf84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:28.824585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6524e22e-8679-4f69-9957-e6ac5b7b1b68 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:28.825160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-133f44a1-c735-428b-8fbb-5ebc413adf84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046831 Aug 01 15:41:28.825312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6524e22e-8679-4f69-9957-e6ac5b7b1b68 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:28.825603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 487/1056] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:28.831418 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6524e22e-8679-4f69-9957-e6ac5b7b1b68 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:28.831873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6524e22e-8679-4f69-9957-e6ac5b7b1b68 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:28.833455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6524e22e-8679-4f69-9957-e6ac5b7b1b68 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:28.833920 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6524e22e-8679-4f69-9957-e6ac5b7b1b68 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:28.967033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6524e22e-8679-4f69-9957-e6ac5b7b1b68 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:28.974736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6524e22e-8679-4f69-9957-e6ac5b7b1b68 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154237 Aug 01 15:41:28.975289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 570/1057] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:28 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:41:28.995742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1bcc1712-03d7-4bea-aa8c-7a2c65a1c5d9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:28.997956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1bcc1712-03d7-4bea-aa8c-7a2c65a1c5d9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:29.003932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1bcc1712-03d7-4bea-aa8c-7a2c65a1c5d9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:29.004385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1bcc1712-03d7-4bea-aa8c-7a2c65a1c5d9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:29.005689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1bcc1712-03d7-4bea-aa8c-7a2c65a1c5d9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:29.006161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1bcc1712-03d7-4bea-aa8c-7a2c65a1c5d9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:29.035761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1bcc1712-03d7-4bea-aa8c-7a2c65a1c5d9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043874 Aug 01 15:41:29.036348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 488/1058] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:28 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:29.837255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-dcee8f27-808d-4328-a767-aa83990aec13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:29.839407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-dcee8f27-808d-4328-a767-aa83990aec13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:29.841371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=78 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:29.849306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dcee8f27-808d-4328-a767-aa83990aec13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:29.849999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dcee8f27-808d-4328-a767-aa83990aec13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:29.851139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dcee8f27-808d-4328-a767-aa83990aec13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:29.851573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dcee8f27-808d-4328-a767-aa83990aec13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:29.881292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-dcee8f27-808d-4328-a767-aa83990aec13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047989 Aug 01 15:41:29.881840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 571/1059] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:29.996251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0ac121a4-e422-4c74-a18f-c5b64b9a0405 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:29.996862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0ac121a4-e422-4c74-a18f-c5b64b9a0405 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:30.003563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0ac121a4-e422-4c74-a18f-c5b64b9a0405 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:30.004009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0ac121a4-e422-4c74-a18f-c5b64b9a0405 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:30.004779 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0ac121a4-e422-4c74-a18f-c5b64b9a0405 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:30.005217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0ac121a4-e422-4c74-a18f-c5b64b9a0405 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:30.048255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bd0bd8b6-7d6c-4398-be52-6de5dca57c52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:30.050464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bd0bd8b6-7d6c-4398-be52-6de5dca57c52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:30.057276 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd0bd8b6-7d6c-4398-be52-6de5dca57c52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:30.057728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd0bd8b6-7d6c-4398-be52-6de5dca57c52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:30.058524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd0bd8b6-7d6c-4398-be52-6de5dca57c52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:30.058957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd0bd8b6-7d6c-4398-be52-6de5dca57c52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:30.089585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bd0bd8b6-7d6c-4398-be52-6de5dca57c52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Aug 01 15:41:30.090199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 572/1060] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:41:30.140542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0ac121a4-e422-4c74-a18f-c5b64b9a0405 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:30.148967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0ac121a4-e422-4c74-a18f-c5b64b9a0405 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156647 Aug 01 15:41:30.149538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 489/1061] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:29 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:30.892968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-440632d7-1b7b-493a-84bf-e4142b6f94ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:30.895253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-440632d7-1b7b-493a-84bf-e4142b6f94ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:30.901497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-440632d7-1b7b-493a-84bf-e4142b6f94ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:30.901975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-440632d7-1b7b-493a-84bf-e4142b6f94ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:30.902760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-440632d7-1b7b-493a-84bf-e4142b6f94ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:30.903196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-440632d7-1b7b-493a-84bf-e4142b6f94ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:30.936473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-440632d7-1b7b-493a-84bf-e4142b6f94ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047375 Aug 01 15:41:30.937309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 573/1062] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:31.102680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cf834acc-f40a-4de4-abe4-e2f2e6840d20 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:31.104845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cf834acc-f40a-4de4-abe4-e2f2e6840d20 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:31.111534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf834acc-f40a-4de4-abe4-e2f2e6840d20 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:31.111988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf834acc-f40a-4de4-abe4-e2f2e6840d20 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:31.112764 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf834acc-f40a-4de4-abe4-e2f2e6840d20 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:31.113233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf834acc-f40a-4de4-abe4-e2f2e6840d20 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:31.128555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:31.146676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cf834acc-f40a-4de4-abe4-e2f2e6840d20 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048383 Aug 01 15:41:31.147144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 490/1063] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:31 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:31.175545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-70d57c2c-ae8c-475a-b486-fe738af3121d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:31.176150 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-70d57c2c-ae8c-475a-b486-fe738af3121d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:31.183413 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70d57c2c-ae8c-475a-b486-fe738af3121d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:31.183854 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70d57c2c-ae8c-475a-b486-fe738af3121d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:31.184603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70d57c2c-ae8c-475a-b486-fe738af3121d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:31.185033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70d57c2c-ae8c-475a-b486-fe738af3121d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:31.320487 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-70d57c2c-ae8c-475a-b486-fe738af3121d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:31.328937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-70d57c2c-ae8c-475a-b486-fe738af3121d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.157188 Aug 01 15:41:31.329497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 574/1064] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:31 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:31.952971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-84a5e752-a509-4683-9055-c439c2b49367 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:31.955146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-84a5e752-a509-4683-9055-c439c2b49367 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:31.963571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84a5e752-a509-4683-9055-c439c2b49367 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:31.964022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84a5e752-a509-4683-9055-c439c2b49367 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:31.964816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84a5e752-a509-4683-9055-c439c2b49367 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:31.965256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84a5e752-a509-4683-9055-c439c2b49367 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:31.998209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-84a5e752-a509-4683-9055-c439c2b49367 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052771 Aug 01 15:41:31.998786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 491/1065] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:32.158948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2dd33d7b-beb3-4b93-8672-19ac833ec06b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:32.161752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2dd33d7b-beb3-4b93-8672-19ac833ec06b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:32.167821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dd33d7b-beb3-4b93-8672-19ac833ec06b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:32.168271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dd33d7b-beb3-4b93-8672-19ac833ec06b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:32.169038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dd33d7b-beb3-4b93-8672-19ac833ec06b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:32.169473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dd33d7b-beb3-4b93-8672-19ac833ec06b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:32.199405 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2dd33d7b-beb3-4b93-8672-19ac833ec06b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Aug 01 15:41:32.199949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 575/1066] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:32 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:32.354350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9f1a3d69-f229-4a0c-8f7b-98d9f97ebe45 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:32.354910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9f1a3d69-f229-4a0c-8f7b-98d9f97ebe45 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:32.361414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9f1a3d69-f229-4a0c-8f7b-98d9f97ebe45 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:32.361863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9f1a3d69-f229-4a0c-8f7b-98d9f97ebe45 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:32.362659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9f1a3d69-f229-4a0c-8f7b-98d9f97ebe45 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:32.363098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9f1a3d69-f229-4a0c-8f7b-98d9f97ebe45 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:32.497404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9f1a3d69-f229-4a0c-8f7b-98d9f97ebe45 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:32.504878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9f1a3d69-f229-4a0c-8f7b-98d9f97ebe45 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154591 Aug 01 15:41:32.505488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 492/1067] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:32 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:33.011323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0506d3d5-dfa1-42f2-aa7c-41e08acb9f0b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:33.013529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0506d3d5-dfa1-42f2-aa7c-41e08acb9f0b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:33.019662 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0506d3d5-dfa1-42f2-aa7c-41e08acb9f0b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:33.020114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0506d3d5-dfa1-42f2-aa7c-41e08acb9f0b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:33.020911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0506d3d5-dfa1-42f2-aa7c-41e08acb9f0b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:33.021352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0506d3d5-dfa1-42f2-aa7c-41e08acb9f0b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:33.058141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0506d3d5-dfa1-42f2-aa7c-41e08acb9f0b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050640 Aug 01 15:41:33.058717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 576/1068] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:33.211660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f050fc00-a8fb-4400-9c51-4e821efebdf3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:33.213851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f050fc00-a8fb-4400-9c51-4e821efebdf3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:33.220257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f050fc00-a8fb-4400-9c51-4e821efebdf3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:33.220709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f050fc00-a8fb-4400-9c51-4e821efebdf3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:33.221484 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f050fc00-a8fb-4400-9c51-4e821efebdf3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:33.221962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f050fc00-a8fb-4400-9c51-4e821efebdf3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:33.250690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f050fc00-a8fb-4400-9c51-4e821efebdf3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043004 Aug 01 15:41:33.251244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 493/1069] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:33 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:33.526873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0b910876-eeb6-4603-a215-77144fca1bc0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:33.527494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0b910876-eeb6-4603-a215-77144fca1bc0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:33.534192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b910876-eeb6-4603-a215-77144fca1bc0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:33.534642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b910876-eeb6-4603-a215-77144fca1bc0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:33.535419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b910876-eeb6-4603-a215-77144fca1bc0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:33.535862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b910876-eeb6-4603-a215-77144fca1bc0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:33.670516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0b910876-eeb6-4603-a215-77144fca1bc0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:33.678584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0b910876-eeb6-4603-a215-77144fca1bc0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155700 Aug 01 15:41:33.679141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 577/1070] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:33 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:34.071118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-87d93f94-a212-4b09-94ff-e38f70716417 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:34.073267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-87d93f94-a212-4b09-94ff-e38f70716417 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:34.080567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87d93f94-a212-4b09-94ff-e38f70716417 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:34.081083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87d93f94-a212-4b09-94ff-e38f70716417 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:34.082134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87d93f94-a212-4b09-94ff-e38f70716417 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:34.082620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87d93f94-a212-4b09-94ff-e38f70716417 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:34.111997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-87d93f94-a212-4b09-94ff-e38f70716417 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045394 Aug 01 15:41:34.112548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 494/1071] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:34.263103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b94eba17-8c7f-4a80-b50d-2f51f85dd8bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:34.265193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b94eba17-8c7f-4a80-b50d-2f51f85dd8bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:34.271930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b94eba17-8c7f-4a80-b50d-2f51f85dd8bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:34.272375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b94eba17-8c7f-4a80-b50d-2f51f85dd8bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:34.273134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b94eba17-8c7f-4a80-b50d-2f51f85dd8bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:34.273569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b94eba17-8c7f-4a80-b50d-2f51f85dd8bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:34.303978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b94eba17-8c7f-4a80-b50d-2f51f85dd8bf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044912 Aug 01 15:41:34.304524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 578/1072] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:34 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:34.699833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-782ed96a-0bd2-43bf-9a73-ec0fe109ea7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:34.700451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-782ed96a-0bd2-43bf-9a73-ec0fe109ea7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:34.706565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-782ed96a-0bd2-43bf-9a73-ec0fe109ea7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:34.707017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-782ed96a-0bd2-43bf-9a73-ec0fe109ea7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:34.707786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-782ed96a-0bd2-43bf-9a73-ec0fe109ea7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:34.708230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-782ed96a-0bd2-43bf-9a73-ec0fe109ea7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:34.840288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-782ed96a-0bd2-43bf-9a73-ec0fe109ea7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:34.848053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-782ed96a-0bd2-43bf-9a73-ec0fe109ea7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152111 Aug 01 15:41:34.848613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 495/1073] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:34 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:35.124547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-42f5e01f-732f-4498-bcb9-7496161a2125 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:35.126958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-42f5e01f-732f-4498-bcb9-7496161a2125 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:35.133449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42f5e01f-732f-4498-bcb9-7496161a2125 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:35.133919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42f5e01f-732f-4498-bcb9-7496161a2125 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:35.134701 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42f5e01f-732f-4498-bcb9-7496161a2125 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:35.135149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42f5e01f-732f-4498-bcb9-7496161a2125 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:35.165371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-42f5e01f-732f-4498-bcb9-7496161a2125 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044767 Aug 01 15:41:35.165974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 579/1074] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:35.316261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-19583714-4320-4996-90a9-cecbac410dca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:35.318803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-19583714-4320-4996-90a9-cecbac410dca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:35.325880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19583714-4320-4996-90a9-cecbac410dca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:35.326360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19583714-4320-4996-90a9-cecbac410dca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:35.327136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19583714-4320-4996-90a9-cecbac410dca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:35.327577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19583714-4320-4996-90a9-cecbac410dca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:35.357816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-19583714-4320-4996-90a9-cecbac410dca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045980 Aug 01 15:41:35.358411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 496/1075] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:35 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:35.870520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5b4f0664-472b-4b11-b934-3f09732c7dfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:35.871256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5b4f0664-472b-4b11-b934-3f09732c7dfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:35.877671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b4f0664-472b-4b11-b934-3f09732c7dfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:35.878154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b4f0664-472b-4b11-b934-3f09732c7dfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:35.878935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b4f0664-472b-4b11-b934-3f09732c7dfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:35.879378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b4f0664-472b-4b11-b934-3f09732c7dfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:36.025088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5b4f0664-472b-4b11-b934-3f09732c7dfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:36.028539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:36.034118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5b4f0664-472b-4b11-b934-3f09732c7dfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.167459 Aug 01 15:41:36.034692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 580/1076] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:35 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:36.180017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5e2090c0-601a-4917-b00e-fc01c30d1cdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:36.183777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5e2090c0-601a-4917-b00e-fc01c30d1cdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:36.189965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e2090c0-601a-4917-b00e-fc01c30d1cdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:36.190423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e2090c0-601a-4917-b00e-fc01c30d1cdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:36.191199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e2090c0-601a-4917-b00e-fc01c30d1cdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:36.191639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e2090c0-601a-4917-b00e-fc01c30d1cdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:36.221931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5e2090c0-601a-4917-b00e-fc01c30d1cdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047878 Aug 01 15:41:36.222518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 497/1077] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:36.370644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0d2d9439-7148-4375-a39a-1e138744ac2b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:36.372796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0d2d9439-7148-4375-a39a-1e138744ac2b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:36.380732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d2d9439-7148-4375-a39a-1e138744ac2b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:36.381175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d2d9439-7148-4375-a39a-1e138744ac2b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:36.382000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d2d9439-7148-4375-a39a-1e138744ac2b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:36.382432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d2d9439-7148-4375-a39a-1e138744ac2b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:36.411218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0d2d9439-7148-4375-a39a-1e138744ac2b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044583 Aug 01 15:41:36.411821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 581/1078] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:36 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:37.056255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9bbc5434-a08b-4f4e-a98f-e4ce4b22a63e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:37.056876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9bbc5434-a08b-4f4e-a98f-e4ce4b22a63e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:37.064200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9bbc5434-a08b-4f4e-a98f-e4ce4b22a63e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:37.064643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9bbc5434-a08b-4f4e-a98f-e4ce4b22a63e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:37.065408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9bbc5434-a08b-4f4e-a98f-e4ce4b22a63e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:37.065836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9bbc5434-a08b-4f4e-a98f-e4ce4b22a63e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:37.196656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9bbc5434-a08b-4f4e-a98f-e4ce4b22a63e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:37.204062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9bbc5434-a08b-4f4e-a98f-e4ce4b22a63e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151682 Aug 01 15:41:37.204613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 498/1079] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:37 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:37.235703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-95bbdd98-1019-495d-a5ce-2eb08487cdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:37.237914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-95bbdd98-1019-495d-a5ce-2eb08487cdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:37.244789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95bbdd98-1019-495d-a5ce-2eb08487cdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:37.245234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95bbdd98-1019-495d-a5ce-2eb08487cdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:37.246034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95bbdd98-1019-495d-a5ce-2eb08487cdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:37.246472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95bbdd98-1019-495d-a5ce-2eb08487cdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:37.276372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-95bbdd98-1019-495d-a5ce-2eb08487cdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044843 Aug 01 15:41:37.276934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 582/1080] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:37.425077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1ef6538e-2910-4421-93e0-58c2b919bb86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:37.427315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1ef6538e-2910-4421-93e0-58c2b919bb86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:37.433405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ef6538e-2910-4421-93e0-58c2b919bb86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:37.433852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ef6538e-2910-4421-93e0-58c2b919bb86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:37.434657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ef6538e-2910-4421-93e0-58c2b919bb86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:37.435095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ef6538e-2910-4421-93e0-58c2b919bb86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:37.464231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1ef6538e-2910-4421-93e0-58c2b919bb86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043137 Aug 01 15:41:37.464787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 499/1081] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:37 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:38.225537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-757c31ae-7783-4a95-b6a0-21cb41e2c839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:38.226105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-757c31ae-7783-4a95-b6a0-21cb41e2c839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:38.232721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-757c31ae-7783-4a95-b6a0-21cb41e2c839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:38.233161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-757c31ae-7783-4a95-b6a0-21cb41e2c839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:38.233944 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-757c31ae-7783-4a95-b6a0-21cb41e2c839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:38.234380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-757c31ae-7783-4a95-b6a0-21cb41e2c839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:38.288807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a66b7dc6-677d-4976-b723-4ce7ef9e761b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:38.291173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a66b7dc6-677d-4976-b723-4ce7ef9e761b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:38.298047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a66b7dc6-677d-4976-b723-4ce7ef9e761b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:38.298579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a66b7dc6-677d-4976-b723-4ce7ef9e761b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:38.299356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a66b7dc6-677d-4976-b723-4ce7ef9e761b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:38.299791 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a66b7dc6-677d-4976-b723-4ce7ef9e761b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:38.331984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a66b7dc6-677d-4976-b723-4ce7ef9e761b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047154 Aug 01 15:41:38.332563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 500/1082] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:41:38.368331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-757c31ae-7783-4a95-b6a0-21cb41e2c839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:38.375814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-757c31ae-7783-4a95-b6a0-21cb41e2c839 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154271 Aug 01 15:41:38.376366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 583/1083] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:38 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:38.477022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-abc26095-8ec4-4c80-9fb9-c343e51df3b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:38.479155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-abc26095-8ec4-4c80-9fb9-c343e51df3b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:38.485235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abc26095-8ec4-4c80-9fb9-c343e51df3b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:38.485678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abc26095-8ec4-4c80-9fb9-c343e51df3b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:38.486475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abc26095-8ec4-4c80-9fb9-c343e51df3b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:38.486912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abc26095-8ec4-4c80-9fb9-c343e51df3b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:38.516284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-abc26095-8ec4-4c80-9fb9-c343e51df3b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Aug 01 15:41:38.516823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 501/1084] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:38 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:39.344793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0fbc9c34-687b-482e-bb31-0d144fb8679c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:39.347021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0fbc9c34-687b-482e-bb31-0d144fb8679c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:39.353524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0fbc9c34-687b-482e-bb31-0d144fb8679c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:39.354008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0fbc9c34-687b-482e-bb31-0d144fb8679c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:39.354778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0fbc9c34-687b-482e-bb31-0d144fb8679c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:39.355215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0fbc9c34-687b-482e-bb31-0d144fb8679c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:39.385155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0fbc9c34-687b-482e-bb31-0d144fb8679c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044671 Aug 01 15:41:39.385715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 584/1085] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:39.398218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-06ce669b-a5e2-42fa-a8fb-241dcd01c131 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:39.398749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-06ce669b-a5e2-42fa-a8fb-241dcd01c131 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:39.405064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06ce669b-a5e2-42fa-a8fb-241dcd01c131 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:39.405510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06ce669b-a5e2-42fa-a8fb-241dcd01c131 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:39.406309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06ce669b-a5e2-42fa-a8fb-241dcd01c131 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:39.406742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06ce669b-a5e2-42fa-a8fb-241dcd01c131 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:39.528731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1d3422c6-b8ab-4e7c-add6-48bb7884e851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:39.531212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1d3422c6-b8ab-4e7c-add6-48bb7884e851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:39.537344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d3422c6-b8ab-4e7c-add6-48bb7884e851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:39.537800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d3422c6-b8ab-4e7c-add6-48bb7884e851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:39.538620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d3422c6-b8ab-4e7c-add6-48bb7884e851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:39.538829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-06ce669b-a5e2-42fa-a8fb-241dcd01c131 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:39.539061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d3422c6-b8ab-4e7c-add6-48bb7884e851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:39.546640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-06ce669b-a5e2-42fa-a8fb-241dcd01c131 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153194 Aug 01 15:41:39.547206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 502/1086] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:39 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:39.569910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1d3422c6-b8ab-4e7c-add6-48bb7884e851 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045212 Aug 01 15:41:39.570459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 585/1087] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:39 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:41:40.397265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-84432a3b-6df5-4b43-94cc-a38736958c35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:40.399679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-84432a3b-6df5-4b43-94cc-a38736958c35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:40.406198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84432a3b-6df5-4b43-94cc-a38736958c35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:40.406654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84432a3b-6df5-4b43-94cc-a38736958c35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:40.407423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84432a3b-6df5-4b43-94cc-a38736958c35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:40.407861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84432a3b-6df5-4b43-94cc-a38736958c35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:40.437829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-84432a3b-6df5-4b43-94cc-a38736958c35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045059 Aug 01 15:41:40.438420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 503/1088] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:40.568138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6fc7a2de-2d38-4325-b5dc-d1e02f939072 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:40.568743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6fc7a2de-2d38-4325-b5dc-d1e02f939072 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:40.575424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6fc7a2de-2d38-4325-b5dc-d1e02f939072 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:40.575865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6fc7a2de-2d38-4325-b5dc-d1e02f939072 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:40.576685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6fc7a2de-2d38-4325-b5dc-d1e02f939072 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:40.577148 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6fc7a2de-2d38-4325-b5dc-d1e02f939072 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:40.582189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5b859107-7a0a-4bef-963c-ba8c229774df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:40.584925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5b859107-7a0a-4bef-963c-ba8c229774df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:40.591021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b859107-7a0a-4bef-963c-ba8c229774df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:40.591476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b859107-7a0a-4bef-963c-ba8c229774df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:40.592267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b859107-7a0a-4bef-963c-ba8c229774df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:40.592700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b859107-7a0a-4bef-963c-ba8c229774df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:40.623489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5b859107-7a0a-4bef-963c-ba8c229774df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Aug 01 15:41:40.624062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 504/1089] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:40 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:41:40.712060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6fc7a2de-2d38-4325-b5dc-d1e02f939072 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:40.719782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6fc7a2de-2d38-4325-b5dc-d1e02f939072 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155483 Aug 01 15:41:40.720330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 586/1090] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:40 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:41.450320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a111a866-ee85-4707-88df-30a9dafdb30c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:41.452489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a111a866-ee85-4707-88df-30a9dafdb30c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:41.459581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a111a866-ee85-4707-88df-30a9dafdb30c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:41.460041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a111a866-ee85-4707-88df-30a9dafdb30c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:41.460815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a111a866-ee85-4707-88df-30a9dafdb30c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:41.461252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a111a866-ee85-4707-88df-30a9dafdb30c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:41.491953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a111a866-ee85-4707-88df-30a9dafdb30c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045642 Aug 01 15:41:41.492643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 505/1091] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:41.637002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b5a59337-318d-48d5-bb27-ba70fdad39af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:41.639179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b5a59337-318d-48d5-bb27-ba70fdad39af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:41.646373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b5a59337-318d-48d5-bb27-ba70fdad39af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:41.646816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b5a59337-318d-48d5-bb27-ba70fdad39af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:41.647631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b5a59337-318d-48d5-bb27-ba70fdad39af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:41.648071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b5a59337-318d-48d5-bb27-ba70fdad39af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:41.676662 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b5a59337-318d-48d5-bb27-ba70fdad39af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043907 Aug 01 15:41:41.677215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 587/1092] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:41.740822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-53ec892e-f793-42c1-8961-7aa8d8212d32 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:41.741379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-53ec892e-f793-42c1-8961-7aa8d8212d32 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:41.747461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53ec892e-f793-42c1-8961-7aa8d8212d32 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:41.747917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53ec892e-f793-42c1-8961-7aa8d8212d32 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:41.748683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53ec892e-f793-42c1-8961-7aa8d8212d32 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:41.749123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53ec892e-f793-42c1-8961-7aa8d8212d32 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:41.882913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-53ec892e-f793-42c1-8961-7aa8d8212d32 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:41.890582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-53ec892e-f793-42c1-8961-7aa8d8212d32 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153768 Aug 01 15:41:41.891152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 506/1093] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:41 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:42.503633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-61685128-d187-4a91-a20b-f4c47308651d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:42.505755 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-61685128-d187-4a91-a20b-f4c47308651d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:42.511746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-61685128-d187-4a91-a20b-f4c47308651d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:42.512191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-61685128-d187-4a91-a20b-f4c47308651d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:42.512936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-61685128-d187-4a91-a20b-f4c47308651d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:42.513365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-61685128-d187-4a91-a20b-f4c47308651d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:42.544129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-61685128-d187-4a91-a20b-f4c47308651d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044461 Aug 01 15:41:42.545281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 588/1094] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:42 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:42.689510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e8de1b51-52b4-453d-bf05-fd4b055e1a1f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:42.691696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e8de1b51-52b4-453d-bf05-fd4b055e1a1f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:42.698753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8de1b51-52b4-453d-bf05-fd4b055e1a1f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:42.699200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8de1b51-52b4-453d-bf05-fd4b055e1a1f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:42.699970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8de1b51-52b4-453d-bf05-fd4b055e1a1f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:42.700404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8de1b51-52b4-453d-bf05-fd4b055e1a1f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:42.702801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:42.731349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e8de1b51-52b4-453d-bf05-fd4b055e1a1f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046122 Aug 01 15:41:42.731908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 507/1095] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:42 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:42.912124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f2e62218-c88b-4d1d-8945-79b3ae5dc216 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:42.913421 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f2e62218-c88b-4d1d-8945-79b3ae5dc216 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:42.919876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f2e62218-c88b-4d1d-8945-79b3ae5dc216 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:42.920328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f2e62218-c88b-4d1d-8945-79b3ae5dc216 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:42.921088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f2e62218-c88b-4d1d-8945-79b3ae5dc216 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:42.921531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f2e62218-c88b-4d1d-8945-79b3ae5dc216 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:43.051156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f2e62218-c88b-4d1d-8945-79b3ae5dc216 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:43.058807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f2e62218-c88b-4d1d-8945-79b3ae5dc216 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.150600 Aug 01 15:41:43.059378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 589/1096] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:42 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:43.557349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5a4544e4-0087-4291-987e-44d1a86f288f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:43.559575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5a4544e4-0087-4291-987e-44d1a86f288f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:43.565635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a4544e4-0087-4291-987e-44d1a86f288f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:43.566132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a4544e4-0087-4291-987e-44d1a86f288f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:43.566888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a4544e4-0087-4291-987e-44d1a86f288f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:43.567319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a4544e4-0087-4291-987e-44d1a86f288f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:43.596519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5a4544e4-0087-4291-987e-44d1a86f288f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043707 Aug 01 15:41:43.597069 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 508/1097] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:43.744374 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f1eecf31-dedf-47c2-bc9d-d8c2f1df25bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:43.746554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f1eecf31-dedf-47c2-bc9d-d8c2f1df25bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:43.752764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f1eecf31-dedf-47c2-bc9d-d8c2f1df25bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:43.753214 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f1eecf31-dedf-47c2-bc9d-d8c2f1df25bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:43.754007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f1eecf31-dedf-47c2-bc9d-d8c2f1df25bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:43.754448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f1eecf31-dedf-47c2-bc9d-d8c2f1df25bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:43.782771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f1eecf31-dedf-47c2-bc9d-d8c2f1df25bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042987 Aug 01 15:41:43.783324 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 590/1098] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:43 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:44.080593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dc40077b-7dd2-4d81-b06c-6813dfc61c5b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:44.081202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dc40077b-7dd2-4d81-b06c-6813dfc61c5b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:44.088177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc40077b-7dd2-4d81-b06c-6813dfc61c5b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:44.088619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc40077b-7dd2-4d81-b06c-6813dfc61c5b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:44.089371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc40077b-7dd2-4d81-b06c-6813dfc61c5b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:44.089797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc40077b-7dd2-4d81-b06c-6813dfc61c5b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:44.222977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dc40077b-7dd2-4d81-b06c-6813dfc61c5b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:44.231272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dc40077b-7dd2-4d81-b06c-6813dfc61c5b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154500 Aug 01 15:41:44.231838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 509/1099] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:44 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:44.608998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-73bed83b-0a92-4b78-a17b-3a7db9ff92a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:44.611122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-73bed83b-0a92-4b78-a17b-3a7db9ff92a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:44.617714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73bed83b-0a92-4b78-a17b-3a7db9ff92a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:44.618193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73bed83b-0a92-4b78-a17b-3a7db9ff92a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:44.618957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73bed83b-0a92-4b78-a17b-3a7db9ff92a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:44.619394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73bed83b-0a92-4b78-a17b-3a7db9ff92a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:44.647934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-73bed83b-0a92-4b78-a17b-3a7db9ff92a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042995 Aug 01 15:41:44.649147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 591/1100] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:44.794401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4158850e-bb58-4c8c-aa6c-ac8ec1ae7b11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:44.796844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4158850e-bb58-4c8c-aa6c-ac8ec1ae7b11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:44.803124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4158850e-bb58-4c8c-aa6c-ac8ec1ae7b11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:44.803573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4158850e-bb58-4c8c-aa6c-ac8ec1ae7b11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:44.804365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4158850e-bb58-4c8c-aa6c-ac8ec1ae7b11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:44.804781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4158850e-bb58-4c8c-aa6c-ac8ec1ae7b11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:44.834772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4158850e-bb58-4c8c-aa6c-ac8ec1ae7b11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Aug 01 15:41:44.835327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 510/1101] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:44 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:45.252730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b4cc84db-8f50-4123-b2c0-476a513320d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:45.253378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b4cc84db-8f50-4123-b2c0-476a513320d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:45.259464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4cc84db-8f50-4123-b2c0-476a513320d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:45.259911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4cc84db-8f50-4123-b2c0-476a513320d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:45.260769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4cc84db-8f50-4123-b2c0-476a513320d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:45.261206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4cc84db-8f50-4123-b2c0-476a513320d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:45.404058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b4cc84db-8f50-4123-b2c0-476a513320d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:45.411711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b4cc84db-8f50-4123-b2c0-476a513320d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.163008 Aug 01 15:41:45.412266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 592/1102] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:45 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:45.661106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ef37788c-dbc0-41f5-8165-76cd079ed6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:45.663306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ef37788c-dbc0-41f5-8165-76cd079ed6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:45.670497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef37788c-dbc0-41f5-8165-76cd079ed6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:45.670951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef37788c-dbc0-41f5-8165-76cd079ed6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:45.671718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef37788c-dbc0-41f5-8165-76cd079ed6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:45.672156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef37788c-dbc0-41f5-8165-76cd079ed6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:45.712719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ef37788c-dbc0-41f5-8165-76cd079ed6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055544 Aug 01 15:41:45.713317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 511/1103] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:45.848162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d35c8241-b0fc-4a6c-b25a-747a80cb98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:45.850372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d35c8241-b0fc-4a6c-b25a-747a80cb98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:45.857048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d35c8241-b0fc-4a6c-b25a-747a80cb98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:45.857502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d35c8241-b0fc-4a6c-b25a-747a80cb98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:45.858295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d35c8241-b0fc-4a6c-b25a-747a80cb98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:45.858738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d35c8241-b0fc-4a6c-b25a-747a80cb98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:45.888538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d35c8241-b0fc-4a6c-b25a-747a80cb98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044630 Aug 01 15:41:45.889098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 593/1104] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:45 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:46.433733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-984556be-ea12-4821-be83-80b9273c8203 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:46.434374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-984556be-ea12-4821-be83-80b9273c8203 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:46.440479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-984556be-ea12-4821-be83-80b9273c8203 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:46.440933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-984556be-ea12-4821-be83-80b9273c8203 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:46.441700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-984556be-ea12-4821-be83-80b9273c8203 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:46.442234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-984556be-ea12-4821-be83-80b9273c8203 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:46.575411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-984556be-ea12-4821-be83-80b9273c8203 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:46.582945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-984556be-ea12-4821-be83-80b9273c8203 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153575 Aug 01 15:41:46.583499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 512/1105] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:46 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:46.725685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f83f89f9-d004-4684-9742-c858dca2228c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:46.728350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f83f89f9-d004-4684-9742-c858dca2228c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:46.735209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f83f89f9-d004-4684-9742-c858dca2228c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:46.735657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f83f89f9-d004-4684-9742-c858dca2228c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:46.736432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f83f89f9-d004-4684-9742-c858dca2228c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:46.736891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f83f89f9-d004-4684-9742-c858dca2228c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:46.766015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f83f89f9-d004-4684-9742-c858dca2228c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044528 Aug 01 15:41:46.766573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 594/1106] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:46.901159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e34a8791-2bf0-4203-9689-f18a333394eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:46.903384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e34a8791-2bf0-4203-9689-f18a333394eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:46.910094 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e34a8791-2bf0-4203-9689-f18a333394eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:46.910584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e34a8791-2bf0-4203-9689-f18a333394eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:46.911356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e34a8791-2bf0-4203-9689-f18a333394eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:46.911818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e34a8791-2bf0-4203-9689-f18a333394eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:46.942758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e34a8791-2bf0-4203-9689-f18a333394eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045812 Aug 01 15:41:46.943342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 513/1107] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:46 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:47.604365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c4cb0e02-f007-4faa-989a-8c96b351805f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:47.605080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c4cb0e02-f007-4faa-989a-8c96b351805f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:47.611588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c4cb0e02-f007-4faa-989a-8c96b351805f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:47.612040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c4cb0e02-f007-4faa-989a-8c96b351805f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:47.612818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c4cb0e02-f007-4faa-989a-8c96b351805f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:47.613258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c4cb0e02-f007-4faa-989a-8c96b351805f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:47.746869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c4cb0e02-f007-4faa-989a-8c96b351805f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:47.754638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c4cb0e02-f007-4faa-989a-8c96b351805f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154155 Aug 01 15:41:47.755221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 595/1108] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:47 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:47.779180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-df8c7dbe-1d5d-4c86-b09d-870e4dfb53db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:47.781347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-df8c7dbe-1d5d-4c86-b09d-870e4dfb53db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:47.787880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df8c7dbe-1d5d-4c86-b09d-870e4dfb53db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:47.788335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df8c7dbe-1d5d-4c86-b09d-870e4dfb53db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:47.789142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df8c7dbe-1d5d-4c86-b09d-870e4dfb53db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:47.789578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df8c7dbe-1d5d-4c86-b09d-870e4dfb53db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:47.818324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-df8c7dbe-1d5d-4c86-b09d-870e4dfb53db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043114 Aug 01 15:41:47.818886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 514/1109] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:47.955158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-386d78bf-af40-493b-9d58-bf53ebe285e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:47.957357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-386d78bf-af40-493b-9d58-bf53ebe285e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:47.963951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-386d78bf-af40-493b-9d58-bf53ebe285e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:47.964396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-386d78bf-af40-493b-9d58-bf53ebe285e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:47.965653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-386d78bf-af40-493b-9d58-bf53ebe285e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:47.966480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-386d78bf-af40-493b-9d58-bf53ebe285e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:48.001129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-386d78bf-af40-493b-9d58-bf53ebe285e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049850 Aug 01 15:41:48.001910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 596/1110] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:47 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:48.779035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a8dd4200-79c3-4cb7-af11-e2bc0d0be5fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:48.779736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a8dd4200-79c3-4cb7-af11-e2bc0d0be5fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:48.786299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8dd4200-79c3-4cb7-af11-e2bc0d0be5fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:48.786752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8dd4200-79c3-4cb7-af11-e2bc0d0be5fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:48.787521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8dd4200-79c3-4cb7-af11-e2bc0d0be5fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:48.787965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8dd4200-79c3-4cb7-af11-e2bc0d0be5fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:48.831232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-128e4bf8-b671-49ad-93b8-93aac8cd027e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:48.833537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-128e4bf8-b671-49ad-93b8-93aac8cd027e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:48.840810 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-128e4bf8-b671-49ad-93b8-93aac8cd027e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:48.841260 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-128e4bf8-b671-49ad-93b8-93aac8cd027e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:48.842073 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-128e4bf8-b671-49ad-93b8-93aac8cd027e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:48.842509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-128e4bf8-b671-49ad-93b8-93aac8cd027e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:48.859938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:48.873331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-128e4bf8-b671-49ad-93b8-93aac8cd027e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046041 Aug 01 15:41:48.873911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 597/1111] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:41:48.929734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a8dd4200-79c3-4cb7-af11-e2bc0d0be5fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:48.937397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a8dd4200-79c3-4cb7-af11-e2bc0d0be5fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.162405 Aug 01 15:41:48.938177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 515/1112] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:48 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:49.014155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c81bdbf1-7f70-4b89-a154-7380c621c950 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:49.016305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c81bdbf1-7f70-4b89-a154-7380c621c950 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:49.022385 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c81bdbf1-7f70-4b89-a154-7380c621c950 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:49.022841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c81bdbf1-7f70-4b89-a154-7380c621c950 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:49.023628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c81bdbf1-7f70-4b89-a154-7380c621c950 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:49.024689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c81bdbf1-7f70-4b89-a154-7380c621c950 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:49.053390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c81bdbf1-7f70-4b89-a154-7380c621c950 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043122 Aug 01 15:41:49.053863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 598/1113] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:49.885727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1e508f0e-fb0d-4558-83ee-6e94aa22b2a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:49.887924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1e508f0e-fb0d-4558-83ee-6e94aa22b2a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:49.894067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e508f0e-fb0d-4558-83ee-6e94aa22b2a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:49.894513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e508f0e-fb0d-4558-83ee-6e94aa22b2a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:49.895271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e508f0e-fb0d-4558-83ee-6e94aa22b2a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:49.895708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e508f0e-fb0d-4558-83ee-6e94aa22b2a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:49.925917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1e508f0e-fb0d-4558-83ee-6e94aa22b2a4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044127 Aug 01 15:41:49.926480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 516/1114] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:49.959070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-782c6dde-94b2-4e82-9280-6f9569856d1b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:49.959747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-782c6dde-94b2-4e82-9280-6f9569856d1b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:49.966098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-782c6dde-94b2-4e82-9280-6f9569856d1b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:49.966729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-782c6dde-94b2-4e82-9280-6f9569856d1b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:49.967864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-782c6dde-94b2-4e82-9280-6f9569856d1b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:49.968793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-782c6dde-94b2-4e82-9280-6f9569856d1b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:50.069365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-60193997-c052-4dc0-92aa-7d6bd449c6f3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:50.071621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-60193997-c052-4dc0-92aa-7d6bd449c6f3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:50.077724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60193997-c052-4dc0-92aa-7d6bd449c6f3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:50.078233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60193997-c052-4dc0-92aa-7d6bd449c6f3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:50.079011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60193997-c052-4dc0-92aa-7d6bd449c6f3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:50.079453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60193997-c052-4dc0-92aa-7d6bd449c6f3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:50.110155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-782c6dde-94b2-4e82-9280-6f9569856d1b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:50.112044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-60193997-c052-4dc0-92aa-7d6bd449c6f3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046591 Aug 01 15:41:50.112803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 517/1115] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:50 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:50.117987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-782c6dde-94b2-4e82-9280-6f9569856d1b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.162930 Aug 01 15:41:50.118547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 599/1116] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:49 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:50.938838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6d7fb4bc-4aff-4c4e-a2eb-bdba4ce2599a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:50.940994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6d7fb4bc-4aff-4c4e-a2eb-bdba4ce2599a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:50.943334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=86 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:50.948662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6d7fb4bc-4aff-4c4e-a2eb-bdba4ce2599a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:50.949110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6d7fb4bc-4aff-4c4e-a2eb-bdba4ce2599a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:50.949874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6d7fb4bc-4aff-4c4e-a2eb-bdba4ce2599a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:50.950337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6d7fb4bc-4aff-4c4e-a2eb-bdba4ce2599a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:50.980581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6d7fb4bc-4aff-4c4e-a2eb-bdba4ce2599a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045695 Aug 01 15:41:50.981131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 518/1117] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:41:51.123678 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e35535c7-0a9f-4af7-97f9-6450397a02a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:51.125935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e35535c7-0a9f-4af7-97f9-6450397a02a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:51.132498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e35535c7-0a9f-4af7-97f9-6450397a02a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:51.132938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e35535c7-0a9f-4af7-97f9-6450397a02a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:51.133699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e35535c7-0a9f-4af7-97f9-6450397a02a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:51.134155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e35535c7-0a9f-4af7-97f9-6450397a02a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:51.138853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2d18b65a-1a8c-461c-bd4b-32f1210a55a5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:51.139448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2d18b65a-1a8c-461c-bd4b-32f1210a55a5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:51.145404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d18b65a-1a8c-461c-bd4b-32f1210a55a5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:51.145759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d18b65a-1a8c-461c-bd4b-32f1210a55a5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:51.146558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d18b65a-1a8c-461c-bd4b-32f1210a55a5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:51.146990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d18b65a-1a8c-461c-bd4b-32f1210a55a5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:51.164662 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e35535c7-0a9f-4af7-97f9-6450397a02a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044151 Aug 01 15:41:51.165437 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 600/1118] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:51 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:51.277299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2d18b65a-1a8c-461c-bd4b-32f1210a55a5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:51.284901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2d18b65a-1a8c-461c-bd4b-32f1210a55a5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.149876 Aug 01 15:41:51.285463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 519/1119] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:51 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:41:51.993701 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-896b3549-9d7f-415b-a48b-b1e61c4f96c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:51.995887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-896b3549-9d7f-415b-a48b-b1e61c4f96c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:52.001985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-896b3549-9d7f-415b-a48b-b1e61c4f96c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:52.002440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-896b3549-9d7f-415b-a48b-b1e61c4f96c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:52.003217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-896b3549-9d7f-415b-a48b-b1e61c4f96c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:52.003655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-896b3549-9d7f-415b-a48b-b1e61c4f96c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:52.032850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-896b3549-9d7f-415b-a48b-b1e61c4f96c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043734 Aug 01 15:41:52.033346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 601/1120] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:52.177269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8a8e913e-454b-4a67-812c-53ad1cb9362b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:52.179584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8a8e913e-454b-4a67-812c-53ad1cb9362b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:52.186790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a8e913e-454b-4a67-812c-53ad1cb9362b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:52.187261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a8e913e-454b-4a67-812c-53ad1cb9362b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:52.188045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a8e913e-454b-4a67-812c-53ad1cb9362b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:52.188488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a8e913e-454b-4a67-812c-53ad1cb9362b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:52.218474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8a8e913e-454b-4a67-812c-53ad1cb9362b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045132 Aug 01 15:41:52.219293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 520/1121] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:52 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:52.307264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d45135de-d009-40f6-88d9-c7702760e634 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:52.308007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d45135de-d009-40f6-88d9-c7702760e634 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:52.314596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d45135de-d009-40f6-88d9-c7702760e634 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:52.315030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d45135de-d009-40f6-88d9-c7702760e634 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:52.316098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d45135de-d009-40f6-88d9-c7702760e634 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:52.316536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d45135de-d009-40f6-88d9-c7702760e634 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:52.455812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d45135de-d009-40f6-88d9-c7702760e634 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:52.463872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d45135de-d009-40f6-88d9-c7702760e634 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.161808 Aug 01 15:41:52.464435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 602/1122] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:52 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:53.045061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b58feb5a-a7e2-40a2-961c-55a5de2334d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:53.047248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b58feb5a-a7e2-40a2-961c-55a5de2334d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:53.053429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b58feb5a-a7e2-40a2-961c-55a5de2334d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:53.053873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b58feb5a-a7e2-40a2-961c-55a5de2334d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:53.054851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b58feb5a-a7e2-40a2-961c-55a5de2334d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:53.055262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b58feb5a-a7e2-40a2-961c-55a5de2334d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:53.086584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b58feb5a-a7e2-40a2-961c-55a5de2334d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044853 Aug 01 15:41:53.087269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 521/1123] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:53.230705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b116ddbb-c6bd-440b-a988-941dcb405794 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:53.232972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b116ddbb-c6bd-440b-a988-941dcb405794 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:53.239088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b116ddbb-c6bd-440b-a988-941dcb405794 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:53.239539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b116ddbb-c6bd-440b-a988-941dcb405794 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:53.240302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b116ddbb-c6bd-440b-a988-941dcb405794 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:53.240752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b116ddbb-c6bd-440b-a988-941dcb405794 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:53.275298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b116ddbb-c6bd-440b-a988-941dcb405794 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048476 Aug 01 15:41:53.275851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 603/1124] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:53 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:53.485311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-926a8eb7-4228-4748-9fae-e38b297dd8c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:53.485956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-926a8eb7-4228-4748-9fae-e38b297dd8c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:53.492581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-926a8eb7-4228-4748-9fae-e38b297dd8c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:53.493033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-926a8eb7-4228-4748-9fae-e38b297dd8c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:53.493803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-926a8eb7-4228-4748-9fae-e38b297dd8c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:53.494882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-926a8eb7-4228-4748-9fae-e38b297dd8c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:53.627028 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-926a8eb7-4228-4748-9fae-e38b297dd8c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:53.635095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-926a8eb7-4228-4748-9fae-e38b297dd8c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153777 Aug 01 15:41:53.635674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 522/1125] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:53 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:54.098793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6b16cf51-a1b4-4643-bd55-2fc6bb761dd8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:54.100958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6b16cf51-a1b4-4643-bd55-2fc6bb761dd8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:54.107588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6b16cf51-a1b4-4643-bd55-2fc6bb761dd8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:54.108034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6b16cf51-a1b4-4643-bd55-2fc6bb761dd8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:54.108787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6b16cf51-a1b4-4643-bd55-2fc6bb761dd8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:54.109220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6b16cf51-a1b4-4643-bd55-2fc6bb761dd8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:54.139102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6b16cf51-a1b4-4643-bd55-2fc6bb761dd8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044265 Aug 01 15:41:54.139647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 604/1126] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:54.287366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0b2b1cd9-31b4-432e-8d4d-829fa5706fe7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:54.290052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0b2b1cd9-31b4-432e-8d4d-829fa5706fe7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:54.296180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b2b1cd9-31b4-432e-8d4d-829fa5706fe7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:54.296635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b2b1cd9-31b4-432e-8d4d-829fa5706fe7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:54.297402 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b2b1cd9-31b4-432e-8d4d-829fa5706fe7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:54.297840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b2b1cd9-31b4-432e-8d4d-829fa5706fe7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:54.322934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:41:54.328071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0b2b1cd9-31b4-432e-8d4d-829fa5706fe7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044826 Aug 01 15:41:54.328638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 523/1127] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:54 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:41:54.657105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6aff6ee4-445a-4293-9acb-5202ead391dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:54.657707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6aff6ee4-445a-4293-9acb-5202ead391dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:54.663859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6aff6ee4-445a-4293-9acb-5202ead391dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:54.664805 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6aff6ee4-445a-4293-9acb-5202ead391dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:54.665550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6aff6ee4-445a-4293-9acb-5202ead391dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:54.666001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6aff6ee4-445a-4293-9acb-5202ead391dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:54.799570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6aff6ee4-445a-4293-9acb-5202ead391dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:54.807134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6aff6ee4-445a-4293-9acb-5202ead391dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153896 Aug 01 15:41:54.807692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 605/1128] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:54 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:55.151640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b34a465d-584a-4f37-9971-095c6065b340 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:55.153775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b34a465d-584a-4f37-9971-095c6065b340 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:55.160483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b34a465d-584a-4f37-9971-095c6065b340 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:55.160911 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b34a465d-584a-4f37-9971-095c6065b340 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:55.161669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b34a465d-584a-4f37-9971-095c6065b340 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:55.162123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b34a465d-584a-4f37-9971-095c6065b340 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:55.190108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b34a465d-584a-4f37-9971-095c6065b340 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043104 Aug 01 15:41:55.190660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 524/1129] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:55.341139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ecf4d986-bec9-4b64-bc96-0461d6470f35 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:55.343218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ecf4d986-bec9-4b64-bc96-0461d6470f35 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:55.350074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ecf4d986-bec9-4b64-bc96-0461d6470f35 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:55.350525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ecf4d986-bec9-4b64-bc96-0461d6470f35 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:55.351284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ecf4d986-bec9-4b64-bc96-0461d6470f35 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:55.351718 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ecf4d986-bec9-4b64-bc96-0461d6470f35 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:55.380432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ecf4d986-bec9-4b64-bc96-0461d6470f35 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043268 Aug 01 15:41:55.381163 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 606/1130] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:55 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:55.828718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-05e7bb08-5e53-4ff3-8d78-c7d05ad44f90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:55.829472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-05e7bb08-5e53-4ff3-8d78-c7d05ad44f90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:55.835595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05e7bb08-5e53-4ff3-8d78-c7d05ad44f90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:55.836038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05e7bb08-5e53-4ff3-8d78-c7d05ad44f90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:55.836797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05e7bb08-5e53-4ff3-8d78-c7d05ad44f90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:55.837221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05e7bb08-5e53-4ff3-8d78-c7d05ad44f90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:55.971799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-05e7bb08-5e53-4ff3-8d78-c7d05ad44f90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:55.979911 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-05e7bb08-5e53-4ff3-8d78-c7d05ad44f90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155477 Aug 01 15:41:55.980504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 525/1131] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:55 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:56.201820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d760c497-132e-4013-b085-da1407899052 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:56.204166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d760c497-132e-4013-b085-da1407899052 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:56.210279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d760c497-132e-4013-b085-da1407899052 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:56.211219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d760c497-132e-4013-b085-da1407899052 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:56.211983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d760c497-132e-4013-b085-da1407899052 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:56.212421 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d760c497-132e-4013-b085-da1407899052 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:56.241675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d760c497-132e-4013-b085-da1407899052 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043866 Aug 01 15:41:56.242256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 607/1132] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:56.392915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-26b29179-fb03-4fd9-83aa-71e3c542f433 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:56.395157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-26b29179-fb03-4fd9-83aa-71e3c542f433 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:56.403260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26b29179-fb03-4fd9-83aa-71e3c542f433 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:56.403730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26b29179-fb03-4fd9-83aa-71e3c542f433 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:56.404511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26b29179-fb03-4fd9-83aa-71e3c542f433 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:56.404959 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26b29179-fb03-4fd9-83aa-71e3c542f433 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:56.437642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-26b29179-fb03-4fd9-83aa-71e3c542f433 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048604 Aug 01 15:41:56.438547 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 526/1133] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:56 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:57.001734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4c245692-9382-474a-9cfc-4efc5eec0d61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:57.002488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4c245692-9382-474a-9cfc-4efc5eec0d61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:57.009785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c245692-9382-474a-9cfc-4efc5eec0d61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:57.010244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c245692-9382-474a-9cfc-4efc5eec0d61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:57.011009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c245692-9382-474a-9cfc-4efc5eec0d61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:57.011448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c245692-9382-474a-9cfc-4efc5eec0d61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:57.143372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4c245692-9382-474a-9cfc-4efc5eec0d61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:57.151122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4c245692-9382-474a-9cfc-4efc5eec0d61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153279 Aug 01 15:41:57.151687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 608/1134] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:56 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:57.254067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4c5a75d6-faa1-4bd6-8962-5805c3be3fcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:57.256197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4c5a75d6-faa1-4bd6-8962-5805c3be3fcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:57.262236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c5a75d6-faa1-4bd6-8962-5805c3be3fcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:57.262682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c5a75d6-faa1-4bd6-8962-5805c3be3fcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:57.263439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c5a75d6-faa1-4bd6-8962-5805c3be3fcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:57.263871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c5a75d6-faa1-4bd6-8962-5805c3be3fcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:57.292632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4c5a75d6-faa1-4bd6-8962-5805c3be3fcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042634 Aug 01 15:41:57.293275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 527/1135] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:41:57.449703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-82511b73-a1f6-4e9e-aa88-86cdf47738ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:57.452555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-82511b73-a1f6-4e9e-aa88-86cdf47738ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:57.459923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-82511b73-a1f6-4e9e-aa88-86cdf47738ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:57.460375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-82511b73-a1f6-4e9e-aa88-86cdf47738ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:57.461180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-82511b73-a1f6-4e9e-aa88-86cdf47738ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:57.461616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-82511b73-a1f6-4e9e-aa88-86cdf47738ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:57.491319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-82511b73-a1f6-4e9e-aa88-86cdf47738ed tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045831 Aug 01 15:41:57.492522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 609/1136] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:57 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:58.172732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4f001be6-c69d-43ad-9863-86989c720644 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:58.173339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4f001be6-c69d-43ad-9863-86989c720644 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:58.180522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f001be6-c69d-43ad-9863-86989c720644 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:58.180967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f001be6-c69d-43ad-9863-86989c720644 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:58.181729 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f001be6-c69d-43ad-9863-86989c720644 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:58.182250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f001be6-c69d-43ad-9863-86989c720644 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:58.306155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2ed3766b-8e18-449a-a30c-0dcb2e2eef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:58.308339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2ed3766b-8e18-449a-a30c-0dcb2e2eef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:58.315086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2ed3766b-8e18-449a-a30c-0dcb2e2eef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:58.315536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2ed3766b-8e18-449a-a30c-0dcb2e2eef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:58.315718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4f001be6-c69d-43ad-9863-86989c720644 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:58.316311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2ed3766b-8e18-449a-a30c-0dcb2e2eef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:58.316747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2ed3766b-8e18-449a-a30c-0dcb2e2eef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:58.323411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4f001be6-c69d-43ad-9863-86989c720644 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154530 Aug 01 15:41:58.323987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 528/1137] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:58 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:58.346886 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2ed3766b-8e18-449a-a30c-0dcb2e2eef89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045455 Aug 01 15:41:58.347447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 610/1138] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:41:58.504317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2643a58b-3573-48c7-89b6-f60ea8b83026 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:58.506508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2643a58b-3573-48c7-89b6-f60ea8b83026 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:58.512535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2643a58b-3573-48c7-89b6-f60ea8b83026 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:58.512992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2643a58b-3573-48c7-89b6-f60ea8b83026 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:58.513765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2643a58b-3573-48c7-89b6-f60ea8b83026 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:58.514231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2643a58b-3573-48c7-89b6-f60ea8b83026 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:58.543962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2643a58b-3573-48c7-89b6-f60ea8b83026 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043773 Aug 01 15:41:58.544525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 529/1139] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:58 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:41:59.345560 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8b111dd4-b3fd-442f-9ed9-b5031263a5d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:59.346144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8b111dd4-b3fd-442f-9ed9-b5031263a5d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:59.353456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b111dd4-b3fd-442f-9ed9-b5031263a5d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:59.353921 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b111dd4-b3fd-442f-9ed9-b5031263a5d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:59.354693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b111dd4-b3fd-442f-9ed9-b5031263a5d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:59.355137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b111dd4-b3fd-442f-9ed9-b5031263a5d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:59.360043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-24892dbc-422e-4cc3-9514-de46cb5c2a35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:59.362208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-24892dbc-422e-4cc3-9514-de46cb5c2a35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:59.368854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24892dbc-422e-4cc3-9514-de46cb5c2a35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:59.369297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24892dbc-422e-4cc3-9514-de46cb5c2a35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:59.370106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24892dbc-422e-4cc3-9514-de46cb5c2a35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:59.370543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24892dbc-422e-4cc3-9514-de46cb5c2a35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:59.400339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-24892dbc-422e-4cc3-9514-de46cb5c2a35 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044183 Aug 01 15:41:59.400914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 530/1140] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:41:59 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:41:59.487098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8b111dd4-b3fd-442f-9ed9-b5031263a5d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:41:59.494646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8b111dd4-b3fd-442f-9ed9-b5031263a5d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153301 Aug 01 15:41:59.495201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 611/1141] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:41:59 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:41:59.556912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0e5162af-95dc-4672-8389-406fb0b37006 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:41:59.559111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0e5162af-95dc-4672-8389-406fb0b37006 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:41:59.565090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e5162af-95dc-4672-8389-406fb0b37006 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:59.565532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e5162af-95dc-4672-8389-406fb0b37006 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:59.566331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e5162af-95dc-4672-8389-406fb0b37006 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:41:59.566758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e5162af-95dc-4672-8389-406fb0b37006 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:41:59.598940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0e5162af-95dc-4672-8389-406fb0b37006 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046017 Aug 01 15:41:59.599415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 531/1142] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:41:59 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:00.415427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3dcbe0e9-d570-471e-bce9-c0424c668914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:00.417575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3dcbe0e9-d570-471e-bce9-c0424c668914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:00.420035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=82 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:00.425411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3dcbe0e9-d570-471e-bce9-c0424c668914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:00.425913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3dcbe0e9-d570-471e-bce9-c0424c668914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:00.426810 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3dcbe0e9-d570-471e-bce9-c0424c668914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:00.427285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3dcbe0e9-d570-471e-bce9-c0424c668914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:00.457468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3dcbe0e9-d570-471e-bce9-c0424c668914 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046845 Aug 01 15:42:00.458054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 612/1143] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:00.520443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f3e36297-fd95-4b93-9da0-d846f62d3375 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:00.521050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f3e36297-fd95-4b93-9da0-d846f62d3375 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:00.528710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f3e36297-fd95-4b93-9da0-d846f62d3375 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:00.529157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f3e36297-fd95-4b93-9da0-d846f62d3375 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:00.529966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f3e36297-fd95-4b93-9da0-d846f62d3375 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:00.530409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f3e36297-fd95-4b93-9da0-d846f62d3375 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:00.611610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cd588d0e-112d-4bf1-bc56-c0c2613e7940 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:00.613645 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cd588d0e-112d-4bf1-bc56-c0c2613e7940 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:00.620438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd588d0e-112d-4bf1-bc56-c0c2613e7940 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:00.620880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd588d0e-112d-4bf1-bc56-c0c2613e7940 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:00.621646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd588d0e-112d-4bf1-bc56-c0c2613e7940 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:00.622105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cd588d0e-112d-4bf1-bc56-c0c2613e7940 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:00.651833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cd588d0e-112d-4bf1-bc56-c0c2613e7940 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Aug 01 15:42:00.652395 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 613/1144] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:00 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:42:00.664443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f3e36297-fd95-4b93-9da0-d846f62d3375 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:00.671982 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f3e36297-fd95-4b93-9da0-d846f62d3375 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155823 Aug 01 15:42:00.672493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 532/1145] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:00 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:01.469939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1902dbf8-dce0-4ea7-8f6c-dcf1d9d4b861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:01.472121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1902dbf8-dce0-4ea7-8f6c-dcf1d9d4b861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:01.479070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1902dbf8-dce0-4ea7-8f6c-dcf1d9d4b861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:01.479523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1902dbf8-dce0-4ea7-8f6c-dcf1d9d4b861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:01.480296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1902dbf8-dce0-4ea7-8f6c-dcf1d9d4b861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:01.480734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1902dbf8-dce0-4ea7-8f6c-dcf1d9d4b861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:01.484603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:01.511640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1902dbf8-dce0-4ea7-8f6c-dcf1d9d4b861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045909 Aug 01 15:42:01.512205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 614/1146] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:01.664564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b5e3113a-aeac-40f2-83b9-9ff1f43ac298 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:01.666777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b5e3113a-aeac-40f2-83b9-9ff1f43ac298 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:01.673475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5e3113a-aeac-40f2-83b9-9ff1f43ac298 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:01.674006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5e3113a-aeac-40f2-83b9-9ff1f43ac298 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:01.674776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5e3113a-aeac-40f2-83b9-9ff1f43ac298 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:01.675209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5e3113a-aeac-40f2-83b9-9ff1f43ac298 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:01.694119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4b3de4d4-c5c6-4663-8395-49b8208a7643 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:01.694791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4b3de4d4-c5c6-4663-8395-49b8208a7643 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:01.701441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b3de4d4-c5c6-4663-8395-49b8208a7643 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:01.701911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b3de4d4-c5c6-4663-8395-49b8208a7643 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:01.702688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b3de4d4-c5c6-4663-8395-49b8208a7643 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:01.703170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b3de4d4-c5c6-4663-8395-49b8208a7643 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:01.706536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b5e3113a-aeac-40f2-83b9-9ff1f43ac298 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Aug 01 15:42:01.707292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 533/1147] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:01 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:01.840520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4b3de4d4-c5c6-4663-8395-49b8208a7643 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:01.848476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4b3de4d4-c5c6-4663-8395-49b8208a7643 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158287 Aug 01 15:42:01.849035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 615/1148] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:01 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:42:02.525504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-70b36b94-c5c9-4f7b-a341-eb973647bb87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:02.527822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-70b36b94-c5c9-4f7b-a341-eb973647bb87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:02.534189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70b36b94-c5c9-4f7b-a341-eb973647bb87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:02.534645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70b36b94-c5c9-4f7b-a341-eb973647bb87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:02.535464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70b36b94-c5c9-4f7b-a341-eb973647bb87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:02.535901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70b36b94-c5c9-4f7b-a341-eb973647bb87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:02.565277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-70b36b94-c5c9-4f7b-a341-eb973647bb87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044421 Aug 01 15:42:02.565844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 534/1149] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:02.719251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-dd644acb-4085-4a2f-8437-db6102c432e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:02.721422 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-dd644acb-4085-4a2f-8437-db6102c432e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:02.728067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dd644acb-4085-4a2f-8437-db6102c432e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:02.728506 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dd644acb-4085-4a2f-8437-db6102c432e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:02.729259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dd644acb-4085-4a2f-8437-db6102c432e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:02.729689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dd644acb-4085-4a2f-8437-db6102c432e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:02.758893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-dd644acb-4085-4a2f-8437-db6102c432e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Aug 01 15:42:02.759434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 616/1150] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:02 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:02.871126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b5f8b43e-e90c-43b6-ae68-d9beab342677 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:02.871748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b5f8b43e-e90c-43b6-ae68-d9beab342677 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:02.877855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5f8b43e-e90c-43b6-ae68-d9beab342677 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:02.878338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5f8b43e-e90c-43b6-ae68-d9beab342677 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:02.879108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5f8b43e-e90c-43b6-ae68-d9beab342677 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:02.879546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5f8b43e-e90c-43b6-ae68-d9beab342677 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:03.012825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b5f8b43e-e90c-43b6-ae68-d9beab342677 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:03.020381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b5f8b43e-e90c-43b6-ae68-d9beab342677 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154139 Aug 01 15:42:03.020935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 535/1151] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:02 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:03.583547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d52ecbc9-7444-461a-8c1f-d18213ecab94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:03.586380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d52ecbc9-7444-461a-8c1f-d18213ecab94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:03.593656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d52ecbc9-7444-461a-8c1f-d18213ecab94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:03.594685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d52ecbc9-7444-461a-8c1f-d18213ecab94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:03.595833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d52ecbc9-7444-461a-8c1f-d18213ecab94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:03.596486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d52ecbc9-7444-461a-8c1f-d18213ecab94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:03.633791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d52ecbc9-7444-461a-8c1f-d18213ecab94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054669 Aug 01 15:42:03.634376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 617/1152] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:03.771368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4c35f77a-8992-47b6-9569-23fbbe245c10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:03.773631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4c35f77a-8992-47b6-9569-23fbbe245c10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:03.779803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c35f77a-8992-47b6-9569-23fbbe245c10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:03.780256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c35f77a-8992-47b6-9569-23fbbe245c10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:03.781117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c35f77a-8992-47b6-9569-23fbbe245c10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:03.781472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c35f77a-8992-47b6-9569-23fbbe245c10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:03.810257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4c35f77a-8992-47b6-9569-23fbbe245c10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042841 Aug 01 15:42:03.810813 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 536/1153] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:03 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:04.041338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-869fdf95-b979-4d33-a439-9d565b08496c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:04.042010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-869fdf95-b979-4d33-a439-9d565b08496c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:04.048495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-869fdf95-b979-4d33-a439-9d565b08496c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:04.048947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-869fdf95-b979-4d33-a439-9d565b08496c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:04.049740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-869fdf95-b979-4d33-a439-9d565b08496c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:04.050202 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-869fdf95-b979-4d33-a439-9d565b08496c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:04.181009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-869fdf95-b979-4d33-a439-9d565b08496c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:04.188776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-869fdf95-b979-4d33-a439-9d565b08496c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151186 Aug 01 15:42:04.189276 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 618/1154] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:04 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:04.646236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-58833ecf-c1f1-49c3-9f29-58bcb3c0c564 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:04.648433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-58833ecf-c1f1-49c3-9f29-58bcb3c0c564 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:04.654939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58833ecf-c1f1-49c3-9f29-58bcb3c0c564 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:04.655395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58833ecf-c1f1-49c3-9f29-58bcb3c0c564 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:04.656164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58833ecf-c1f1-49c3-9f29-58bcb3c0c564 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:04.656604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58833ecf-c1f1-49c3-9f29-58bcb3c0c564 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:04.685538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-58833ecf-c1f1-49c3-9f29-58bcb3c0c564 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043291 Aug 01 15:42:04.686131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 537/1155] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:04 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:04.822149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-18c31afc-7607-40bd-bbb3-886a405747ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:04.824345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-18c31afc-7607-40bd-bbb3-886a405747ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:04.830446 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18c31afc-7607-40bd-bbb3-886a405747ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:04.830887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18c31afc-7607-40bd-bbb3-886a405747ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:04.831640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18c31afc-7607-40bd-bbb3-886a405747ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:04.832067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18c31afc-7607-40bd-bbb3-886a405747ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:04.861756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-18c31afc-7607-40bd-bbb3-886a405747ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Aug 01 15:42:04.862347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 619/1156] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:04 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:05.211318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6e07261d-e3de-408d-94a7-55ef6e2e86f7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:05.211932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6e07261d-e3de-408d-94a7-55ef6e2e86f7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:05.218107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e07261d-e3de-408d-94a7-55ef6e2e86f7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:05.218560 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e07261d-e3de-408d-94a7-55ef6e2e86f7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:05.219742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e07261d-e3de-408d-94a7-55ef6e2e86f7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:05.220184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6e07261d-e3de-408d-94a7-55ef6e2e86f7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:05.347656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6e07261d-e3de-408d-94a7-55ef6e2e86f7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:05.355753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6e07261d-e3de-408d-94a7-55ef6e2e86f7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.148813 Aug 01 15:42:05.356322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 538/1157] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:05 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:05.698972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2a95265b-03b0-472a-b28a-73375b16612f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:05.701164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2a95265b-03b0-472a-b28a-73375b16612f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:05.707720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a95265b-03b0-472a-b28a-73375b16612f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:05.708175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a95265b-03b0-472a-b28a-73375b16612f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:05.709034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a95265b-03b0-472a-b28a-73375b16612f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:05.709475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2a95265b-03b0-472a-b28a-73375b16612f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:05.741688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2a95265b-03b0-472a-b28a-73375b16612f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047229 Aug 01 15:42:05.742265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 620/1158] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:05.873806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b4934901-eef8-4b4e-af1d-fbab28dd8634 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:05.876021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b4934901-eef8-4b4e-af1d-fbab28dd8634 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:05.883322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b4934901-eef8-4b4e-af1d-fbab28dd8634 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:05.883771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b4934901-eef8-4b4e-af1d-fbab28dd8634 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:05.884541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b4934901-eef8-4b4e-af1d-fbab28dd8634 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:05.884978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b4934901-eef8-4b4e-af1d-fbab28dd8634 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:05.914506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b4934901-eef8-4b4e-af1d-fbab28dd8634 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044452 Aug 01 15:42:05.914979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 539/1159] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:05 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:06.377176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d23383ae-30b9-4f7a-8e00-480d80caf211 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:06.377987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d23383ae-30b9-4f7a-8e00-480d80caf211 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:06.384492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d23383ae-30b9-4f7a-8e00-480d80caf211 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:06.384939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d23383ae-30b9-4f7a-8e00-480d80caf211 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:06.385702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d23383ae-30b9-4f7a-8e00-480d80caf211 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:06.386173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d23383ae-30b9-4f7a-8e00-480d80caf211 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:06.520225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d23383ae-30b9-4f7a-8e00-480d80caf211 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:06.527793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d23383ae-30b9-4f7a-8e00-480d80caf211 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154943 Aug 01 15:42:06.528355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 621/1160] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:06 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:06.754616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3337f6a7-c9ff-4546-a66a-f9d3bcc97e1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:06.756742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3337f6a7-c9ff-4546-a66a-f9d3bcc97e1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:06.765629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3337f6a7-c9ff-4546-a66a-f9d3bcc97e1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:06.766223 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3337f6a7-c9ff-4546-a66a-f9d3bcc97e1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:06.766998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3337f6a7-c9ff-4546-a66a-f9d3bcc97e1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:06.767440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3337f6a7-c9ff-4546-a66a-f9d3bcc97e1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:06.781496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:06.798244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3337f6a7-c9ff-4546-a66a-f9d3bcc97e1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048158 Aug 01 15:42:06.798807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 540/1161] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:06.927438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d1fc785a-0636-4db0-bfb5-b1ad307d2a3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:06.929617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d1fc785a-0636-4db0-bfb5-b1ad307d2a3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:06.936092 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1fc785a-0636-4db0-bfb5-b1ad307d2a3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:06.936536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1fc785a-0636-4db0-bfb5-b1ad307d2a3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:06.937295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1fc785a-0636-4db0-bfb5-b1ad307d2a3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:06.937728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1fc785a-0636-4db0-bfb5-b1ad307d2a3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:06.966576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d1fc785a-0636-4db0-bfb5-b1ad307d2a3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043081 Aug 01 15:42:06.967128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 622/1162] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:06 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:07.550988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-06388391-704c-4670-a711-22c7aab3ede6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:07.551692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-06388391-704c-4670-a711-22c7aab3ede6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:07.558763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06388391-704c-4670-a711-22c7aab3ede6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:07.559205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06388391-704c-4670-a711-22c7aab3ede6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:07.559969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06388391-704c-4670-a711-22c7aab3ede6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:07.560400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06388391-704c-4670-a711-22c7aab3ede6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:07.704010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-06388391-704c-4670-a711-22c7aab3ede6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:07.712541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-06388391-704c-4670-a711-22c7aab3ede6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.165455 Aug 01 15:42:07.713120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 541/1163] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:07 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:07.811201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1e1c7173-a2ef-406b-93ca-af65d5b1bcf6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:07.813376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1e1c7173-a2ef-406b-93ca-af65d5b1bcf6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:07.819536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e1c7173-a2ef-406b-93ca-af65d5b1bcf6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:07.819987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e1c7173-a2ef-406b-93ca-af65d5b1bcf6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:07.820755 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e1c7173-a2ef-406b-93ca-af65d5b1bcf6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:07.821196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e1c7173-a2ef-406b-93ca-af65d5b1bcf6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:07.850462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1e1c7173-a2ef-406b-93ca-af65d5b1bcf6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043231 Aug 01 15:42:07.851521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 623/1164] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:07 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:42:07.979650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2baf87f2-b745-4e0d-ba31-11e6d385a9d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:07.981821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2baf87f2-b745-4e0d-ba31-11e6d385a9d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:07.988000 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2baf87f2-b745-4e0d-ba31-11e6d385a9d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:07.988449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2baf87f2-b745-4e0d-ba31-11e6d385a9d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:07.989216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2baf87f2-b745-4e0d-ba31-11e6d385a9d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:07.989654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2baf87f2-b745-4e0d-ba31-11e6d385a9d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:08.019267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2baf87f2-b745-4e0d-ba31-11e6d385a9d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044110 Aug 01 15:42:08.019829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 542/1165] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:07 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:08.737855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-77c62edb-062d-4073-b96a-42c3a3770ca9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:08.738493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-77c62edb-062d-4073-b96a-42c3a3770ca9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:08.746115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-77c62edb-062d-4073-b96a-42c3a3770ca9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:08.746568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-77c62edb-062d-4073-b96a-42c3a3770ca9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:08.747332 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-77c62edb-062d-4073-b96a-42c3a3770ca9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:08.747771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-77c62edb-062d-4073-b96a-42c3a3770ca9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:08.863382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-345dc92b-8e46-4857-9740-887de328c374 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:08.865660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-345dc92b-8e46-4857-9740-887de328c374 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:08.872249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-345dc92b-8e46-4857-9740-887de328c374 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:08.872706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-345dc92b-8e46-4857-9740-887de328c374 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:08.873497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-345dc92b-8e46-4857-9740-887de328c374 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:08.873964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-345dc92b-8e46-4857-9740-887de328c374 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:08.883804 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-77c62edb-062d-4073-b96a-42c3a3770ca9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:08.892402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-77c62edb-062d-4073-b96a-42c3a3770ca9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158350 Aug 01 15:42:08.892969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 624/1166] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:08 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:08.906868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-345dc92b-8e46-4857-9740-887de328c374 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047427 Aug 01 15:42:08.907455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 543/1167] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:42:09.031645 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9b2a5970-b06b-4e40-8e6e-47f612d40c86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:09.033715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9b2a5970-b06b-4e40-8e6e-47f612d40c86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:09.039821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b2a5970-b06b-4e40-8e6e-47f612d40c86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:09.040269 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b2a5970-b06b-4e40-8e6e-47f612d40c86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:09.041024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b2a5970-b06b-4e40-8e6e-47f612d40c86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:09.041457 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b2a5970-b06b-4e40-8e6e-47f612d40c86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:09.073174 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9b2a5970-b06b-4e40-8e6e-47f612d40c86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045504 Aug 01 15:42:09.073748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 625/1168] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:09 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:09.914385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fbb43ef8-c2b3-4c59-88b5-72c05c9e9230 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:09.915005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fbb43ef8-c2b3-4c59-88b5-72c05c9e9230 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:09.920110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a67fc2c0-d6af-420c-90a7-7b52bf431de0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:09.922508 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a67fc2c0-d6af-420c-90a7-7b52bf431de0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:09.923937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fbb43ef8-c2b3-4c59-88b5-72c05c9e9230 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:09.924391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fbb43ef8-c2b3-4c59-88b5-72c05c9e9230 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:09.925241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fbb43ef8-c2b3-4c59-88b5-72c05c9e9230 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:09.925712 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fbb43ef8-c2b3-4c59-88b5-72c05c9e9230 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:09.929227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a67fc2c0-d6af-420c-90a7-7b52bf431de0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:09.929675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a67fc2c0-d6af-420c-90a7-7b52bf431de0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:09.930975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a67fc2c0-d6af-420c-90a7-7b52bf431de0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:09.931410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a67fc2c0-d6af-420c-90a7-7b52bf431de0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:09.963611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a67fc2c0-d6af-420c-90a7-7b52bf431de0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047770 Aug 01 15:42:09.964411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 626/1169] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:42:10.060412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fbb43ef8-c2b3-4c59-88b5-72c05c9e9230 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:10.068173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fbb43ef8-c2b3-4c59-88b5-72c05c9e9230 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.157773 Aug 01 15:42:10.068739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 544/1170] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:09 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:10.085399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d9830146-36a5-4ada-b7b6-414898ea6b1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:10.087595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d9830146-36a5-4ada-b7b6-414898ea6b1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:10.094430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9830146-36a5-4ada-b7b6-414898ea6b1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:10.094878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9830146-36a5-4ada-b7b6-414898ea6b1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:10.095677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9830146-36a5-4ada-b7b6-414898ea6b1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:10.096106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9830146-36a5-4ada-b7b6-414898ea6b1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:10.125948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d9830146-36a5-4ada-b7b6-414898ea6b1b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045178 Aug 01 15:42:10.126536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 627/1171] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:10 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:10.976830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5467a4bd-ce84-4db9-8f8b-627a2e4f68cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:10.979577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5467a4bd-ce84-4db9-8f8b-627a2e4f68cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:10.986129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5467a4bd-ce84-4db9-8f8b-627a2e4f68cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:10.986592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5467a4bd-ce84-4db9-8f8b-627a2e4f68cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:10.987360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5467a4bd-ce84-4db9-8f8b-627a2e4f68cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:10.987797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5467a4bd-ce84-4db9-8f8b-627a2e4f68cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:11.017396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5467a4bd-ce84-4db9-8f8b-627a2e4f68cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044618 Aug 01 15:42:11.017997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 545/1172] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:10 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:11.090402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cb7bac0d-9fab-4e05-b117-53bd2d4bbd64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:11.091016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cb7bac0d-9fab-4e05-b117-53bd2d4bbd64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:11.097802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb7bac0d-9fab-4e05-b117-53bd2d4bbd64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:11.098286 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb7bac0d-9fab-4e05-b117-53bd2d4bbd64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:11.099080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb7bac0d-9fab-4e05-b117-53bd2d4bbd64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:11.099518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb7bac0d-9fab-4e05-b117-53bd2d4bbd64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:11.138636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8f1af6ff-3853-4f16-b21e-8d21e949a162 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:11.140965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8f1af6ff-3853-4f16-b21e-8d21e949a162 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:11.147291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f1af6ff-3853-4f16-b21e-8d21e949a162 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:11.147843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f1af6ff-3853-4f16-b21e-8d21e949a162 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:11.148702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f1af6ff-3853-4f16-b21e-8d21e949a162 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:11.149731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f1af6ff-3853-4f16-b21e-8d21e949a162 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:11.179582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8f1af6ff-3853-4f16-b21e-8d21e949a162 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045065 Aug 01 15:42:11.180159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 546/1173] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:11 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:42:11.230431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cb7bac0d-9fab-4e05-b117-53bd2d4bbd64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:11.237963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cb7bac0d-9fab-4e05-b117-53bd2d4bbd64 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152029 Aug 01 15:42:11.238513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 628/1174] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:11 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:12.030555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-224a91ba-af9f-44e4-bb20-0af5dd291f1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:12.032762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-224a91ba-af9f-44e4-bb20-0af5dd291f1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:12.039405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-224a91ba-af9f-44e4-bb20-0af5dd291f1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:12.040496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-224a91ba-af9f-44e4-bb20-0af5dd291f1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:12.041272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-224a91ba-af9f-44e4-bb20-0af5dd291f1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:12.041715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-224a91ba-af9f-44e4-bb20-0af5dd291f1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:12.071238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-224a91ba-af9f-44e4-bb20-0af5dd291f1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044660 Aug 01 15:42:12.071804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 547/1175] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:12.190877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fa884a09-3e22-4443-b93b-fb59c612f2a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:12.192974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fa884a09-3e22-4443-b93b-fb59c612f2a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:12.200114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa884a09-3e22-4443-b93b-fb59c612f2a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:12.200598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa884a09-3e22-4443-b93b-fb59c612f2a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:12.201361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa884a09-3e22-4443-b93b-fb59c612f2a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:12.201801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa884a09-3e22-4443-b93b-fb59c612f2a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:12.231147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fa884a09-3e22-4443-b93b-fb59c612f2a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044258 Aug 01 15:42:12.231706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 629/1176] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:12 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:12.260311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d6f03c7e-9d04-442d-b06c-cba1f8a1f1f0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:12.260525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d6f03c7e-9d04-442d-b06c-cba1f8a1f1f0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:12.266599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6f03c7e-9d04-442d-b06c-cba1f8a1f1f0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:12.267041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6f03c7e-9d04-442d-b06c-cba1f8a1f1f0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:12.267826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6f03c7e-9d04-442d-b06c-cba1f8a1f1f0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:12.268253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6f03c7e-9d04-442d-b06c-cba1f8a1f1f0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:12.398478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d6f03c7e-9d04-442d-b06c-cba1f8a1f1f0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:12.406791 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d6f03c7e-9d04-442d-b06c-cba1f8a1f1f0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151459 Aug 01 15:42:12.407457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 548/1177] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:12 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:13.085132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-94d7ff1a-bb67-4cd6-afde-ec0bc2c32bb9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:13.087343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-94d7ff1a-bb67-4cd6-afde-ec0bc2c32bb9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:13.093464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94d7ff1a-bb67-4cd6-afde-ec0bc2c32bb9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:13.093938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94d7ff1a-bb67-4cd6-afde-ec0bc2c32bb9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:13.094973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94d7ff1a-bb67-4cd6-afde-ec0bc2c32bb9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:13.095407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94d7ff1a-bb67-4cd6-afde-ec0bc2c32bb9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:13.120762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:13.125946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-94d7ff1a-bb67-4cd6-afde-ec0bc2c32bb9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045105 Aug 01 15:42:13.126506 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 630/1178] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:13.243427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e574c7ef-0194-4c83-b669-a7f077f7d3b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:13.246252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e574c7ef-0194-4c83-b669-a7f077f7d3b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:13.252827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e574c7ef-0194-4c83-b669-a7f077f7d3b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:13.253275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e574c7ef-0194-4c83-b669-a7f077f7d3b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:13.254093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e574c7ef-0194-4c83-b669-a7f077f7d3b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:13.254536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e574c7ef-0194-4c83-b669-a7f077f7d3b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:13.283601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e574c7ef-0194-4c83-b669-a7f077f7d3b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044088 Aug 01 15:42:13.284166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 549/1179] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:13 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:13.428019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-38997c46-8c5c-419a-8911-287453cc0ea3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:13.428625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-38997c46-8c5c-419a-8911-287453cc0ea3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:13.435226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-38997c46-8c5c-419a-8911-287453cc0ea3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:13.435670 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-38997c46-8c5c-419a-8911-287453cc0ea3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:13.436421 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-38997c46-8c5c-419a-8911-287453cc0ea3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:13.436846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-38997c46-8c5c-419a-8911-287453cc0ea3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:13.568838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-38997c46-8c5c-419a-8911-287453cc0ea3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:13.576520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-38997c46-8c5c-419a-8911-287453cc0ea3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152319 Aug 01 15:42:13.577088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 631/1180] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:13 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:14.138635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7dba66c6-7aee-47cb-8cb8-36378e3e157c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:14.140776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7dba66c6-7aee-47cb-8cb8-36378e3e157c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:14.146846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7dba66c6-7aee-47cb-8cb8-36378e3e157c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:14.147287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7dba66c6-7aee-47cb-8cb8-36378e3e157c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:14.148049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7dba66c6-7aee-47cb-8cb8-36378e3e157c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:14.148477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7dba66c6-7aee-47cb-8cb8-36378e3e157c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:14.177628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7dba66c6-7aee-47cb-8cb8-36378e3e157c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043571 Aug 01 15:42:14.178209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 550/1181] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:42:14.296454 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cb02fccf-52a4-4759-b48f-a19f967d0486 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:14.298596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cb02fccf-52a4-4759-b48f-a19f967d0486 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:14.304774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb02fccf-52a4-4759-b48f-a19f967d0486 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:14.305264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb02fccf-52a4-4759-b48f-a19f967d0486 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:14.306056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb02fccf-52a4-4759-b48f-a19f967d0486 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:14.306493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb02fccf-52a4-4759-b48f-a19f967d0486 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:14.337200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cb02fccf-52a4-4759-b48f-a19f967d0486 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045217 Aug 01 15:42:14.337744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 632/1182] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:14 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:14.598699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6984ab0c-9e9d-4978-8c83-f750d8d445e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:14.599234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6984ab0c-9e9d-4978-8c83-f750d8d445e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:14.605690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6984ab0c-9e9d-4978-8c83-f750d8d445e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:14.606163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6984ab0c-9e9d-4978-8c83-f750d8d445e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:14.606922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6984ab0c-9e9d-4978-8c83-f750d8d445e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:14.607350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6984ab0c-9e9d-4978-8c83-f750d8d445e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:14.742314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6984ab0c-9e9d-4978-8c83-f750d8d445e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:14.749828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6984ab0c-9e9d-4978-8c83-f750d8d445e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155043 Aug 01 15:42:14.750422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 551/1183] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:14 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:15.190643 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2df75168-1fe4-42da-a026-0e35be587ad0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:15.192789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2df75168-1fe4-42da-a026-0e35be587ad0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:15.199829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2df75168-1fe4-42da-a026-0e35be587ad0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:15.200279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2df75168-1fe4-42da-a026-0e35be587ad0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:15.201044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2df75168-1fe4-42da-a026-0e35be587ad0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:15.201480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2df75168-1fe4-42da-a026-0e35be587ad0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:15.230848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2df75168-1fe4-42da-a026-0e35be587ad0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044278 Aug 01 15:42:15.231405 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 633/1184] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:15.350379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e560ff6c-6ad2-4a53-bdee-54ca1b8f724e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:15.352509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e560ff6c-6ad2-4a53-bdee-54ca1b8f724e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:15.358628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e560ff6c-6ad2-4a53-bdee-54ca1b8f724e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:15.359212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e560ff6c-6ad2-4a53-bdee-54ca1b8f724e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:15.359943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e560ff6c-6ad2-4a53-bdee-54ca1b8f724e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:15.360451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e560ff6c-6ad2-4a53-bdee-54ca1b8f724e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:15.395752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e560ff6c-6ad2-4a53-bdee-54ca1b8f724e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049444 Aug 01 15:42:15.401139 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 552/1185] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:15 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:15.772510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1617d863-45a1-486e-b23b-e1ad4c330597 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:15.773130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1617d863-45a1-486e-b23b-e1ad4c330597 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:15.779539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1617d863-45a1-486e-b23b-e1ad4c330597 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:15.779992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1617d863-45a1-486e-b23b-e1ad4c330597 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:15.780770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1617d863-45a1-486e-b23b-e1ad4c330597 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:15.781239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1617d863-45a1-486e-b23b-e1ad4c330597 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:15.912847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1617d863-45a1-486e-b23b-e1ad4c330597 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:15.920954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1617d863-45a1-486e-b23b-e1ad4c330597 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152993 Aug 01 15:42:15.921506 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 634/1186] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:15 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:16.243538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-16347374-7165-4eea-b8ac-6730583b47af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:16.245699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-16347374-7165-4eea-b8ac-6730583b47af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:16.252397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16347374-7165-4eea-b8ac-6730583b47af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:16.252849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16347374-7165-4eea-b8ac-6730583b47af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:16.253622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16347374-7165-4eea-b8ac-6730583b47af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:16.254091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16347374-7165-4eea-b8ac-6730583b47af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:16.284731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-16347374-7165-4eea-b8ac-6730583b47af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045127 Aug 01 15:42:16.285303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 553/1187] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:16 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:16.408675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-691d4640-65e1-4ab6-a6fc-5585ee020434 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:16.410886 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-691d4640-65e1-4ab6-a6fc-5585ee020434 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:16.417015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-691d4640-65e1-4ab6-a6fc-5585ee020434 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:16.417469 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-691d4640-65e1-4ab6-a6fc-5585ee020434 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:16.418901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-691d4640-65e1-4ab6-a6fc-5585ee020434 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:16.420484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-691d4640-65e1-4ab6-a6fc-5585ee020434 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:16.450788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-691d4640-65e1-4ab6-a6fc-5585ee020434 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046138 Aug 01 15:42:16.451319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 635/1188] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:16 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:16.943398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b43dabec-8bef-4ba8-aa22-baae680f9f4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:16.944017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b43dabec-8bef-4ba8-aa22-baae680f9f4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:16.950219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b43dabec-8bef-4ba8-aa22-baae680f9f4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:16.950690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b43dabec-8bef-4ba8-aa22-baae680f9f4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:16.951495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b43dabec-8bef-4ba8-aa22-baae680f9f4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:16.951932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b43dabec-8bef-4ba8-aa22-baae680f9f4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:17.095316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b43dabec-8bef-4ba8-aa22-baae680f9f4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:17.102803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b43dabec-8bef-4ba8-aa22-baae680f9f4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.163297 Aug 01 15:42:17.103363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 554/1189] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:16 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:17.298088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-73ed7ab1-0740-4dc7-aba8-932f2974de07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:17.300244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-73ed7ab1-0740-4dc7-aba8-932f2974de07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:17.306942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73ed7ab1-0740-4dc7-aba8-932f2974de07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:17.307327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73ed7ab1-0740-4dc7-aba8-932f2974de07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:17.308112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73ed7ab1-0740-4dc7-aba8-932f2974de07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:17.308551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73ed7ab1-0740-4dc7-aba8-932f2974de07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:17.342442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-73ed7ab1-0740-4dc7-aba8-932f2974de07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048992 Aug 01 15:42:17.343031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 636/1190] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:17.463449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-297fe2a5-31ac-43c9-b8e6-1223f7ed6615 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:17.466317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-297fe2a5-31ac-43c9-b8e6-1223f7ed6615 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:17.473550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-297fe2a5-31ac-43c9-b8e6-1223f7ed6615 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:17.474041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-297fe2a5-31ac-43c9-b8e6-1223f7ed6615 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:17.474828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-297fe2a5-31ac-43c9-b8e6-1223f7ed6615 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:17.475268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-297fe2a5-31ac-43c9-b8e6-1223f7ed6615 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:17.505404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-297fe2a5-31ac-43c9-b8e6-1223f7ed6615 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 Aug 01 15:42:17.506003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 555/1191] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:17 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:18.126129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c3f784bd-5b9b-4784-a6c5-2fec9e57ac50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:18.126744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c3f784bd-5b9b-4784-a6c5-2fec9e57ac50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:18.133120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3f784bd-5b9b-4784-a6c5-2fec9e57ac50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:18.133568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3f784bd-5b9b-4784-a6c5-2fec9e57ac50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:18.134368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3f784bd-5b9b-4784-a6c5-2fec9e57ac50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:18.134794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3f784bd-5b9b-4784-a6c5-2fec9e57ac50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:18.265456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c3f784bd-5b9b-4784-a6c5-2fec9e57ac50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:18.273032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c3f784bd-5b9b-4784-a6c5-2fec9e57ac50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151677 Aug 01 15:42:18.273592 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 637/1192] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:18 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:18.355593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1b553f16-e495-49d9-b221-83216c827607 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:18.358280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1b553f16-e495-49d9-b221-83216c827607 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:18.364493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b553f16-e495-49d9-b221-83216c827607 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:18.364870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b553f16-e495-49d9-b221-83216c827607 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:18.365630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b553f16-e495-49d9-b221-83216c827607 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:18.366090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b553f16-e495-49d9-b221-83216c827607 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:18.396505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1b553f16-e495-49d9-b221-83216c827607 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044801 Aug 01 15:42:18.397074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 556/1193] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:18.516997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0b762676-c260-49e7-8d08-eca21c750ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:18.519185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0b762676-c260-49e7-8d08-eca21c750ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:18.525657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b762676-c260-49e7-8d08-eca21c750ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:18.526141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b762676-c260-49e7-8d08-eca21c750ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:18.526912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b762676-c260-49e7-8d08-eca21c750ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:18.527348 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b762676-c260-49e7-8d08-eca21c750ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:18.556913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0b762676-c260-49e7-8d08-eca21c750ab8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Aug 01 15:42:18.557459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 638/1194] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:18 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:19.191224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:42:19.191862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:42:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:42:19.294504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b200c3f7-7937-4041-a234-667004d695fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:19.295100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b200c3f7-7937-4041-a234-667004d695fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:19.301505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b200c3f7-7937-4041-a234-667004d695fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:19.301988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b200c3f7-7937-4041-a234-667004d695fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:19.302754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b200c3f7-7937-4041-a234-667004d695fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:19.303196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b200c3f7-7937-4041-a234-667004d695fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:19.305784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:19.408831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-26250067-b2a9-43d0-8fcf-3e52f789dcb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:19.411050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-26250067-b2a9-43d0-8fcf-3e52f789dcb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:19.417110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26250067-b2a9-43d0-8fcf-3e52f789dcb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:19.417551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26250067-b2a9-43d0-8fcf-3e52f789dcb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:19.418522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26250067-b2a9-43d0-8fcf-3e52f789dcb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:19.418950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26250067-b2a9-43d0-8fcf-3e52f789dcb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:19.438603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b200c3f7-7937-4041-a234-667004d695fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:19.446188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b200c3f7-7937-4041-a234-667004d695fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155578 Aug 01 15:42:19.446767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 557/1195] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:19 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:19.448599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-26250067-b2a9-43d0-8fcf-3e52f789dcb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043744 Aug 01 15:42:19.449152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 639/1196] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:42:19.569333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cd963800-f6ef-45b7-8a13-ad66ecc57662 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:19.571445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cd963800-f6ef-45b7-8a13-ad66ecc57662 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:19.578122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cd963800-f6ef-45b7-8a13-ad66ecc57662 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:19.578571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cd963800-f6ef-45b7-8a13-ad66ecc57662 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:19.579332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cd963800-f6ef-45b7-8a13-ad66ecc57662 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:19.579766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cd963800-f6ef-45b7-8a13-ad66ecc57662 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:19.609620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cd963800-f6ef-45b7-8a13-ad66ecc57662 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044310 Aug 01 15:42:19.610221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 558/1197] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:19 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:20.461571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-80d4db10-2a4d-4588-b814-caf0f83f5ddd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:20.463844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-80d4db10-2a4d-4588-b814-caf0f83f5ddd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:20.468106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2020a6e7-f52c-44e4-b4b8-b4f57747a92a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:20.468863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2020a6e7-f52c-44e4-b4b8-b4f57747a92a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:20.471603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80d4db10-2a4d-4588-b814-caf0f83f5ddd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:20.472057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80d4db10-2a4d-4588-b814-caf0f83f5ddd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:20.472834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80d4db10-2a4d-4588-b814-caf0f83f5ddd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:20.473271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80d4db10-2a4d-4588-b814-caf0f83f5ddd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:20.476768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2020a6e7-f52c-44e4-b4b8-b4f57747a92a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:20.477283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2020a6e7-f52c-44e4-b4b8-b4f57747a92a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:20.478063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2020a6e7-f52c-44e4-b4b8-b4f57747a92a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:20.478525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2020a6e7-f52c-44e4-b4b8-b4f57747a92a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:20.503415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-80d4db10-2a4d-4588-b814-caf0f83f5ddd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045739 Aug 01 15:42:20.503978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 640/1198] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:20.614676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2020a6e7-f52c-44e4-b4b8-b4f57747a92a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:20.621505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6e32b640-8a7d-4843-9089-4105168c0acf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:20.622948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2020a6e7-f52c-44e4-b4b8-b4f57747a92a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158800 Aug 01 15:42:20.623543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 559/1199] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:20 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:42:20.623714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6e32b640-8a7d-4843-9089-4105168c0acf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:20.630194 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6e32b640-8a7d-4843-9089-4105168c0acf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:20.630642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6e32b640-8a7d-4843-9089-4105168c0acf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:20.631415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6e32b640-8a7d-4843-9089-4105168c0acf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:20.631848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6e32b640-8a7d-4843-9089-4105168c0acf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:20.661729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6e32b640-8a7d-4843-9089-4105168c0acf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Aug 01 15:42:20.662477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 641/1200] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:20 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:42:21.516356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2ac49ca3-d4f2-4263-ac0d-b4bd0b7b450d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:21.518564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2ac49ca3-d4f2-4263-ac0d-b4bd0b7b450d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:21.521054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=84 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:21.526658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ac49ca3-d4f2-4263-ac0d-b4bd0b7b450d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:21.527108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ac49ca3-d4f2-4263-ac0d-b4bd0b7b450d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:21.527887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ac49ca3-d4f2-4263-ac0d-b4bd0b7b450d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:21.528323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ac49ca3-d4f2-4263-ac0d-b4bd0b7b450d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:21.559116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2ac49ca3-d4f2-4263-ac0d-b4bd0b7b450d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046821 Aug 01 15:42:21.559709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 560/1201] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:21.644535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9251bf31-6cd2-41e9-bd27-c88a1fd7e9c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:21.645138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9251bf31-6cd2-41e9-bd27-c88a1fd7e9c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:21.652306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9251bf31-6cd2-41e9-bd27-c88a1fd7e9c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:21.652749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9251bf31-6cd2-41e9-bd27-c88a1fd7e9c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:21.653526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9251bf31-6cd2-41e9-bd27-c88a1fd7e9c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:21.653992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9251bf31-6cd2-41e9-bd27-c88a1fd7e9c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:21.674511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ab94c7ff-6fc6-4762-aacc-d292e3012460 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:21.676786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ab94c7ff-6fc6-4762-aacc-d292e3012460 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:21.682969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab94c7ff-6fc6-4762-aacc-d292e3012460 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:21.683405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab94c7ff-6fc6-4762-aacc-d292e3012460 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:21.684673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab94c7ff-6fc6-4762-aacc-d292e3012460 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:21.685107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab94c7ff-6fc6-4762-aacc-d292e3012460 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:21.717858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ab94c7ff-6fc6-4762-aacc-d292e3012460 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047265 Aug 01 15:42:21.718610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 561/1202] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:21 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:42:21.791244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9251bf31-6cd2-41e9-bd27-c88a1fd7e9c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:21.798767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9251bf31-6cd2-41e9-bd27-c88a1fd7e9c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158213 Aug 01 15:42:21.799316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 642/1203] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:21 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:22.572164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e216c496-71f5-495e-87ff-f970e47872ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:22.574468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e216c496-71f5-495e-87ff-f970e47872ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:22.580955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e216c496-71f5-495e-87ff-f970e47872ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:22.581400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e216c496-71f5-495e-87ff-f970e47872ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:22.582190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e216c496-71f5-495e-87ff-f970e47872ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:22.582625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e216c496-71f5-495e-87ff-f970e47872ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:22.612403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e216c496-71f5-495e-87ff-f970e47872ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044293 Aug 01 15:42:22.612959 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 562/1204] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:22 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:22.732119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8667621c-354c-40b0-b992-a55f4169cf2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:22.734319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8667621c-354c-40b0-b992-a55f4169cf2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:22.741115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8667621c-354c-40b0-b992-a55f4169cf2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:22.741648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8667621c-354c-40b0-b992-a55f4169cf2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:22.742667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8667621c-354c-40b0-b992-a55f4169cf2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:22.743263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8667621c-354c-40b0-b992-a55f4169cf2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:22.773767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8667621c-354c-40b0-b992-a55f4169cf2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046913 Aug 01 15:42:22.774348 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 643/1205] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:22 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:22.820339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-00821cb7-d3a0-4c48-af7a-24ae11c5a59f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:22.820956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-00821cb7-d3a0-4c48-af7a-24ae11c5a59f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:22.827151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-00821cb7-d3a0-4c48-af7a-24ae11c5a59f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:22.827632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-00821cb7-d3a0-4c48-af7a-24ae11c5a59f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:22.828370 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-00821cb7-d3a0-4c48-af7a-24ae11c5a59f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:22.828804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-00821cb7-d3a0-4c48-af7a-24ae11c5a59f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:22.974550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-00821cb7-d3a0-4c48-af7a-24ae11c5a59f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:22.982707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-00821cb7-d3a0-4c48-af7a-24ae11c5a59f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.166209 Aug 01 15:42:22.983198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 563/1206] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:22 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:23.624892 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ad2a45ad-90d1-44be-bc35-e0a4337c5be4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:23.627046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ad2a45ad-90d1-44be-bc35-e0a4337c5be4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:23.633188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad2a45ad-90d1-44be-bc35-e0a4337c5be4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:23.633626 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad2a45ad-90d1-44be-bc35-e0a4337c5be4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:23.634407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad2a45ad-90d1-44be-bc35-e0a4337c5be4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:23.634863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad2a45ad-90d1-44be-bc35-e0a4337c5be4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:23.663992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ad2a45ad-90d1-44be-bc35-e0a4337c5be4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043104 Aug 01 15:42:23.664524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 644/1207] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:42:23.785990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a2f14df8-730e-47df-9c4d-cfaa6d8ee60b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:23.789276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a2f14df8-730e-47df-9c4d-cfaa6d8ee60b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:23.795880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2f14df8-730e-47df-9c4d-cfaa6d8ee60b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:23.796331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2f14df8-730e-47df-9c4d-cfaa6d8ee60b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:23.797104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2f14df8-730e-47df-9c4d-cfaa6d8ee60b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:23.797544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2f14df8-730e-47df-9c4d-cfaa6d8ee60b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:23.827978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a2f14df8-730e-47df-9c4d-cfaa6d8ee60b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045974 Aug 01 15:42:23.828543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 564/1208] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:23 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:24.004568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fabde60a-8a2f-4706-af8e-98eb3afb1689 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:24.005172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fabde60a-8a2f-4706-af8e-98eb3afb1689 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:24.011610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fabde60a-8a2f-4706-af8e-98eb3afb1689 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:24.012055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fabde60a-8a2f-4706-af8e-98eb3afb1689 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:24.012802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fabde60a-8a2f-4706-af8e-98eb3afb1689 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:24.013232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fabde60a-8a2f-4706-af8e-98eb3afb1689 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:24.146368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fabde60a-8a2f-4706-af8e-98eb3afb1689 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:24.153948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fabde60a-8a2f-4706-af8e-98eb3afb1689 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153192 Aug 01 15:42:24.154517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 645/1209] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:23 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:24.676979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6b12a82b-82fb-4e90-91f6-52618c3968ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:24.679179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6b12a82b-82fb-4e90-91f6-52618c3968ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:24.685453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b12a82b-82fb-4e90-91f6-52618c3968ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:24.685937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b12a82b-82fb-4e90-91f6-52618c3968ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:24.686802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b12a82b-82fb-4e90-91f6-52618c3968ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:24.687246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b12a82b-82fb-4e90-91f6-52618c3968ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:24.717086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6b12a82b-82fb-4e90-91f6-52618c3968ed tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044099 Aug 01 15:42:24.718304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 565/1210] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:24.840458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c04ba99c-0de6-4203-a79f-d00ce8a86df6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:24.843425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c04ba99c-0de6-4203-a79f-d00ce8a86df6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:24.850025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c04ba99c-0de6-4203-a79f-d00ce8a86df6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:24.850447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c04ba99c-0de6-4203-a79f-d00ce8a86df6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:24.851206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c04ba99c-0de6-4203-a79f-d00ce8a86df6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:24.851639 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c04ba99c-0de6-4203-a79f-d00ce8a86df6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:24.880298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c04ba99c-0de6-4203-a79f-d00ce8a86df6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Aug 01 15:42:24.880844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 646/1211] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:24 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:25.175358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-53312f71-ff15-4485-9815-9e2a79786f71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:25.175946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-53312f71-ff15-4485-9815-9e2a79786f71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:25.182412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53312f71-ff15-4485-9815-9e2a79786f71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:25.182860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53312f71-ff15-4485-9815-9e2a79786f71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:25.183612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53312f71-ff15-4485-9815-9e2a79786f71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:25.184045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53312f71-ff15-4485-9815-9e2a79786f71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:25.314740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-53312f71-ff15-4485-9815-9e2a79786f71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:25.322606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-53312f71-ff15-4485-9815-9e2a79786f71 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151208 Aug 01 15:42:25.323172 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 566/1212] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:25 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:25.730094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-612932d2-9759-4029-bad7-54ea8e372b2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:25.732236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-612932d2-9759-4029-bad7-54ea8e372b2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:25.739137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-612932d2-9759-4029-bad7-54ea8e372b2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:25.739583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-612932d2-9759-4029-bad7-54ea8e372b2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:25.740340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-612932d2-9759-4029-bad7-54ea8e372b2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:25.740773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-612932d2-9759-4029-bad7-54ea8e372b2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:25.757025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:25.771445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-612932d2-9759-4029-bad7-54ea8e372b2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045376 Aug 01 15:42:25.772025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 647/1213] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:25 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:25.893685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a04c9a2f-bbdb-4f29-bf1e-3d1005cc1d3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:25.895935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a04c9a2f-bbdb-4f29-bf1e-3d1005cc1d3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:25.902232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a04c9a2f-bbdb-4f29-bf1e-3d1005cc1d3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:25.902684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a04c9a2f-bbdb-4f29-bf1e-3d1005cc1d3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:25.903464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a04c9a2f-bbdb-4f29-bf1e-3d1005cc1d3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:25.903903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a04c9a2f-bbdb-4f29-bf1e-3d1005cc1d3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:25.933769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a04c9a2f-bbdb-4f29-bf1e-3d1005cc1d3b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044596 Aug 01 15:42:25.934363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 567/1214] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:25 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:26.187769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:42:26.188335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:42:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:42:26.345633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ec865315-738d-4cf4-8a83-a1c5e27a2c43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:26.346265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ec865315-738d-4cf4-8a83-a1c5e27a2c43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:26.352441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec865315-738d-4cf4-8a83-a1c5e27a2c43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:26.352896 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec865315-738d-4cf4-8a83-a1c5e27a2c43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:26.353662 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec865315-738d-4cf4-8a83-a1c5e27a2c43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:26.354126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec865315-738d-4cf4-8a83-a1c5e27a2c43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:26.489627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ec865315-738d-4cf4-8a83-a1c5e27a2c43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:26.497102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ec865315-738d-4cf4-8a83-a1c5e27a2c43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155778 Aug 01 15:42:26.497655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 648/1215] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:26 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:26.784988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-850527aa-a581-46bb-beed-2bf9ab4e62e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:26.787189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-850527aa-a581-46bb-beed-2bf9ab4e62e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:26.794221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-850527aa-a581-46bb-beed-2bf9ab4e62e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:26.794675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-850527aa-a581-46bb-beed-2bf9ab4e62e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:26.796101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-850527aa-a581-46bb-beed-2bf9ab4e62e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:26.796552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-850527aa-a581-46bb-beed-2bf9ab4e62e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:26.825510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-850527aa-a581-46bb-beed-2bf9ab4e62e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044574 Aug 01 15:42:26.826092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 568/1216] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:26.946902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a25143f1-d26b-464d-aa10-9b76b55e4b8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:26.949080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a25143f1-d26b-464d-aa10-9b76b55e4b8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:26.955688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a25143f1-d26b-464d-aa10-9b76b55e4b8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:26.956140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a25143f1-d26b-464d-aa10-9b76b55e4b8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:26.956900 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a25143f1-d26b-464d-aa10-9b76b55e4b8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:26.957370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a25143f1-d26b-464d-aa10-9b76b55e4b8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:26.987458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a25143f1-d26b-464d-aa10-9b76b55e4b8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Aug 01 15:42:26.988019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 649/1217] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:26 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:27.518798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a3cb3ae4-ed6c-4d05-9889-35eac8d5a960 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:27.519420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a3cb3ae4-ed6c-4d05-9889-35eac8d5a960 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:27.525573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a3cb3ae4-ed6c-4d05-9889-35eac8d5a960 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:27.526084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a3cb3ae4-ed6c-4d05-9889-35eac8d5a960 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:27.526850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a3cb3ae4-ed6c-4d05-9889-35eac8d5a960 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:27.527288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a3cb3ae4-ed6c-4d05-9889-35eac8d5a960 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:27.656938 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a3cb3ae4-ed6c-4d05-9889-35eac8d5a960 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:27.664632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a3cb3ae4-ed6c-4d05-9889-35eac8d5a960 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.150495 Aug 01 15:42:27.665195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 569/1218] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:27 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:27.837845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-677a201b-2fe5-4d86-9d11-f6c7184aa108 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:27.839930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-677a201b-2fe5-4d86-9d11-f6c7184aa108 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:27.846458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-677a201b-2fe5-4d86-9d11-f6c7184aa108 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:27.846907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-677a201b-2fe5-4d86-9d11-f6c7184aa108 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:27.847666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-677a201b-2fe5-4d86-9d11-f6c7184aa108 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:27.848150 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-677a201b-2fe5-4d86-9d11-f6c7184aa108 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:27.878963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-677a201b-2fe5-4d86-9d11-f6c7184aa108 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045138 Aug 01 15:42:27.879518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 650/1219] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:28.000849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-678d8334-0421-49a6-ab8d-618213036bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:28.003034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-678d8334-0421-49a6-ab8d-618213036bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:28.009421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-678d8334-0421-49a6-ab8d-618213036bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:28.009973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-678d8334-0421-49a6-ab8d-618213036bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:28.010733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-678d8334-0421-49a6-ab8d-618213036bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:28.011166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-678d8334-0421-49a6-ab8d-618213036bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:28.039711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-678d8334-0421-49a6-ab8d-618213036bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Aug 01 15:42:28.040254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 570/1220] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:27 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:28.686161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-23d267e0-c6d7-4f55-92a5-f06dd884f6bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:28.687104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-23d267e0-c6d7-4f55-92a5-f06dd884f6bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:28.693683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23d267e0-c6d7-4f55-92a5-f06dd884f6bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:28.694157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23d267e0-c6d7-4f55-92a5-f06dd884f6bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:28.694926 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23d267e0-c6d7-4f55-92a5-f06dd884f6bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:28.695357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23d267e0-c6d7-4f55-92a5-f06dd884f6bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:28.830583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-23d267e0-c6d7-4f55-92a5-f06dd884f6bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:28.838134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-23d267e0-c6d7-4f55-92a5-f06dd884f6bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155979 Aug 01 15:42:28.838684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 651/1221] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:28 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:28.892138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0714837a-ab15-470f-9b6a-bd6112bd1e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:28.894343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0714837a-ab15-470f-9b6a-bd6112bd1e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:28.900580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0714837a-ab15-470f-9b6a-bd6112bd1e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:28.901030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0714837a-ab15-470f-9b6a-bd6112bd1e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:28.901800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0714837a-ab15-470f-9b6a-bd6112bd1e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:28.902270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0714837a-ab15-470f-9b6a-bd6112bd1e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:28.933638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0714837a-ab15-470f-9b6a-bd6112bd1e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046174 Aug 01 15:42:28.934234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 571/1222] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:29.052038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-35263a39-a40c-4235-b165-30f8140e1865 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:29.054142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-35263a39-a40c-4235-b165-30f8140e1865 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:29.060182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-35263a39-a40c-4235-b165-30f8140e1865 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:29.060628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-35263a39-a40c-4235-b165-30f8140e1865 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:29.062180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-35263a39-a40c-4235-b165-30f8140e1865 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:29.062616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-35263a39-a40c-4235-b165-30f8140e1865 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:29.091811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-35263a39-a40c-4235-b165-30f8140e1865 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Aug 01 15:42:29.092357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 652/1223] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:29 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:29.861060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-10b8321b-6672-43d7-967d-8b1fca956272 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:29.861681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-10b8321b-6672-43d7-967d-8b1fca956272 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:29.868318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10b8321b-6672-43d7-967d-8b1fca956272 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:29.868773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10b8321b-6672-43d7-967d-8b1fca956272 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:29.869545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10b8321b-6672-43d7-967d-8b1fca956272 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:29.870020 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10b8321b-6672-43d7-967d-8b1fca956272 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:29.947305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-49a4bd1a-346e-4f2d-8644-bda9c3f60128 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:29.949734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-49a4bd1a-346e-4f2d-8644-bda9c3f60128 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:29.956505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49a4bd1a-346e-4f2d-8644-bda9c3f60128 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:29.956954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49a4bd1a-346e-4f2d-8644-bda9c3f60128 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:29.957722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49a4bd1a-346e-4f2d-8644-bda9c3f60128 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:29.958186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49a4bd1a-346e-4f2d-8644-bda9c3f60128 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:29.991002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-49a4bd1a-346e-4f2d-8644-bda9c3f60128 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047710 Aug 01 15:42:29.991576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 653/1224] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:42:30.006450 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-10b8321b-6672-43d7-967d-8b1fca956272 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:30.014031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-10b8321b-6672-43d7-967d-8b1fca956272 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.157534 Aug 01 15:42:30.014583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 572/1225] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:29 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:30.104255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2abbe825-c530-4eea-b3bf-07e6bc6fff1d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:30.106444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2abbe825-c530-4eea-b3bf-07e6bc6fff1d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:30.112638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2abbe825-c530-4eea-b3bf-07e6bc6fff1d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:30.113078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2abbe825-c530-4eea-b3bf-07e6bc6fff1d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:30.113833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2abbe825-c530-4eea-b3bf-07e6bc6fff1d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:30.114291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2abbe825-c530-4eea-b3bf-07e6bc6fff1d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:30.142909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2abbe825-c530-4eea-b3bf-07e6bc6fff1d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042528 Aug 01 15:42:30.143459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 654/1226] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:31.004202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9888e955-4f5d-4961-b03b-3847be511200 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:31.006319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9888e955-4f5d-4961-b03b-3847be511200 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:31.012886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9888e955-4f5d-4961-b03b-3847be511200 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:31.013461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9888e955-4f5d-4961-b03b-3847be511200 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:31.014202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9888e955-4f5d-4961-b03b-3847be511200 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:31.014707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9888e955-4f5d-4961-b03b-3847be511200 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:31.035613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2b11a201-9be9-4b11-a82e-e9d3ca78dd39 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:31.036228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2b11a201-9be9-4b11-a82e-e9d3ca78dd39 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:31.038770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=86 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:31.039991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:31.043765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b11a201-9be9-4b11-a82e-e9d3ca78dd39 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:31.044345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b11a201-9be9-4b11-a82e-e9d3ca78dd39 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:31.045800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b11a201-9be9-4b11-a82e-e9d3ca78dd39 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:31.046073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9888e955-4f5d-4961-b03b-3847be511200 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045442 Aug 01 15:42:31.046329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b11a201-9be9-4b11-a82e-e9d3ca78dd39 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:31.046940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 573/1227] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:31.156179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7f1161bf-9039-460f-9d6f-64a269d863fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:31.158572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7f1161bf-9039-460f-9d6f-64a269d863fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:31.164745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f1161bf-9039-460f-9d6f-64a269d863fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:31.165188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f1161bf-9039-460f-9d6f-64a269d863fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:31.165976 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f1161bf-9039-460f-9d6f-64a269d863fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:31.166406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f1161bf-9039-460f-9d6f-64a269d863fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:31.181760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2b11a201-9be9-4b11-a82e-e9d3ca78dd39 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:31.189480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2b11a201-9be9-4b11-a82e-e9d3ca78dd39 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.157869 Aug 01 15:42:31.190074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 655/1228] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:31 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:31.196476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7f1161bf-9039-460f-9d6f-64a269d863fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045148 Aug 01 15:42:31.197035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 574/1229] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:31 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:42:32.059043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-233cd9f0-95e1-4bc6-86a9-8e73ea0b2a90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:32.061710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-233cd9f0-95e1-4bc6-86a9-8e73ea0b2a90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:32.068143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-233cd9f0-95e1-4bc6-86a9-8e73ea0b2a90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:32.068590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-233cd9f0-95e1-4bc6-86a9-8e73ea0b2a90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:32.069363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-233cd9f0-95e1-4bc6-86a9-8e73ea0b2a90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:32.069803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-233cd9f0-95e1-4bc6-86a9-8e73ea0b2a90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:32.099987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-233cd9f0-95e1-4bc6-86a9-8e73ea0b2a90 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044883 Aug 01 15:42:32.100547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 656/1230] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:32.209310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-07f23f1c-5bb3-4973-99e2-ebea4652cc2c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:32.211181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8f39eecb-8c38-4f7b-805d-7e06f15d32dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:32.211410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-07f23f1c-5bb3-4973-99e2-ebea4652cc2c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:32.211825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8f39eecb-8c38-4f7b-805d-7e06f15d32dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:32.219197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-07f23f1c-5bb3-4973-99e2-ebea4652cc2c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:32.219397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f39eecb-8c38-4f7b-805d-7e06f15d32dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:32.219649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f39eecb-8c38-4f7b-805d-7e06f15d32dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:32.219823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-07f23f1c-5bb3-4973-99e2-ebea4652cc2c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:32.220425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-07f23f1c-5bb3-4973-99e2-ebea4652cc2c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:32.220523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f39eecb-8c38-4f7b-805d-7e06f15d32dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:32.220864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-07f23f1c-5bb3-4973-99e2-ebea4652cc2c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:32.220970 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f39eecb-8c38-4f7b-805d-7e06f15d32dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:32.261002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-07f23f1c-5bb3-4973-99e2-ebea4652cc2c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055923 Aug 01 15:42:32.261573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 575/1231] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:32 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:32.355579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8f39eecb-8c38-4f7b-805d-7e06f15d32dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:32.363870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8f39eecb-8c38-4f7b-805d-7e06f15d32dc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156863 Aug 01 15:42:32.364427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 657/1232] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:32 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:42:33.112848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c41d0bcf-a9e8-4816-bedb-604c5032c386 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:33.115137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c41d0bcf-a9e8-4816-bedb-604c5032c386 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:33.121341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c41d0bcf-a9e8-4816-bedb-604c5032c386 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:33.121792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c41d0bcf-a9e8-4816-bedb-604c5032c386 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:33.122597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c41d0bcf-a9e8-4816-bedb-604c5032c386 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:33.123035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c41d0bcf-a9e8-4816-bedb-604c5032c386 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:33.152608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c41d0bcf-a9e8-4816-bedb-604c5032c386 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043665 Aug 01 15:42:33.153165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 576/1233] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:33.274106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6055cc5b-bbd8-4251-aa9a-6b98ed5a085b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:33.276287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6055cc5b-bbd8-4251-aa9a-6b98ed5a085b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:33.282895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6055cc5b-bbd8-4251-aa9a-6b98ed5a085b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:33.283395 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6055cc5b-bbd8-4251-aa9a-6b98ed5a085b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:33.284187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6055cc5b-bbd8-4251-aa9a-6b98ed5a085b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:33.284622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6055cc5b-bbd8-4251-aa9a-6b98ed5a085b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:33.314106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6055cc5b-bbd8-4251-aa9a-6b98ed5a085b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043842 Aug 01 15:42:33.314586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 658/1234] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:33 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:33.385617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4ec3e468-f060-4403-87bb-4f1b309eaeec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:33.386268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4ec3e468-f060-4403-87bb-4f1b309eaeec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:33.392769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ec3e468-f060-4403-87bb-4f1b309eaeec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:33.393215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ec3e468-f060-4403-87bb-4f1b309eaeec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:33.394018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ec3e468-f060-4403-87bb-4f1b309eaeec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:33.394460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ec3e468-f060-4403-87bb-4f1b309eaeec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:33.526478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4ec3e468-f060-4403-87bb-4f1b309eaeec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:33.535257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4ec3e468-f060-4403-87bb-4f1b309eaeec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153405 Aug 01 15:42:33.535835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 577/1235] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:33 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:34.164958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-dfdd9766-60e3-4978-92bc-0bf2cf341ae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:34.167404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-dfdd9766-60e3-4978-92bc-0bf2cf341ae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:34.173462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dfdd9766-60e3-4978-92bc-0bf2cf341ae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:34.173935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dfdd9766-60e3-4978-92bc-0bf2cf341ae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:34.174706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dfdd9766-60e3-4978-92bc-0bf2cf341ae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:34.175177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dfdd9766-60e3-4978-92bc-0bf2cf341ae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:34.204502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-dfdd9766-60e3-4978-92bc-0bf2cf341ae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043421 Aug 01 15:42:34.204958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 659/1236] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:34.327339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c46c7a9e-4522-4565-ac32-8d56beb283e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:34.329497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c46c7a9e-4522-4565-ac32-8d56beb283e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:34.335665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c46c7a9e-4522-4565-ac32-8d56beb283e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:34.336116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c46c7a9e-4522-4565-ac32-8d56beb283e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:34.336886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c46c7a9e-4522-4565-ac32-8d56beb283e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:34.337325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c46c7a9e-4522-4565-ac32-8d56beb283e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:34.366126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c46c7a9e-4522-4565-ac32-8d56beb283e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043486 Aug 01 15:42:34.366675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 578/1237] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:34 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:34.557412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-df52c398-5c69-4133-9ec5-514afd87f739 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:34.558088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-df52c398-5c69-4133-9ec5-514afd87f739 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:34.564982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df52c398-5c69-4133-9ec5-514afd87f739 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:34.565424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df52c398-5c69-4133-9ec5-514afd87f739 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:34.566215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df52c398-5c69-4133-9ec5-514afd87f739 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:34.566647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df52c398-5c69-4133-9ec5-514afd87f739 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:34.699046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-df52c398-5c69-4133-9ec5-514afd87f739 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:34.706563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-df52c398-5c69-4133-9ec5-514afd87f739 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153086 Aug 01 15:42:34.707114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 660/1238] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:34 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:42:35.216146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-20dfc55b-0072-4fd8-bd06-c809e5201265 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:35.219253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-20dfc55b-0072-4fd8-bd06-c809e5201265 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:35.225854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-20dfc55b-0072-4fd8-bd06-c809e5201265 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:35.226335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-20dfc55b-0072-4fd8-bd06-c809e5201265 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:35.227101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-20dfc55b-0072-4fd8-bd06-c809e5201265 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:35.227535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-20dfc55b-0072-4fd8-bd06-c809e5201265 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:35.257082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-20dfc55b-0072-4fd8-bd06-c809e5201265 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044904 Aug 01 15:42:35.257651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 579/1239] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:35.378731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-60ffbd89-4105-429c-a85c-54ae6e32b13c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:35.380891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-60ffbd89-4105-429c-a85c-54ae6e32b13c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:35.387009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60ffbd89-4105-429c-a85c-54ae6e32b13c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:35.387451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60ffbd89-4105-429c-a85c-54ae6e32b13c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:35.388209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60ffbd89-4105-429c-a85c-54ae6e32b13c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:35.389156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60ffbd89-4105-429c-a85c-54ae6e32b13c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:35.418424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-60ffbd89-4105-429c-a85c-54ae6e32b13c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043586 Aug 01 15:42:35.418974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 661/1240] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:35 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:35.728747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8c5ffa77-cdd0-49ca-921e-acaca669c318 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:35.729284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8c5ffa77-cdd0-49ca-921e-acaca669c318 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:35.735487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8c5ffa77-cdd0-49ca-921e-acaca669c318 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:35.735981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8c5ffa77-cdd0-49ca-921e-acaca669c318 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:35.736800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8c5ffa77-cdd0-49ca-921e-acaca669c318 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:35.737284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8c5ffa77-cdd0-49ca-921e-acaca669c318 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:35.870982 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8c5ffa77-cdd0-49ca-921e-acaca669c318 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:35.878576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8c5ffa77-cdd0-49ca-921e-acaca669c318 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153937 Aug 01 15:42:35.879144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 580/1241] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:35 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:36.269975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-920f37cd-787b-489a-ab07-75eb990d46ef tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:36.272112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-920f37cd-787b-489a-ab07-75eb990d46ef tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:36.279055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-920f37cd-787b-489a-ab07-75eb990d46ef tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:36.280124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-920f37cd-787b-489a-ab07-75eb990d46ef tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:36.280896 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-920f37cd-787b-489a-ab07-75eb990d46ef tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:36.281336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-920f37cd-787b-489a-ab07-75eb990d46ef tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:36.310167 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-920f37cd-787b-489a-ab07-75eb990d46ef tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044007 Aug 01 15:42:36.310635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 662/1242] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:36.431030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4e539ebc-695d-401a-93d3-c4fced9f38bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:36.433248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4e539ebc-695d-401a-93d3-c4fced9f38bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:36.440513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e539ebc-695d-401a-93d3-c4fced9f38bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:36.440973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e539ebc-695d-401a-93d3-c4fced9f38bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:36.441745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e539ebc-695d-401a-93d3-c4fced9f38bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:36.442272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e539ebc-695d-401a-93d3-c4fced9f38bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:36.473260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4e539ebc-695d-401a-93d3-c4fced9f38bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046040 Aug 01 15:42:36.473787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 581/1243] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:36 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:36.900730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-442a0c06-d59a-435c-9874-7fdb097a5b42 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:36.901349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-442a0c06-d59a-435c-9874-7fdb097a5b42 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:36.908657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-442a0c06-d59a-435c-9874-7fdb097a5b42 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:36.909107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-442a0c06-d59a-435c-9874-7fdb097a5b42 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:36.909899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-442a0c06-d59a-435c-9874-7fdb097a5b42 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:36.910349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-442a0c06-d59a-435c-9874-7fdb097a5b42 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:37.044558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-442a0c06-d59a-435c-9874-7fdb097a5b42 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:37.052695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-442a0c06-d59a-435c-9874-7fdb097a5b42 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155856 Aug 01 15:42:37.053265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 663/1244] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:36 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:37.322824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d9a77e38-d84d-4f86-b0c3-dad433457891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:37.324915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d9a77e38-d84d-4f86-b0c3-dad433457891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:37.331042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9a77e38-d84d-4f86-b0c3-dad433457891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:37.331483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9a77e38-d84d-4f86-b0c3-dad433457891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:37.332238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9a77e38-d84d-4f86-b0c3-dad433457891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:37.332673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9a77e38-d84d-4f86-b0c3-dad433457891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:37.361984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d9a77e38-d84d-4f86-b0c3-dad433457891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043356 Aug 01 15:42:37.362538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 582/1245] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:37.485456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b33c90b0-fa4d-4bab-8ac6-d01e6c574eb9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:37.487671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b33c90b0-fa4d-4bab-8ac6-d01e6c574eb9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:37.494166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b33c90b0-fa4d-4bab-8ac6-d01e6c574eb9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:37.494615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b33c90b0-fa4d-4bab-8ac6-d01e6c574eb9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:37.495374 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b33c90b0-fa4d-4bab-8ac6-d01e6c574eb9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:37.495808 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b33c90b0-fa4d-4bab-8ac6-d01e6c574eb9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:37.499380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:37.526035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b33c90b0-fa4d-4bab-8ac6-d01e6c574eb9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Aug 01 15:42:37.526581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 664/1246] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:37 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:38.074215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7c680928-5ee2-4da1-b9e2-223e500fb24d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:38.074821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7c680928-5ee2-4da1-b9e2-223e500fb24d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:38.081959 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c680928-5ee2-4da1-b9e2-223e500fb24d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:38.082554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c680928-5ee2-4da1-b9e2-223e500fb24d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:38.083402 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c680928-5ee2-4da1-b9e2-223e500fb24d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:38.083923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c680928-5ee2-4da1-b9e2-223e500fb24d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:38.215749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7c680928-5ee2-4da1-b9e2-223e500fb24d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:38.223537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7c680928-5ee2-4da1-b9e2-223e500fb24d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153257 Aug 01 15:42:38.224097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 583/1247] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:38 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:38.375843 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-72045f30-1bc7-4c5f-8254-6534c7fa989e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:38.378878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-72045f30-1bc7-4c5f-8254-6534c7fa989e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:38.385206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72045f30-1bc7-4c5f-8254-6534c7fa989e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:38.385664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72045f30-1bc7-4c5f-8254-6534c7fa989e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:38.386467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72045f30-1bc7-4c5f-8254-6534c7fa989e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:38.386908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72045f30-1bc7-4c5f-8254-6534c7fa989e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:38.415611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-72045f30-1bc7-4c5f-8254-6534c7fa989e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045022 Aug 01 15:42:38.416174 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 665/1248] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:38.538948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3956e765-3c00-4ad1-9b7f-598865609a49 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:38.540999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3956e765-3c00-4ad1-9b7f-598865609a49 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:38.547654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3956e765-3c00-4ad1-9b7f-598865609a49 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:38.548095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3956e765-3c00-4ad1-9b7f-598865609a49 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:38.548852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3956e765-3c00-4ad1-9b7f-598865609a49 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:38.549280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3956e765-3c00-4ad1-9b7f-598865609a49 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:38.578500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3956e765-3c00-4ad1-9b7f-598865609a49 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043609 Aug 01 15:42:38.579048 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 584/1249] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:38 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:39.244513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a995a280-e891-4463-834d-2bcd23155a04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:39.245066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a995a280-e891-4463-834d-2bcd23155a04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:39.251832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a995a280-e891-4463-834d-2bcd23155a04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:39.252285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a995a280-e891-4463-834d-2bcd23155a04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:39.253031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a995a280-e891-4463-834d-2bcd23155a04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:39.253464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a995a280-e891-4463-834d-2bcd23155a04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:39.381207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a995a280-e891-4463-834d-2bcd23155a04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:39.389329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a995a280-e891-4463-834d-2bcd23155a04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.148342 Aug 01 15:42:39.389907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 666/1250] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:39 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:39.429051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-034a6bbe-2b79-44d9-81be-3ada12b409e8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:39.431263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-034a6bbe-2b79-44d9-81be-3ada12b409e8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:39.438280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-034a6bbe-2b79-44d9-81be-3ada12b409e8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:39.438729 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-034a6bbe-2b79-44d9-81be-3ada12b409e8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:39.439493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-034a6bbe-2b79-44d9-81be-3ada12b409e8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:39.439928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-034a6bbe-2b79-44d9-81be-3ada12b409e8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:39.469789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-034a6bbe-2b79-44d9-81be-3ada12b409e8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044680 Aug 01 15:42:39.470376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 585/1251] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:39.590807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c0749380-62f7-401f-809e-e7a51196540b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:39.593052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c0749380-62f7-401f-809e-e7a51196540b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:39.599493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0749380-62f7-401f-809e-e7a51196540b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:39.599948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0749380-62f7-401f-809e-e7a51196540b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:39.600711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0749380-62f7-401f-809e-e7a51196540b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:39.601171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0749380-62f7-401f-809e-e7a51196540b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:39.629964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c0749380-62f7-401f-809e-e7a51196540b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043149 Aug 01 15:42:39.630519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 667/1252] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:39 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:40.411153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1b64d660-7d6f-486c-84d4-884fbe645aa0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:40.411752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1b64d660-7d6f-486c-84d4-884fbe645aa0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:40.417965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b64d660-7d6f-486c-84d4-884fbe645aa0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:40.418425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b64d660-7d6f-486c-84d4-884fbe645aa0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:40.419222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b64d660-7d6f-486c-84d4-884fbe645aa0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:40.419667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b64d660-7d6f-486c-84d4-884fbe645aa0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:40.481547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-beacb54b-b29a-44fd-8e11-8280816ad2ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:40.484810 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-beacb54b-b29a-44fd-8e11-8280816ad2ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:40.492264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-beacb54b-b29a-44fd-8e11-8280816ad2ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:40.492818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-beacb54b-b29a-44fd-8e11-8280816ad2ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:40.493631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-beacb54b-b29a-44fd-8e11-8280816ad2ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:40.494102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-beacb54b-b29a-44fd-8e11-8280816ad2ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:40.523942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-beacb54b-b29a-44fd-8e11-8280816ad2ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046368 Aug 01 15:42:40.524511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 668/1253] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:42:40.559969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1b64d660-7d6f-486c-84d4-884fbe645aa0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:40.568456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1b64d660-7d6f-486c-84d4-884fbe645aa0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.161213 Aug 01 15:42:40.569041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 586/1254] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:40 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:40.641831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c5c9c9d0-09f1-454f-b1fd-9dd355f1c778 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:40.644023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c5c9c9d0-09f1-454f-b1fd-9dd355f1c778 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:40.650122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5c9c9d0-09f1-454f-b1fd-9dd355f1c778 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:40.650563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5c9c9d0-09f1-454f-b1fd-9dd355f1c778 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:40.651318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5c9c9d0-09f1-454f-b1fd-9dd355f1c778 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:40.651744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5c9c9d0-09f1-454f-b1fd-9dd355f1c778 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:40.680791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c5c9c9d0-09f1-454f-b1fd-9dd355f1c778 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043277 Aug 01 15:42:40.681264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 669/1255] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:40 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:41.536451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fe3be01a-7f56-4be0-81aa-608728971782 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:41.538627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fe3be01a-7f56-4be0-81aa-608728971782 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:41.545756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe3be01a-7f56-4be0-81aa-608728971782 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:41.546289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe3be01a-7f56-4be0-81aa-608728971782 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:41.547028 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe3be01a-7f56-4be0-81aa-608728971782 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:41.547466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe3be01a-7f56-4be0-81aa-608728971782 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:41.577441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fe3be01a-7f56-4be0-81aa-608728971782 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044960 Aug 01 15:42:41.578169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 587/1256] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:41.590616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fa99f106-7da1-43f8-a4ed-574074ec3db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:41.591237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fa99f106-7da1-43f8-a4ed-574074ec3db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:41.598366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa99f106-7da1-43f8-a4ed-574074ec3db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:41.598817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa99f106-7da1-43f8-a4ed-574074ec3db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:41.599586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa99f106-7da1-43f8-a4ed-574074ec3db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:41.600028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa99f106-7da1-43f8-a4ed-574074ec3db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:41.693180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ae3b7b3e-d15f-43fe-acfb-edc3afa891a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:41.695422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ae3b7b3e-d15f-43fe-acfb-edc3afa891a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:41.701670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae3b7b3e-d15f-43fe-acfb-edc3afa891a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:41.702158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae3b7b3e-d15f-43fe-acfb-edc3afa891a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:41.702944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae3b7b3e-d15f-43fe-acfb-edc3afa891a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:41.703387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae3b7b3e-d15f-43fe-acfb-edc3afa891a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:41.733787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fa99f106-7da1-43f8-a4ed-574074ec3db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:41.735523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ae3b7b3e-d15f-43fe-acfb-edc3afa891a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046614 Aug 01 15:42:41.736105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 588/1257] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:42:41.748218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fa99f106-7da1-43f8-a4ed-574074ec3db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.161124 Aug 01 15:42:41.748883 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 670/1258] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:41 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:41.807095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:42:41.807291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:42:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:42:42.590431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-63210dac-90a3-4d7f-a708-bcc3f2925a80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:42.592726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-63210dac-90a3-4d7f-a708-bcc3f2925a80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:42.599716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-63210dac-90a3-4d7f-a708-bcc3f2925a80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:42.600167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-63210dac-90a3-4d7f-a708-bcc3f2925a80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:42.600953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-63210dac-90a3-4d7f-a708-bcc3f2925a80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:42.601391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-63210dac-90a3-4d7f-a708-bcc3f2925a80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:42.630328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-63210dac-90a3-4d7f-a708-bcc3f2925a80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044273 Aug 01 15:42:42.630884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 589/1259] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:42 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:42.748365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-60d47e1d-29b4-4958-88a8-32925209c4f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:42.750601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-60d47e1d-29b4-4958-88a8-32925209c4f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:42.757783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60d47e1d-29b4-4958-88a8-32925209c4f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:42.758377 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60d47e1d-29b4-4958-88a8-32925209c4f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:42.759284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60d47e1d-29b4-4958-88a8-32925209c4f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:42.759783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60d47e1d-29b4-4958-88a8-32925209c4f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:42.770111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9e433d6f-13e3-426a-847c-be4bea1ab57e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:42.770726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9e433d6f-13e3-426a-847c-be4bea1ab57e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:42.776874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e433d6f-13e3-426a-847c-be4bea1ab57e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:42.777320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e433d6f-13e3-426a-847c-be4bea1ab57e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:42.778126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e433d6f-13e3-426a-847c-be4bea1ab57e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:42.778557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e433d6f-13e3-426a-847c-be4bea1ab57e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:42.792321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-60d47e1d-29b4-4958-88a8-32925209c4f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048457 Aug 01 15:42:42.792878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 671/1260] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:42 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:42.793621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:42.915721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9e433d6f-13e3-426a-847c-be4bea1ab57e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:42.923898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9e433d6f-13e3-426a-847c-be4bea1ab57e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.157593 Aug 01 15:42:42.924462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 590/1261] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:42 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:43.644233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0f85262a-c2f6-4247-aeb2-665bf8ea85f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:43.646452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0f85262a-c2f6-4247-aeb2-665bf8ea85f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:43.652653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0f85262a-c2f6-4247-aeb2-665bf8ea85f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:43.653105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0f85262a-c2f6-4247-aeb2-665bf8ea85f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:43.654017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0f85262a-c2f6-4247-aeb2-665bf8ea85f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:43.655049 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0f85262a-c2f6-4247-aeb2-665bf8ea85f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:43.683707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0f85262a-c2f6-4247-aeb2-665bf8ea85f3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043672 Aug 01 15:42:43.684253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 672/1262] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:43.805384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-925783f1-0ffb-46c8-9ec8-9563bffe6d31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:43.807617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-925783f1-0ffb-46c8-9ec8-9563bffe6d31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:43.814387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-925783f1-0ffb-46c8-9ec8-9563bffe6d31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:43.814843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-925783f1-0ffb-46c8-9ec8-9563bffe6d31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:43.815613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-925783f1-0ffb-46c8-9ec8-9563bffe6d31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:43.816053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-925783f1-0ffb-46c8-9ec8-9563bffe6d31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:43.845768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-925783f1-0ffb-46c8-9ec8-9563bffe6d31 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044367 Aug 01 15:42:43.846358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 591/1263] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:43 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:43.946360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-44c7ad30-8159-4b03-b96e-495d71446327 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:43.947125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-44c7ad30-8159-4b03-b96e-495d71446327 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:43.954654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44c7ad30-8159-4b03-b96e-495d71446327 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:43.955056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44c7ad30-8159-4b03-b96e-495d71446327 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:43.955816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44c7ad30-8159-4b03-b96e-495d71446327 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:43.956242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44c7ad30-8159-4b03-b96e-495d71446327 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:44.087041 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-44c7ad30-8159-4b03-b96e-495d71446327 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:44.094861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-44c7ad30-8159-4b03-b96e-495d71446327 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152650 Aug 01 15:42:44.095420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 673/1264] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:43 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:44.696225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8b9024e3-1933-4207-8e34-a08cda2349c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:44.698504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8b9024e3-1933-4207-8e34-a08cda2349c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:44.704826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b9024e3-1933-4207-8e34-a08cda2349c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:44.705267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b9024e3-1933-4207-8e34-a08cda2349c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:44.706063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b9024e3-1933-4207-8e34-a08cda2349c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:44.706496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b9024e3-1933-4207-8e34-a08cda2349c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:44.736032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8b9024e3-1933-4207-8e34-a08cda2349c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043829 Aug 01 15:42:44.736579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 592/1265] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:44.859162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-92044491-8b34-45d6-8eea-63943141b739 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:44.861338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-92044491-8b34-45d6-8eea-63943141b739 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:44.867469 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-92044491-8b34-45d6-8eea-63943141b739 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:44.867921 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-92044491-8b34-45d6-8eea-63943141b739 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:44.868667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-92044491-8b34-45d6-8eea-63943141b739 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:44.869096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-92044491-8b34-45d6-8eea-63943141b739 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:44.897513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-92044491-8b34-45d6-8eea-63943141b739 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042972 Aug 01 15:42:44.898087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 674/1266] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:44 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:45.116476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f530cb30-f155-4eb5-bba0-1ad7123ccfde tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:45.117083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f530cb30-f155-4eb5-bba0-1ad7123ccfde tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:45.123656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f530cb30-f155-4eb5-bba0-1ad7123ccfde tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:45.124097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f530cb30-f155-4eb5-bba0-1ad7123ccfde tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:45.124883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f530cb30-f155-4eb5-bba0-1ad7123ccfde tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:45.125309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f530cb30-f155-4eb5-bba0-1ad7123ccfde tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:45.259312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f530cb30-f155-4eb5-bba0-1ad7123ccfde tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:45.267326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f530cb30-f155-4eb5-bba0-1ad7123ccfde tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154713 Aug 01 15:42:45.267888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 593/1267] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:45 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:45.749137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3837ddf8-4f05-41c7-bde3-ca5b80663d6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:45.751474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3837ddf8-4f05-41c7-bde3-ca5b80663d6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:45.757525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3837ddf8-4f05-41c7-bde3-ca5b80663d6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:45.758003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3837ddf8-4f05-41c7-bde3-ca5b80663d6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:45.758774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3837ddf8-4f05-41c7-bde3-ca5b80663d6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:45.759206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3837ddf8-4f05-41c7-bde3-ca5b80663d6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:45.791155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3837ddf8-4f05-41c7-bde3-ca5b80663d6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046657 Aug 01 15:42:45.791707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 675/1268] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:45.909975 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b836f042-cce5-4e82-b396-c92c9af553fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:45.912163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b836f042-cce5-4e82-b396-c92c9af553fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:45.918639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b836f042-cce5-4e82-b396-c92c9af553fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:45.919085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b836f042-cce5-4e82-b396-c92c9af553fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:45.919848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b836f042-cce5-4e82-b396-c92c9af553fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:45.920815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b836f042-cce5-4e82-b396-c92c9af553fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:45.949805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b836f042-cce5-4e82-b396-c92c9af553fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 Aug 01 15:42:45.950425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 594/1269] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:45 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:46.288737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7ae65bef-3153-45a8-879a-4051556271b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:46.289344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7ae65bef-3153-45a8-879a-4051556271b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:46.296106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ae65bef-3153-45a8-879a-4051556271b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:46.296551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ae65bef-3153-45a8-879a-4051556271b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:46.297318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ae65bef-3153-45a8-879a-4051556271b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:46.297751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ae65bef-3153-45a8-879a-4051556271b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:46.442125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7ae65bef-3153-45a8-879a-4051556271b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:46.449645 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7ae65bef-3153-45a8-879a-4051556271b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.164775 Aug 01 15:42:46.450233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 676/1270] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:46 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:46.803736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bd6d7142-e6f2-4dcb-8ce5-f2dc89b1ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:46.805868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bd6d7142-e6f2-4dcb-8ce5-f2dc89b1ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:46.812546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd6d7142-e6f2-4dcb-8ce5-f2dc89b1ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:46.812994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd6d7142-e6f2-4dcb-8ce5-f2dc89b1ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:46.813761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd6d7142-e6f2-4dcb-8ce5-f2dc89b1ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:46.814221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd6d7142-e6f2-4dcb-8ce5-f2dc89b1ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:46.844529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bd6d7142-e6f2-4dcb-8ce5-f2dc89b1ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044608 Aug 01 15:42:46.845083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 595/1271] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:46.962131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cf0c1ad0-8dc0-41a5-b59c-dac1456987a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:46.964289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cf0c1ad0-8dc0-41a5-b59c-dac1456987a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:46.971082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf0c1ad0-8dc0-41a5-b59c-dac1456987a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:46.971538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf0c1ad0-8dc0-41a5-b59c-dac1456987a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:46.972308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf0c1ad0-8dc0-41a5-b59c-dac1456987a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:46.972747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf0c1ad0-8dc0-41a5-b59c-dac1456987a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:47.002175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cf0c1ad0-8dc0-41a5-b59c-dac1456987a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044055 Aug 01 15:42:47.002727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 677/1272] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:46 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:47.471346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-82286ec6-d088-4593-8005-4f14fc2088b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:47.471941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-82286ec6-d088-4593-8005-4f14fc2088b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:47.478020 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82286ec6-d088-4593-8005-4f14fc2088b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:47.478463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82286ec6-d088-4593-8005-4f14fc2088b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:47.479214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82286ec6-d088-4593-8005-4f14fc2088b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:47.479643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82286ec6-d088-4593-8005-4f14fc2088b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:47.610685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-82286ec6-d088-4593-8005-4f14fc2088b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:47.619161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-82286ec6-d088-4593-8005-4f14fc2088b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151845 Aug 01 15:42:47.619748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 596/1273] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:47 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:47.859174 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3d065d77-df18-49ef-96cb-43b7b994679f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:47.861289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3d065d77-df18-49ef-96cb-43b7b994679f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:47.867449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d065d77-df18-49ef-96cb-43b7b994679f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:47.867903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d065d77-df18-49ef-96cb-43b7b994679f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:47.868753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d065d77-df18-49ef-96cb-43b7b994679f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:47.869265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d065d77-df18-49ef-96cb-43b7b994679f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:47.897727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3d065d77-df18-49ef-96cb-43b7b994679f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044086 Aug 01 15:42:47.898577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 678/1274] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:48.016808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eeac98b1-64d2-4178-8576-2ea792b76c68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:48.019088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eeac98b1-64d2-4178-8576-2ea792b76c68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:48.025981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eeac98b1-64d2-4178-8576-2ea792b76c68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:48.026428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eeac98b1-64d2-4178-8576-2ea792b76c68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:48.027196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eeac98b1-64d2-4178-8576-2ea792b76c68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:48.027627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eeac98b1-64d2-4178-8576-2ea792b76c68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:48.057726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eeac98b1-64d2-4178-8576-2ea792b76c68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045596 Aug 01 15:42:48.058315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 597/1275] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:48 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:48.641687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f0513c92-df3c-4ec9-89ed-0c382ff0919b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:48.642344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f0513c92-df3c-4ec9-89ed-0c382ff0919b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:48.648989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f0513c92-df3c-4ec9-89ed-0c382ff0919b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:48.649443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f0513c92-df3c-4ec9-89ed-0c382ff0919b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:48.650262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f0513c92-df3c-4ec9-89ed-0c382ff0919b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:48.650706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f0513c92-df3c-4ec9-89ed-0c382ff0919b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:48.795062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f0513c92-df3c-4ec9-89ed-0c382ff0919b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:48.803192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f0513c92-df3c-4ec9-89ed-0c382ff0919b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.166022 Aug 01 15:42:48.803887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 679/1276] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:48 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:48.910506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-752f2e7a-3071-4b11-be9e-6604f32dece0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:48.912559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-752f2e7a-3071-4b11-be9e-6604f32dece0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:48.918670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-752f2e7a-3071-4b11-be9e-6604f32dece0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:48.919116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-752f2e7a-3071-4b11-be9e-6604f32dece0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:48.919872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-752f2e7a-3071-4b11-be9e-6604f32dece0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:48.920874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-752f2e7a-3071-4b11-be9e-6604f32dece0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:48.950966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-752f2e7a-3071-4b11-be9e-6604f32dece0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044447 Aug 01 15:42:48.951533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 598/1277] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:49.071605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9efa8005-79af-48fe-9dc2-ca1b0505dc45 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:49.073780 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9efa8005-79af-48fe-9dc2-ca1b0505dc45 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:49.079977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9efa8005-79af-48fe-9dc2-ca1b0505dc45 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:49.080433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9efa8005-79af-48fe-9dc2-ca1b0505dc45 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:49.081200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9efa8005-79af-48fe-9dc2-ca1b0505dc45 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:49.081641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9efa8005-79af-48fe-9dc2-ca1b0505dc45 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:49.106267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:49.111638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9efa8005-79af-48fe-9dc2-ca1b0505dc45 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044341 Aug 01 15:42:49.112254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 680/1278] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:49.825044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9aa2d2a1-9004-485c-b873-ac0a3dc9b820 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:49.825689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9aa2d2a1-9004-485c-b873-ac0a3dc9b820 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:49.832310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aa2d2a1-9004-485c-b873-ac0a3dc9b820 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:49.832761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aa2d2a1-9004-485c-b873-ac0a3dc9b820 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:49.833533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aa2d2a1-9004-485c-b873-ac0a3dc9b820 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:49.834025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aa2d2a1-9004-485c-b873-ac0a3dc9b820 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:49.963034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9aa2d2a1-9004-485c-b873-ac0a3dc9b820 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:49.963788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f9117ba3-d769-415f-a982-6fd7ce7ccc2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:49.965978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f9117ba3-d769-415f-a982-6fd7ce7ccc2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:49.971743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9aa2d2a1-9004-485c-b873-ac0a3dc9b820 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.150584 Aug 01 15:42:49.972327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 599/1279] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:49 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:49.973228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f9117ba3-d769-415f-a982-6fd7ce7ccc2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:49.973684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f9117ba3-d769-415f-a982-6fd7ce7ccc2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:49.974520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f9117ba3-d769-415f-a982-6fd7ce7ccc2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:49.974953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f9117ba3-d769-415f-a982-6fd7ce7ccc2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:50.004627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f9117ba3-d769-415f-a982-6fd7ce7ccc2b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044781 Aug 01 15:42:50.005180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 681/1280] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:50.124402 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8a57e11f-e8be-4c2e-a32c-a605716b3e95 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:50.126623 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8a57e11f-e8be-4c2e-a32c-a605716b3e95 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:50.132692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a57e11f-e8be-4c2e-a32c-a605716b3e95 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:50.133149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a57e11f-e8be-4c2e-a32c-a605716b3e95 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:50.133945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a57e11f-e8be-4c2e-a32c-a605716b3e95 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:50.134385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a57e11f-e8be-4c2e-a32c-a605716b3e95 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:50.163620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8a57e11f-e8be-4c2e-a32c-a605716b3e95 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043722 Aug 01 15:42:50.164179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 600/1281] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:50 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:50.993599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d75f6374-fb0e-4299-9acc-8bf1299ca1eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:50.994275 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d75f6374-fb0e-4299-9acc-8bf1299ca1eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:51.000820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d75f6374-fb0e-4299-9acc-8bf1299ca1eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:51.001270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d75f6374-fb0e-4299-9acc-8bf1299ca1eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:51.002076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d75f6374-fb0e-4299-9acc-8bf1299ca1eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:51.002519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d75f6374-fb0e-4299-9acc-8bf1299ca1eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:51.017315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-73dff3b1-bf3f-41c3-ba1e-6cd2c4291c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:51.019580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-73dff3b1-bf3f-41c3-ba1e-6cd2c4291c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:51.026038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73dff3b1-bf3f-41c3-ba1e-6cd2c4291c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:51.026482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73dff3b1-bf3f-41c3-ba1e-6cd2c4291c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:51.028347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73dff3b1-bf3f-41c3-ba1e-6cd2c4291c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:51.028347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73dff3b1-bf3f-41c3-ba1e-6cd2c4291c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:51.064203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-73dff3b1-bf3f-41c3-ba1e-6cd2c4291c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051314 Aug 01 15:42:51.064995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 601/1282] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:42:51.137852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d75f6374-fb0e-4299-9acc-8bf1299ca1eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:51.146034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d75f6374-fb0e-4299-9acc-8bf1299ca1eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156356 Aug 01 15:42:51.146563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 682/1283] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:50 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:51.176017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2d19fe36-5dd5-4b59-885f-bbbdda56b364 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:51.178210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2d19fe36-5dd5-4b59-885f-bbbdda56b364 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:51.184297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d19fe36-5dd5-4b59-885f-bbbdda56b364 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:51.184750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d19fe36-5dd5-4b59-885f-bbbdda56b364 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:51.185520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d19fe36-5dd5-4b59-885f-bbbdda56b364 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:51.185988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d19fe36-5dd5-4b59-885f-bbbdda56b364 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:51.214953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2d19fe36-5dd5-4b59-885f-bbbdda56b364 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043011 Aug 01 15:42:51.215502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 602/1284] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:51 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:52.077108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-42e713a4-ab70-43c9-bfe1-0b67e602756a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:52.079325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-42e713a4-ab70-43c9-bfe1-0b67e602756a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:52.086082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42e713a4-ab70-43c9-bfe1-0b67e602756a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:52.086540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42e713a4-ab70-43c9-bfe1-0b67e602756a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:52.087319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42e713a4-ab70-43c9-bfe1-0b67e602756a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:52.087758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42e713a4-ab70-43c9-bfe1-0b67e602756a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:52.119297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-42e713a4-ab70-43c9-bfe1-0b67e602756a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046227 Aug 01 15:42:52.119862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 683/1285] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:52.168044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b04dc3d4-e7d3-44fa-b71c-bb032ed47aa6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:52.168858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b04dc3d4-e7d3-44fa-b71c-bb032ed47aa6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:52.172153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=86 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:52.177533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b04dc3d4-e7d3-44fa-b71c-bb032ed47aa6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:52.178004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b04dc3d4-e7d3-44fa-b71c-bb032ed47aa6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:52.178800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b04dc3d4-e7d3-44fa-b71c-bb032ed47aa6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:52.179243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b04dc3d4-e7d3-44fa-b71c-bb032ed47aa6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:52.228217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d90d5348-e13c-491a-9950-b1ee7b995473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:52.230336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d90d5348-e13c-491a-9950-b1ee7b995473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:52.237244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d90d5348-e13c-491a-9950-b1ee7b995473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:52.237725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d90d5348-e13c-491a-9950-b1ee7b995473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:52.238524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d90d5348-e13c-491a-9950-b1ee7b995473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:52.238965 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d90d5348-e13c-491a-9950-b1ee7b995473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:52.268687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d90d5348-e13c-491a-9950-b1ee7b995473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044504 Aug 01 15:42:52.269267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 684/1286] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:52 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:42:52.384303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b04dc3d4-e7d3-44fa-b71c-bb032ed47aa6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:52.391931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b04dc3d4-e7d3-44fa-b71c-bb032ed47aa6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.227772 Aug 01 15:42:52.392541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 603/1287] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:52 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:53.131625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-44b27a58-59df-4a11-a129-3b8e3877a4fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:53.133840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-44b27a58-59df-4a11-a129-3b8e3877a4fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:53.140889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44b27a58-59df-4a11-a129-3b8e3877a4fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:53.141338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44b27a58-59df-4a11-a129-3b8e3877a4fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:53.142135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44b27a58-59df-4a11-a129-3b8e3877a4fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:53.142572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44b27a58-59df-4a11-a129-3b8e3877a4fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:53.171229 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-44b27a58-59df-4a11-a129-3b8e3877a4fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043624 Aug 01 15:42:53.171783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 685/1288] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:53.280961 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-06f5284a-d1e3-431b-a9da-b485a90a2f63 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:53.283137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-06f5284a-d1e3-431b-a9da-b485a90a2f63 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:53.289711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06f5284a-d1e3-431b-a9da-b485a90a2f63 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:53.290198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06f5284a-d1e3-431b-a9da-b485a90a2f63 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:53.290972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06f5284a-d1e3-431b-a9da-b485a90a2f63 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:53.291412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06f5284a-d1e3-431b-a9da-b485a90a2f63 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:53.321142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-06f5284a-d1e3-431b-a9da-b485a90a2f63 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044195 Aug 01 15:42:53.321695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 604/1289] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:53 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:53.415119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-51d7d87f-b406-49b2-929d-22fc538ef380 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:53.415736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-51d7d87f-b406-49b2-929d-22fc538ef380 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:53.422263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-51d7d87f-b406-49b2-929d-22fc538ef380 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:53.422716 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-51d7d87f-b406-49b2-929d-22fc538ef380 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:53.423477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-51d7d87f-b406-49b2-929d-22fc538ef380 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:53.423918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-51d7d87f-b406-49b2-929d-22fc538ef380 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:53.558347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-51d7d87f-b406-49b2-929d-22fc538ef380 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:53.566659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-51d7d87f-b406-49b2-929d-22fc538ef380 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155317 Aug 01 15:42:53.567218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 686/1290] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:53 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:54.183713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bf82dc52-c6c0-46c0-bd3f-8cd5546f3676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:54.186523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bf82dc52-c6c0-46c0-bd3f-8cd5546f3676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:54.192753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf82dc52-c6c0-46c0-bd3f-8cd5546f3676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:54.193127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf82dc52-c6c0-46c0-bd3f-8cd5546f3676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:54.193905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf82dc52-c6c0-46c0-bd3f-8cd5546f3676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:54.194439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf82dc52-c6c0-46c0-bd3f-8cd5546f3676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:54.223890 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bf82dc52-c6c0-46c0-bd3f-8cd5546f3676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044112 Aug 01 15:42:54.224375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 605/1291] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:54.333620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f5216097-ada1-48d8-bb45-a069503605b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:54.335815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f5216097-ada1-48d8-bb45-a069503605b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:54.342568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f5216097-ada1-48d8-bb45-a069503605b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:54.343030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f5216097-ada1-48d8-bb45-a069503605b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:54.344052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f5216097-ada1-48d8-bb45-a069503605b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:54.344495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f5216097-ada1-48d8-bb45-a069503605b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:54.374405 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f5216097-ada1-48d8-bb45-a069503605b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Aug 01 15:42:54.374954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 687/1292] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:54 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:54.588448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e8a44a63-cf12-4f31-b08f-2731a3928fe9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:54.588971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e8a44a63-cf12-4f31-b08f-2731a3928fe9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:54.595823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8a44a63-cf12-4f31-b08f-2731a3928fe9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:54.596275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8a44a63-cf12-4f31-b08f-2731a3928fe9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:54.597045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8a44a63-cf12-4f31-b08f-2731a3928fe9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:54.597490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8a44a63-cf12-4f31-b08f-2731a3928fe9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:54.727227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e8a44a63-cf12-4f31-b08f-2731a3928fe9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:54.735101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e8a44a63-cf12-4f31-b08f-2731a3928fe9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.150626 Aug 01 15:42:54.735675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 606/1293] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:54 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:55.236245 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9028089a-d4e3-4b69-aa5c-1b40211abe13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:55.238458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9028089a-d4e3-4b69-aa5c-1b40211abe13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:55.244520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9028089a-d4e3-4b69-aa5c-1b40211abe13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:55.244969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9028089a-d4e3-4b69-aa5c-1b40211abe13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:55.245737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9028089a-d4e3-4b69-aa5c-1b40211abe13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:55.246201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9028089a-d4e3-4b69-aa5c-1b40211abe13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:55.275728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9028089a-d4e3-4b69-aa5c-1b40211abe13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043459 Aug 01 15:42:55.276303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 688/1294] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:55.386935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-65a03256-2d47-406a-b365-523fc5309cde tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:55.389828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-65a03256-2d47-406a-b365-523fc5309cde tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:55.395911 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65a03256-2d47-406a-b365-523fc5309cde tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:55.396357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65a03256-2d47-406a-b365-523fc5309cde tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:55.397122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65a03256-2d47-406a-b365-523fc5309cde tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:55.397558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65a03256-2d47-406a-b365-523fc5309cde tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:55.399939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:42:55.426365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-65a03256-2d47-406a-b365-523fc5309cde tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043337 Aug 01 15:42:55.426927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 607/1295] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:55 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:55.757445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ec425439-e86f-4fab-bdd9-5b0c0187426e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:55.758090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ec425439-e86f-4fab-bdd9-5b0c0187426e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:55.764712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec425439-e86f-4fab-bdd9-5b0c0187426e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:55.765163 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec425439-e86f-4fab-bdd9-5b0c0187426e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:55.766107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec425439-e86f-4fab-bdd9-5b0c0187426e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:55.766400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec425439-e86f-4fab-bdd9-5b0c0187426e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:55.903588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ec425439-e86f-4fab-bdd9-5b0c0187426e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:55.911902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ec425439-e86f-4fab-bdd9-5b0c0187426e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158632 Aug 01 15:42:55.912471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 689/1296] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:55 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:56.287996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-475491c8-6cdd-43c2-aa98-980fb93cc708 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:56.290203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-475491c8-6cdd-43c2-aa98-980fb93cc708 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:56.300524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-475491c8-6cdd-43c2-aa98-980fb93cc708 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:56.300971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-475491c8-6cdd-43c2-aa98-980fb93cc708 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:56.301750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-475491c8-6cdd-43c2-aa98-980fb93cc708 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:56.302214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-475491c8-6cdd-43c2-aa98-980fb93cc708 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:56.331526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-475491c8-6cdd-43c2-aa98-980fb93cc708 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047465 Aug 01 15:42:56.332006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 608/1297] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:56.438587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b525c467-28aa-4b1a-9061-4ccf9f7ad0ce tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:56.440795 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b525c467-28aa-4b1a-9061-4ccf9f7ad0ce tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:56.446840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b525c467-28aa-4b1a-9061-4ccf9f7ad0ce tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:56.447281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b525c467-28aa-4b1a-9061-4ccf9f7ad0ce tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:56.448037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b525c467-28aa-4b1a-9061-4ccf9f7ad0ce tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:56.448473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b525c467-28aa-4b1a-9061-4ccf9f7ad0ce tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:56.478092 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b525c467-28aa-4b1a-9061-4ccf9f7ad0ce tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043565 Aug 01 15:42:56.478633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 690/1298] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:56 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:42:56.493696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:42:56.493862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:42:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:42:56.933735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f88693b1-0e0e-49f0-8a63-5d2c06ef22e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:56.934404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f88693b1-0e0e-49f0-8a63-5d2c06ef22e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:56.941203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f88693b1-0e0e-49f0-8a63-5d2c06ef22e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:56.941646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f88693b1-0e0e-49f0-8a63-5d2c06ef22e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:56.942435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f88693b1-0e0e-49f0-8a63-5d2c06ef22e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:56.942980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f88693b1-0e0e-49f0-8a63-5d2c06ef22e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:57.074364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f88693b1-0e0e-49f0-8a63-5d2c06ef22e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:57.081963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f88693b1-0e0e-49f0-8a63-5d2c06ef22e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152146 Aug 01 15:42:57.082627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 609/1299] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:56 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:57.344338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d5ee44b8-ed39-486a-b983-61b50070c70f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:57.346440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d5ee44b8-ed39-486a-b983-61b50070c70f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:57.353049 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5ee44b8-ed39-486a-b983-61b50070c70f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:57.353499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5ee44b8-ed39-486a-b983-61b50070c70f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:57.354292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5ee44b8-ed39-486a-b983-61b50070c70f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:57.354756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5ee44b8-ed39-486a-b983-61b50070c70f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:57.384451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d5ee44b8-ed39-486a-b983-61b50070c70f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044568 Aug 01 15:42:57.384997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 691/1300] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:57.490971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dd7b1bcb-fd9a-4233-9e0d-fd8c431933b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:57.493130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dd7b1bcb-fd9a-4233-9e0d-fd8c431933b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:57.499757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd7b1bcb-fd9a-4233-9e0d-fd8c431933b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:57.500209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd7b1bcb-fd9a-4233-9e0d-fd8c431933b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:57.500971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd7b1bcb-fd9a-4233-9e0d-fd8c431933b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:57.501410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd7b1bcb-fd9a-4233-9e0d-fd8c431933b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:57.532121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dd7b1bcb-fd9a-4233-9e0d-fd8c431933b5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045135 Aug 01 15:42:57.532677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 610/1301] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:57 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:58.103357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2265363d-9908-411d-8634-e846b4268d22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:58.104271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2265363d-9908-411d-8634-e846b4268d22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:58.110464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2265363d-9908-411d-8634-e846b4268d22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:58.110923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2265363d-9908-411d-8634-e846b4268d22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:58.111696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2265363d-9908-411d-8634-e846b4268d22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:58.112139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2265363d-9908-411d-8634-e846b4268d22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:58.244556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2265363d-9908-411d-8634-e846b4268d22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:58.252880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2265363d-9908-411d-8634-e846b4268d22 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153305 Aug 01 15:42:58.253435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 692/1302] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:58 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:58.396837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-431b957a-cd98-471e-ae28-dacf71a338b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:58.398925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-431b957a-cd98-471e-ae28-dacf71a338b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:58.405438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-431b957a-cd98-471e-ae28-dacf71a338b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:58.405908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-431b957a-cd98-471e-ae28-dacf71a338b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:58.406670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-431b957a-cd98-471e-ae28-dacf71a338b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:58.407105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-431b957a-cd98-471e-ae28-dacf71a338b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:58.441383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-431b957a-cd98-471e-ae28-dacf71a338b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048570 Aug 01 15:42:58.441980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 611/1303] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:58.544328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2e32b900-be7e-424a-82b7-eb34b82e5b0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:58.546582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2e32b900-be7e-424a-82b7-eb34b82e5b0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:58.553017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2e32b900-be7e-424a-82b7-eb34b82e5b0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:58.553458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2e32b900-be7e-424a-82b7-eb34b82e5b0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:58.554237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2e32b900-be7e-424a-82b7-eb34b82e5b0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:58.554664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2e32b900-be7e-424a-82b7-eb34b82e5b0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:58.583580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2e32b900-be7e-424a-82b7-eb34b82e5b0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043234 Aug 01 15:42:58.584122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 693/1304] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:58 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:42:59.273468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-75b4deb1-9c1f-4953-a03a-6af6ab61a718 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:59.274097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-75b4deb1-9c1f-4953-a03a-6af6ab61a718 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:59.280601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75b4deb1-9c1f-4953-a03a-6af6ab61a718 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:59.281038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75b4deb1-9c1f-4953-a03a-6af6ab61a718 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:59.281789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75b4deb1-9c1f-4953-a03a-6af6ab61a718 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:59.282249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75b4deb1-9c1f-4953-a03a-6af6ab61a718 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:59.411396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-75b4deb1-9c1f-4953-a03a-6af6ab61a718 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:42:59.418946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-75b4deb1-9c1f-4953-a03a-6af6ab61a718 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.149329 Aug 01 15:42:59.419507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 612/1305] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:42:59 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:42:59.453669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-924d01de-c6d4-465a-925a-6f454e42551c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:59.455833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-924d01de-c6d4-465a-925a-6f454e42551c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:59.462061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-924d01de-c6d4-465a-925a-6f454e42551c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:59.462517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-924d01de-c6d4-465a-925a-6f454e42551c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:59.463285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-924d01de-c6d4-465a-925a-6f454e42551c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:59.463720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-924d01de-c6d4-465a-925a-6f454e42551c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:59.493020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-924d01de-c6d4-465a-925a-6f454e42551c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043322 Aug 01 15:42:59.493560 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 694/1306] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:42:59 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:42:59.595627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cce1f147-e9a4-486a-8b08-9de81c3e0f8f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:42:59.597790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cce1f147-e9a4-486a-8b08-9de81c3e0f8f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:42:59.603852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cce1f147-e9a4-486a-8b08-9de81c3e0f8f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:59.604302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cce1f147-e9a4-486a-8b08-9de81c3e0f8f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:59.605068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cce1f147-e9a4-486a-8b08-9de81c3e0f8f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:42:59.605507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cce1f147-e9a4-486a-8b08-9de81c3e0f8f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:42:59.635225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cce1f147-e9a4-486a-8b08-9de81c3e0f8f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Aug 01 15:42:59.635794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 613/1307] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:42:59 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:00.441308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0edb222d-336e-4787-997d-2de19c3f26fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:00.442026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0edb222d-336e-4787-997d-2de19c3f26fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:00.448565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0edb222d-336e-4787-997d-2de19c3f26fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:00.449010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0edb222d-336e-4787-997d-2de19c3f26fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:00.449766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0edb222d-336e-4787-997d-2de19c3f26fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:00.450369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0edb222d-336e-4787-997d-2de19c3f26fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:00.506132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cb1018f1-84df-4f1c-a428-6745b6945669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:00.508342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cb1018f1-84df-4f1c-a428-6745b6945669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:00.514965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cb1018f1-84df-4f1c-a428-6745b6945669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:00.515412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cb1018f1-84df-4f1c-a428-6745b6945669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:00.516187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cb1018f1-84df-4f1c-a428-6745b6945669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:00.516622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cb1018f1-84df-4f1c-a428-6745b6945669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:00.547312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cb1018f1-84df-4f1c-a428-6745b6945669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045701 Aug 01 15:43:00.547889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 614/1308] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:43:00.582374 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0edb222d-336e-4787-997d-2de19c3f26fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:00.590017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0edb222d-336e-4787-997d-2de19c3f26fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153229 Aug 01 15:43:00.590578 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 695/1309] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:00 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:00.647274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cf0a8f31-0298-46c1-a91f-2691679e99c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:00.649457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cf0a8f31-0298-46c1-a91f-2691679e99c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:00.656025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf0a8f31-0298-46c1-a91f-2691679e99c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:00.656472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf0a8f31-0298-46c1-a91f-2691679e99c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:00.657245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf0a8f31-0298-46c1-a91f-2691679e99c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:00.657683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf0a8f31-0298-46c1-a91f-2691679e99c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:00.687386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cf0a8f31-0298-46c1-a91f-2691679e99c6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 Aug 01 15:43:00.687952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 615/1310] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:00 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:01.559442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-96d9bfb0-b870-4e9c-b799-d674326de241 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:01.562269 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-96d9bfb0-b870-4e9c-b799-d674326de241 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:01.564586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=82 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:01.569597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96d9bfb0-b870-4e9c-b799-d674326de241 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:01.570090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96d9bfb0-b870-4e9c-b799-d674326de241 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:01.570851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96d9bfb0-b870-4e9c-b799-d674326de241 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:01.571288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96d9bfb0-b870-4e9c-b799-d674326de241 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:01.605347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-96d9bfb0-b870-4e9c-b799-d674326de241 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049866 Aug 01 15:43:01.605919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 696/1311] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:01.612342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-81a4440a-7bc8-4006-8dc2-864b02effcea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:01.612949 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-81a4440a-7bc8-4006-8dc2-864b02effcea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:01.619490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-81a4440a-7bc8-4006-8dc2-864b02effcea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:01.619931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-81a4440a-7bc8-4006-8dc2-864b02effcea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:01.620682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-81a4440a-7bc8-4006-8dc2-864b02effcea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:01.621115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-81a4440a-7bc8-4006-8dc2-864b02effcea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:01.700653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-19581804-bb75-4a8d-b6e7-dded25ca1f5e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:01.702972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-19581804-bb75-4a8d-b6e7-dded25ca1f5e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:01.709689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-19581804-bb75-4a8d-b6e7-dded25ca1f5e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:01.710013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-19581804-bb75-4a8d-b6e7-dded25ca1f5e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:01.710783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-19581804-bb75-4a8d-b6e7-dded25ca1f5e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:01.711733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-19581804-bb75-4a8d-b6e7-dded25ca1f5e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:01.731738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:01.751955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-19581804-bb75-4a8d-b6e7-dded25ca1f5e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056150 Aug 01 15:43:01.752543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 697/1312] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:01 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:01.764338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-81a4440a-7bc8-4006-8dc2-864b02effcea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:01.771900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-81a4440a-7bc8-4006-8dc2-864b02effcea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.163313 Aug 01 15:43:01.772461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 616/1313] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:01 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:02.618714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-67cb4b2a-6223-49b8-a404-0be06db71857 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:02.620893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-67cb4b2a-6223-49b8-a404-0be06db71857 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:02.628113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67cb4b2a-6223-49b8-a404-0be06db71857 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:02.628561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67cb4b2a-6223-49b8-a404-0be06db71857 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:02.629332 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67cb4b2a-6223-49b8-a404-0be06db71857 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:02.629765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67cb4b2a-6223-49b8-a404-0be06db71857 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:02.658794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-67cb4b2a-6223-49b8-a404-0be06db71857 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044107 Aug 01 15:43:02.659355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 698/1314] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:02.766216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4f8f1e82-5946-4adc-9f8e-3cdf84fea031 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:02.768423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4f8f1e82-5946-4adc-9f8e-3cdf84fea031 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:02.775095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f8f1e82-5946-4adc-9f8e-3cdf84fea031 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:02.775548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f8f1e82-5946-4adc-9f8e-3cdf84fea031 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:02.776321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f8f1e82-5946-4adc-9f8e-3cdf84fea031 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:02.776760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f8f1e82-5946-4adc-9f8e-3cdf84fea031 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:02.792668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-389f730d-2e1b-4d93-bc46-0cc151e0d4a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:02.793281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-389f730d-2e1b-4d93-bc46-0cc151e0d4a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:02.799504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-389f730d-2e1b-4d93-bc46-0cc151e0d4a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:02.799953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-389f730d-2e1b-4d93-bc46-0cc151e0d4a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:02.800712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-389f730d-2e1b-4d93-bc46-0cc151e0d4a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:02.801151 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-389f730d-2e1b-4d93-bc46-0cc151e0d4a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:02.805970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4f8f1e82-5946-4adc-9f8e-3cdf84fea031 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 01 15:43:02.806550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 617/1315] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:02 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:02.945816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-389f730d-2e1b-4d93-bc46-0cc151e0d4a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:02.954253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-389f730d-2e1b-4d93-bc46-0cc151e0d4a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.165287 Aug 01 15:43:02.954811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 699/1316] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:02 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:43:03.671066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-45885431-c775-466a-bd3d-57af1a6e5a6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:03.673215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-45885431-c775-466a-bd3d-57af1a6e5a6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:03.679471 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45885431-c775-466a-bd3d-57af1a6e5a6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:03.679925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45885431-c775-466a-bd3d-57af1a6e5a6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:03.680696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45885431-c775-466a-bd3d-57af1a6e5a6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:03.681133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45885431-c775-466a-bd3d-57af1a6e5a6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:03.709841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-45885431-c775-466a-bd3d-57af1a6e5a6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043550 Aug 01 15:43:03.710436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 618/1317] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:03.818431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c726fd84-e0ef-4eb5-aad7-93a6950708fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:03.820975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c726fd84-e0ef-4eb5-aad7-93a6950708fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:03.828390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c726fd84-e0ef-4eb5-aad7-93a6950708fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:03.828851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c726fd84-e0ef-4eb5-aad7-93a6950708fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:03.829623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c726fd84-e0ef-4eb5-aad7-93a6950708fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:03.830100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c726fd84-e0ef-4eb5-aad7-93a6950708fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:03.861390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c726fd84-e0ef-4eb5-aad7-93a6950708fe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046994 Aug 01 15:43:03.861983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 700/1318] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:03 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:03.975912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6a9bb0bb-615c-409b-848d-0c2a69579940 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:03.976529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6a9bb0bb-615c-409b-848d-0c2a69579940 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:03.983027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a9bb0bb-615c-409b-848d-0c2a69579940 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:03.983478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a9bb0bb-615c-409b-848d-0c2a69579940 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:03.984256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a9bb0bb-615c-409b-848d-0c2a69579940 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:03.984695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a9bb0bb-615c-409b-848d-0c2a69579940 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:04.120475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6a9bb0bb-615c-409b-848d-0c2a69579940 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:04.128086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6a9bb0bb-615c-409b-848d-0c2a69579940 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156113 Aug 01 15:43:04.128657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 619/1319] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:03 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:04.722754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ef3fc2b8-cddb-4559-b0df-fb5187278369 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:04.724931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ef3fc2b8-cddb-4559-b0df-fb5187278369 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:04.731099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef3fc2b8-cddb-4559-b0df-fb5187278369 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:04.731548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef3fc2b8-cddb-4559-b0df-fb5187278369 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:04.732797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef3fc2b8-cddb-4559-b0df-fb5187278369 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:04.733229 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef3fc2b8-cddb-4559-b0df-fb5187278369 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:04.762164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ef3fc2b8-cddb-4559-b0df-fb5187278369 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043748 Aug 01 15:43:04.762716 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 701/1320] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:04 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:04.876255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3e635975-aa8b-43c3-89a4-7af3d77b6e65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:04.878447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3e635975-aa8b-43c3-89a4-7af3d77b6e65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:04.884755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e635975-aa8b-43c3-89a4-7af3d77b6e65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:04.885694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e635975-aa8b-43c3-89a4-7af3d77b6e65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:04.886926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e635975-aa8b-43c3-89a4-7af3d77b6e65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:04.887298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e635975-aa8b-43c3-89a4-7af3d77b6e65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:04.920364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3e635975-aa8b-43c3-89a4-7af3d77b6e65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049736 Aug 01 15:43:04.920995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 620/1321] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:04 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:43:05.149783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-380698a4-35b6-45d7-9194-9ee22e684d87 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:05.150438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-380698a4-35b6-45d7-9194-9ee22e684d87 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:05.157482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-380698a4-35b6-45d7-9194-9ee22e684d87 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:05.157965 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-380698a4-35b6-45d7-9194-9ee22e684d87 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:05.158735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-380698a4-35b6-45d7-9194-9ee22e684d87 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:05.159173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-380698a4-35b6-45d7-9194-9ee22e684d87 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:05.292470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-380698a4-35b6-45d7-9194-9ee22e684d87 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:05.300062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-380698a4-35b6-45d7-9194-9ee22e684d87 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154131 Aug 01 15:43:05.300622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 702/1322] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:05 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:05.774888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9753dd8e-b4af-4005-8d4b-b1a5ccb33906 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:05.777319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9753dd8e-b4af-4005-8d4b-b1a5ccb33906 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:05.784755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9753dd8e-b4af-4005-8d4b-b1a5ccb33906 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:05.785196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9753dd8e-b4af-4005-8d4b-b1a5ccb33906 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:05.786005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9753dd8e-b4af-4005-8d4b-b1a5ccb33906 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:05.786447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9753dd8e-b4af-4005-8d4b-b1a5ccb33906 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:05.815651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9753dd8e-b4af-4005-8d4b-b1a5ccb33906 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044986 Aug 01 15:43:05.816230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 621/1323] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:05.933144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c1ae852e-c195-400b-a083-022c88571828 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:05.936012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c1ae852e-c195-400b-a083-022c88571828 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:05.942141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1ae852e-c195-400b-a083-022c88571828 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:05.942591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1ae852e-c195-400b-a083-022c88571828 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:05.943354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1ae852e-c195-400b-a083-022c88571828 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:05.943790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1ae852e-c195-400b-a083-022c88571828 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:05.973691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c1ae852e-c195-400b-a083-022c88571828 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044787 Aug 01 15:43:05.974282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 703/1324] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:05 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:06.321372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4c09cc31-2841-4b8b-a3f5-75cba184d28c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:06.321913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4c09cc31-2841-4b8b-a3f5-75cba184d28c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:06.328047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c09cc31-2841-4b8b-a3f5-75cba184d28c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:06.328497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c09cc31-2841-4b8b-a3f5-75cba184d28c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:06.329257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c09cc31-2841-4b8b-a3f5-75cba184d28c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:06.329698 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c09cc31-2841-4b8b-a3f5-75cba184d28c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:06.458853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4c09cc31-2841-4b8b-a3f5-75cba184d28c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:06.466889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4c09cc31-2841-4b8b-a3f5-75cba184d28c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.149011 Aug 01 15:43:06.467461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 622/1325] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:06 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:06.828073 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-56c041a0-8cec-451c-ac95-51a6ba9c12a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:06.830307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-56c041a0-8cec-451c-ac95-51a6ba9c12a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:06.836788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56c041a0-8cec-451c-ac95-51a6ba9c12a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:06.837240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56c041a0-8cec-451c-ac95-51a6ba9c12a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:06.838040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56c041a0-8cec-451c-ac95-51a6ba9c12a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:06.838482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56c041a0-8cec-451c-ac95-51a6ba9c12a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:06.868793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-56c041a0-8cec-451c-ac95-51a6ba9c12a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045288 Aug 01 15:43:06.869346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 704/1326] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:06.986490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-07266259-b66c-448b-b13b-af76a955598e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:06.988769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-07266259-b66c-448b-b13b-af76a955598e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:06.995399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-07266259-b66c-448b-b13b-af76a955598e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:06.995850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-07266259-b66c-448b-b13b-af76a955598e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:06.996618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-07266259-b66c-448b-b13b-af76a955598e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:06.997056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-07266259-b66c-448b-b13b-af76a955598e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:07.022004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:07.027118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-07266259-b66c-448b-b13b-af76a955598e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045105 Aug 01 15:43:07.027685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 623/1327] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:06 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:07.488835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a92427d7-b7c9-45d2-92c0-728e666fe1cb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:07.489449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a92427d7-b7c9-45d2-92c0-728e666fe1cb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:07.495588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a92427d7-b7c9-45d2-92c0-728e666fe1cb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:07.496038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a92427d7-b7c9-45d2-92c0-728e666fe1cb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:07.496809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a92427d7-b7c9-45d2-92c0-728e666fe1cb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:07.497244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a92427d7-b7c9-45d2-92c0-728e666fe1cb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:07.633177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a92427d7-b7c9-45d2-92c0-728e666fe1cb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:07.641220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a92427d7-b7c9-45d2-92c0-728e666fe1cb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156216 Aug 01 15:43:07.642292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 705/1328] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:07 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:07.881583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6c145304-c0a6-4f64-9a90-fa8c19471dd2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:07.883775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6c145304-c0a6-4f64-9a90-fa8c19471dd2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:07.889833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c145304-c0a6-4f64-9a90-fa8c19471dd2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:07.890375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c145304-c0a6-4f64-9a90-fa8c19471dd2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:07.891153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c145304-c0a6-4f64-9a90-fa8c19471dd2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:07.891601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c145304-c0a6-4f64-9a90-fa8c19471dd2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:07.923152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6c145304-c0a6-4f64-9a90-fa8c19471dd2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045689 Aug 01 15:43:07.923796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 624/1329] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:07 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:08.039448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4a72fe10-d7b7-4acc-baf8-3996f1461426 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:08.041590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4a72fe10-d7b7-4acc-baf8-3996f1461426 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:08.048787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a72fe10-d7b7-4acc-baf8-3996f1461426 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:08.049231 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a72fe10-d7b7-4acc-baf8-3996f1461426 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:08.050018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a72fe10-d7b7-4acc-baf8-3996f1461426 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:08.050451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a72fe10-d7b7-4acc-baf8-3996f1461426 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:08.080236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4a72fe10-d7b7-4acc-baf8-3996f1461426 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 Aug 01 15:43:08.080784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 706/1330] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:08 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:08.662803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a777e935-9170-4154-871a-69092afcdb19 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:08.663410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a777e935-9170-4154-871a-69092afcdb19 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:08.670029 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a777e935-9170-4154-871a-69092afcdb19 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:08.670476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a777e935-9170-4154-871a-69092afcdb19 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:08.671242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a777e935-9170-4154-871a-69092afcdb19 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:08.671700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a777e935-9170-4154-871a-69092afcdb19 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:08.803035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a777e935-9170-4154-871a-69092afcdb19 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:08.811191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a777e935-9170-4154-871a-69092afcdb19 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151829 Aug 01 15:43:08.811760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 625/1331] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:08 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:08.936404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-22b6916a-e043-455d-ae34-ae6f15e520d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:08.938697 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-22b6916a-e043-455d-ae34-ae6f15e520d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:08.945357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22b6916a-e043-455d-ae34-ae6f15e520d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:08.945809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22b6916a-e043-455d-ae34-ae6f15e520d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:08.946626 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22b6916a-e043-455d-ae34-ae6f15e520d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:08.947068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22b6916a-e043-455d-ae34-ae6f15e520d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:08.980283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-22b6916a-e043-455d-ae34-ae6f15e520d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048421 Aug 01 15:43:08.980839 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 707/1332] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:09.092612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8aa4a1f9-f482-4acb-bdd5-d42b01d29e86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:09.095062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8aa4a1f9-f482-4acb-bdd5-d42b01d29e86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:09.101179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8aa4a1f9-f482-4acb-bdd5-d42b01d29e86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:09.101634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8aa4a1f9-f482-4acb-bdd5-d42b01d29e86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:09.102423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8aa4a1f9-f482-4acb-bdd5-d42b01d29e86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:09.102873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8aa4a1f9-f482-4acb-bdd5-d42b01d29e86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:09.132107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8aa4a1f9-f482-4acb-bdd5-d42b01d29e86 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043471 Aug 01 15:43:09.132670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 626/1333] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:09 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:09.834681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5ec0b861-a810-4f17-8f49-d233cf17e47e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:09.835334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5ec0b861-a810-4f17-8f49-d233cf17e47e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:09.842836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ec0b861-a810-4f17-8f49-d233cf17e47e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:09.843291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ec0b861-a810-4f17-8f49-d233cf17e47e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:09.844321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ec0b861-a810-4f17-8f49-d233cf17e47e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:09.844757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ec0b861-a810-4f17-8f49-d233cf17e47e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:09.981619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5ec0b861-a810-4f17-8f49-d233cf17e47e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:09.990196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5ec0b861-a810-4f17-8f49-d233cf17e47e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.159260 Aug 01 15:43:09.991014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 708/1334] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:09 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:09.992690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d6c11e70-84ea-4532-86eb-558bade4ec87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:09.994901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d6c11e70-84ea-4532-86eb-558bade4ec87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:10.001406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6c11e70-84ea-4532-86eb-558bade4ec87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:10.001852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6c11e70-84ea-4532-86eb-558bade4ec87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:10.002648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6c11e70-84ea-4532-86eb-558bade4ec87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:10.003115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6c11e70-84ea-4532-86eb-558bade4ec87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:10.039841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d6c11e70-84ea-4532-86eb-558bade4ec87 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051087 Aug 01 15:43:10.040573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 627/1335] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:43:10.145108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6438e53e-43d9-4308-8686-e12ca0de98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:10.147282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6438e53e-43d9-4308-8686-e12ca0de98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:10.153331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6438e53e-43d9-4308-8686-e12ca0de98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:10.153781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6438e53e-43d9-4308-8686-e12ca0de98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:10.154730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6438e53e-43d9-4308-8686-e12ca0de98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:10.155165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6438e53e-43d9-4308-8686-e12ca0de98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:10.184742 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6438e53e-43d9-4308-8686-e12ca0de98a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043781 Aug 01 15:43:10.185301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 709/1336] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:10 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:11.012801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-49f01879-53cc-4023-8bc4-d43ffcd9b50a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:11.013484 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-49f01879-53cc-4023-8bc4-d43ffcd9b50a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:11.020700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49f01879-53cc-4023-8bc4-d43ffcd9b50a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:11.021154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49f01879-53cc-4023-8bc4-d43ffcd9b50a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:11.021947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49f01879-53cc-4023-8bc4-d43ffcd9b50a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:11.022387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49f01879-53cc-4023-8bc4-d43ffcd9b50a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:11.055247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f7f3b9ac-5f97-4f99-9fa4-e1d3ec7f6c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:11.057332 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f7f3b9ac-5f97-4f99-9fa4-e1d3ec7f6c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:11.064580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f7f3b9ac-5f97-4f99-9fa4-e1d3ec7f6c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:11.065035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f7f3b9ac-5f97-4f99-9fa4-e1d3ec7f6c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:11.065810 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f7f3b9ac-5f97-4f99-9fa4-e1d3ec7f6c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:11.066279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f7f3b9ac-5f97-4f99-9fa4-e1d3ec7f6c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:11.096597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f7f3b9ac-5f97-4f99-9fa4-e1d3ec7f6c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045196 Aug 01 15:43:11.097374 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 710/1337] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:11 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:43:11.157210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-49f01879-53cc-4023-8bc4-d43ffcd9b50a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:11.164760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-49f01879-53cc-4023-8bc4-d43ffcd9b50a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156120 Aug 01 15:43:11.165332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 628/1338] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:11 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:11.197792 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8a37bf40-12d2-4645-ad47-56ae39af1f52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:11.199973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8a37bf40-12d2-4645-ad47-56ae39af1f52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:11.205954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8a37bf40-12d2-4645-ad47-56ae39af1f52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:11.206396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8a37bf40-12d2-4645-ad47-56ae39af1f52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:11.207141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8a37bf40-12d2-4645-ad47-56ae39af1f52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:11.207569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8a37bf40-12d2-4645-ad47-56ae39af1f52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:11.237655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8a37bf40-12d2-4645-ad47-56ae39af1f52 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Aug 01 15:43:11.238241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 711/1339] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:11 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:12.109807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d3d43d7d-e1a1-4ec8-809a-4e50f700f1a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:12.112177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d3d43d7d-e1a1-4ec8-809a-4e50f700f1a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:12.119184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3d43d7d-e1a1-4ec8-809a-4e50f700f1a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:12.119635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3d43d7d-e1a1-4ec8-809a-4e50f700f1a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:12.120445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3d43d7d-e1a1-4ec8-809a-4e50f700f1a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:12.120883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3d43d7d-e1a1-4ec8-809a-4e50f700f1a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:12.151429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d3d43d7d-e1a1-4ec8-809a-4e50f700f1a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046268 Aug 01 15:43:12.151993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 629/1340] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:12.187364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5a0c0fd5-c941-430d-ba56-f5fc49422a83 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:12.187987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5a0c0fd5-c941-430d-ba56-f5fc49422a83 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:12.194982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a0c0fd5-c941-430d-ba56-f5fc49422a83 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:12.195434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a0c0fd5-c941-430d-ba56-f5fc49422a83 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:12.196199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a0c0fd5-c941-430d-ba56-f5fc49422a83 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:12.196648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a0c0fd5-c941-430d-ba56-f5fc49422a83 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:12.250717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4ab31af9-d80e-4627-82b1-47cd1b3e86ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:12.253081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4ab31af9-d80e-4627-82b1-47cd1b3e86ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:12.259246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ab31af9-d80e-4627-82b1-47cd1b3e86ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:12.259767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ab31af9-d80e-4627-82b1-47cd1b3e86ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:12.260630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ab31af9-d80e-4627-82b1-47cd1b3e86ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:12.261124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ab31af9-d80e-4627-82b1-47cd1b3e86ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:12.290307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4ab31af9-d80e-4627-82b1-47cd1b3e86ca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Aug 01 15:43:12.290875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 630/1341] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:12 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:12.334154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5a0c0fd5-c941-430d-ba56-f5fc49422a83 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:12.341577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5a0c0fd5-c941-430d-ba56-f5fc49422a83 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158722 Aug 01 15:43:12.342176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 712/1342] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:12 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:13.163937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-290e0f58-9ab2-41dd-a8ed-1a1c1fd01a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:13.166168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-290e0f58-9ab2-41dd-a8ed-1a1c1fd01a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:13.172794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-290e0f58-9ab2-41dd-a8ed-1a1c1fd01a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:13.173252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-290e0f58-9ab2-41dd-a8ed-1a1c1fd01a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:13.174065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-290e0f58-9ab2-41dd-a8ed-1a1c1fd01a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:13.174508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-290e0f58-9ab2-41dd-a8ed-1a1c1fd01a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:13.204918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-290e0f58-9ab2-41dd-a8ed-1a1c1fd01a54 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044973 Aug 01 15:43:13.205483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 631/1343] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:13.303188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2faea095-b6c0-4d50-9635-9e6e37276028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:13.305431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2faea095-b6c0-4d50-9635-9e6e37276028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:13.312513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2faea095-b6c0-4d50-9635-9e6e37276028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:13.312942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2faea095-b6c0-4d50-9635-9e6e37276028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:13.313709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2faea095-b6c0-4d50-9635-9e6e37276028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:13.314173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2faea095-b6c0-4d50-9635-9e6e37276028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:13.345672 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2faea095-b6c0-4d50-9635-9e6e37276028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046050 Aug 01 15:43:13.346253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 713/1344] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:13 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:13.371991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b908818f-6ea7-4fc7-a11c-60e95c9b3e6f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:13.372604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b908818f-6ea7-4fc7-a11c-60e95c9b3e6f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:13.379265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b908818f-6ea7-4fc7-a11c-60e95c9b3e6f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:13.379714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b908818f-6ea7-4fc7-a11c-60e95c9b3e6f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:13.380472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b908818f-6ea7-4fc7-a11c-60e95c9b3e6f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:13.380905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b908818f-6ea7-4fc7-a11c-60e95c9b3e6f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:13.511672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b908818f-6ea7-4fc7-a11c-60e95c9b3e6f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:13.520704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b908818f-6ea7-4fc7-a11c-60e95c9b3e6f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152543 Aug 01 15:43:13.521309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 632/1345] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:13 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:14.218491 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c06d4b74-76a7-462d-93c1-feb10f74980e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:14.220852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c06d4b74-76a7-462d-93c1-feb10f74980e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:14.227123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c06d4b74-76a7-462d-93c1-feb10f74980e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:14.227569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c06d4b74-76a7-462d-93c1-feb10f74980e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:14.228364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c06d4b74-76a7-462d-93c1-feb10f74980e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:14.228795 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c06d4b74-76a7-462d-93c1-feb10f74980e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:14.233250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:14.258185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c06d4b74-76a7-462d-93c1-feb10f74980e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044247 Aug 01 15:43:14.258741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 714/1346] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:14.358889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d4a6bd57-923a-4e4a-b92f-7944bb79caa8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:14.361075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d4a6bd57-923a-4e4a-b92f-7944bb79caa8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:14.367637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d4a6bd57-923a-4e4a-b92f-7944bb79caa8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:14.368087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d4a6bd57-923a-4e4a-b92f-7944bb79caa8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:14.368862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d4a6bd57-923a-4e4a-b92f-7944bb79caa8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:14.369300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d4a6bd57-923a-4e4a-b92f-7944bb79caa8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:14.398549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d4a6bd57-923a-4e4a-b92f-7944bb79caa8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043562 Aug 01 15:43:14.399101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 633/1347] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:14 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:14.542659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1a80d0d5-8706-45aa-a62b-f864bc5c70f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:14.543204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1a80d0d5-8706-45aa-a62b-f864bc5c70f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:14.549677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1a80d0d5-8706-45aa-a62b-f864bc5c70f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:14.550163 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1a80d0d5-8706-45aa-a62b-f864bc5c70f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:14.550931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1a80d0d5-8706-45aa-a62b-f864bc5c70f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:14.551370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1a80d0d5-8706-45aa-a62b-f864bc5c70f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:14.683131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1a80d0d5-8706-45aa-a62b-f864bc5c70f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:14.691325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1a80d0d5-8706-45aa-a62b-f864bc5c70f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152548 Aug 01 15:43:14.691885 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 715/1348] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:14 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:15.271105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3d754349-400c-4450-89e2-06712965057d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:15.273270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3d754349-400c-4450-89e2-06712965057d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:15.280016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d754349-400c-4450-89e2-06712965057d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:15.280458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d754349-400c-4450-89e2-06712965057d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:15.281212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d754349-400c-4450-89e2-06712965057d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:15.281638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d754349-400c-4450-89e2-06712965057d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:15.309911 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3d754349-400c-4450-89e2-06712965057d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042680 Aug 01 15:43:15.310408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 634/1349] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:15.410977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-39e72503-3e2b-4b48-b5b7-f68d0ab6ba6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:15.413177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-39e72503-3e2b-4b48-b5b7-f68d0ab6ba6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:15.419388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39e72503-3e2b-4b48-b5b7-f68d0ab6ba6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:15.419832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39e72503-3e2b-4b48-b5b7-f68d0ab6ba6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:15.420594 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39e72503-3e2b-4b48-b5b7-f68d0ab6ba6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:15.421029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39e72503-3e2b-4b48-b5b7-f68d0ab6ba6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:15.450499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-39e72503-3e2b-4b48-b5b7-f68d0ab6ba6a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043637 Aug 01 15:43:15.452392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 716/1350] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:15 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:15.713267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d0d2dc95-3419-4dce-8f84-4f13b28d890f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:15.713840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d0d2dc95-3419-4dce-8f84-4f13b28d890f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:15.720772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0d2dc95-3419-4dce-8f84-4f13b28d890f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:15.721234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0d2dc95-3419-4dce-8f84-4f13b28d890f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:15.722004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0d2dc95-3419-4dce-8f84-4f13b28d890f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:15.722439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0d2dc95-3419-4dce-8f84-4f13b28d890f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:15.858572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d0d2dc95-3419-4dce-8f84-4f13b28d890f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:15.866209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d0d2dc95-3419-4dce-8f84-4f13b28d890f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156865 Aug 01 15:43:15.866765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 635/1351] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:15 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:16.322346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1b907a0d-24a0-43eb-b239-e1b81f7af5fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:16.324391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1b907a0d-24a0-43eb-b239-e1b81f7af5fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:16.331247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b907a0d-24a0-43eb-b239-e1b81f7af5fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:16.331691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b907a0d-24a0-43eb-b239-e1b81f7af5fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:16.332438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b907a0d-24a0-43eb-b239-e1b81f7af5fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:16.332873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b907a0d-24a0-43eb-b239-e1b81f7af5fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:16.361046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1b907a0d-24a0-43eb-b239-e1b81f7af5fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042773 Aug 01 15:43:16.361589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 717/1352] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:16 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:16.463880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a8a13588-3df8-4401-8f43-2c9fd3c9733e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:16.466081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a8a13588-3df8-4401-8f43-2c9fd3c9733e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:16.472493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8a13588-3df8-4401-8f43-2c9fd3c9733e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:16.472964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8a13588-3df8-4401-8f43-2c9fd3c9733e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:16.473731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8a13588-3df8-4401-8f43-2c9fd3c9733e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:16.474190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8a13588-3df8-4401-8f43-2c9fd3c9733e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:16.503300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a8a13588-3df8-4401-8f43-2c9fd3c9733e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Aug 01 15:43:16.503861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 636/1353] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:16 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:16.887882 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-612f4251-54c0-422a-aedd-be5cc7f4c336 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:16.888503 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-612f4251-54c0-422a-aedd-be5cc7f4c336 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:16.895543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-612f4251-54c0-422a-aedd-be5cc7f4c336 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:16.896029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-612f4251-54c0-422a-aedd-be5cc7f4c336 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:16.896891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-612f4251-54c0-422a-aedd-be5cc7f4c336 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:16.897413 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-612f4251-54c0-422a-aedd-be5cc7f4c336 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:17.041039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-612f4251-54c0-422a-aedd-be5cc7f4c336 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:17.050104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-612f4251-54c0-422a-aedd-be5cc7f4c336 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.165889 Aug 01 15:43:17.050591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 718/1354] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:16 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:17.374243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-daba250c-e2ea-4791-b506-6474453f3e2f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:17.376430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-daba250c-e2ea-4791-b506-6474453f3e2f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:17.383128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-daba250c-e2ea-4791-b506-6474453f3e2f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:17.383582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-daba250c-e2ea-4791-b506-6474453f3e2f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:17.384356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-daba250c-e2ea-4791-b506-6474453f3e2f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:17.384797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-daba250c-e2ea-4791-b506-6474453f3e2f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:17.417617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-daba250c-e2ea-4791-b506-6474453f3e2f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047479 Aug 01 15:43:17.418240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 637/1355] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:43:17.515720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-27f73cc6-b065-45bc-98dc-d121deaff9d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:17.517917 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-27f73cc6-b065-45bc-98dc-d121deaff9d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:17.523960 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27f73cc6-b065-45bc-98dc-d121deaff9d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:17.524409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27f73cc6-b065-45bc-98dc-d121deaff9d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:17.525175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27f73cc6-b065-45bc-98dc-d121deaff9d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:17.525610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27f73cc6-b065-45bc-98dc-d121deaff9d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:17.556536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-27f73cc6-b065-45bc-98dc-d121deaff9d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044906 Aug 01 15:43:17.557087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 719/1356] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:17 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:43:18.072576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4f131295-d345-43fa-80d9-fd0e2a055334 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:18.073199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4f131295-d345-43fa-80d9-fd0e2a055334 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:18.079810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f131295-d345-43fa-80d9-fd0e2a055334 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:18.080269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f131295-d345-43fa-80d9-fd0e2a055334 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:18.081034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f131295-d345-43fa-80d9-fd0e2a055334 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:18.081473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f131295-d345-43fa-80d9-fd0e2a055334 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:18.217468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4f131295-d345-43fa-80d9-fd0e2a055334 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:18.226930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4f131295-d345-43fa-80d9-fd0e2a055334 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158193 Aug 01 15:43:18.227434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 638/1357] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:18 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:18.430498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d8659f3c-1f5a-46db-aadb-d7fc94a01bd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:18.432748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d8659f3c-1f5a-46db-aadb-d7fc94a01bd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:18.440028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d8659f3c-1f5a-46db-aadb-d7fc94a01bd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:18.440478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d8659f3c-1f5a-46db-aadb-d7fc94a01bd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:18.441241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d8659f3c-1f5a-46db-aadb-d7fc94a01bd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:18.441678 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d8659f3c-1f5a-46db-aadb-d7fc94a01bd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:18.471130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d8659f3c-1f5a-46db-aadb-d7fc94a01bd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044690 Aug 01 15:43:18.471694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 720/1358] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:18.569671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2ceeaa5b-3aa8-4e22-b27b-b02012ea17a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:18.571799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2ceeaa5b-3aa8-4e22-b27b-b02012ea17a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:18.579053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ceeaa5b-3aa8-4e22-b27b-b02012ea17a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:18.579509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ceeaa5b-3aa8-4e22-b27b-b02012ea17a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:18.580277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ceeaa5b-3aa8-4e22-b27b-b02012ea17a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:18.580717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ceeaa5b-3aa8-4e22-b27b-b02012ea17a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:18.610453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2ceeaa5b-3aa8-4e22-b27b-b02012ea17a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Aug 01 15:43:18.611128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 639/1359] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:18 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:19.248446 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-60079c00-58f1-4e21-adcd-a9a243f7722c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:19.249042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-60079c00-58f1-4e21-adcd-a9a243f7722c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:19.255128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60079c00-58f1-4e21-adcd-a9a243f7722c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:19.255579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60079c00-58f1-4e21-adcd-a9a243f7722c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:19.256343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60079c00-58f1-4e21-adcd-a9a243f7722c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:19.256781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-60079c00-58f1-4e21-adcd-a9a243f7722c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:19.390086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-60079c00-58f1-4e21-adcd-a9a243f7722c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:19.399772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-60079c00-58f1-4e21-adcd-a9a243f7722c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155145 Aug 01 15:43:19.400345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 721/1360] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:19 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:19.484786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2cd1b1cd-4a56-481a-a6a3-b70effad2c8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:19.487004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2cd1b1cd-4a56-481a-a6a3-b70effad2c8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:19.493078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2cd1b1cd-4a56-481a-a6a3-b70effad2c8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:19.493525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2cd1b1cd-4a56-481a-a6a3-b70effad2c8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:19.494326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2cd1b1cd-4a56-481a-a6a3-b70effad2c8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:19.494759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2cd1b1cd-4a56-481a-a6a3-b70effad2c8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:19.509210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:19.525528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2cd1b1cd-4a56-481a-a6a3-b70effad2c8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045465 Aug 01 15:43:19.526131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 640/1361] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:19.622739 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c04d4fe2-f0d6-41eb-85d7-d44e582d3fa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:19.624929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c04d4fe2-f0d6-41eb-85d7-d44e582d3fa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:19.631440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c04d4fe2-f0d6-41eb-85d7-d44e582d3fa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:19.631893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c04d4fe2-f0d6-41eb-85d7-d44e582d3fa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:19.632661 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c04d4fe2-f0d6-41eb-85d7-d44e582d3fa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:19.633102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c04d4fe2-f0d6-41eb-85d7-d44e582d3fa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:19.662348 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c04d4fe2-f0d6-41eb-85d7-d44e582d3fa4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043521 Aug 01 15:43:19.662899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 722/1362] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:19 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:20.422178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b6085e29-74d0-4beb-9ce6-7ca7913052f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:20.422889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b6085e29-74d0-4beb-9ce6-7ca7913052f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:20.429372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b6085e29-74d0-4beb-9ce6-7ca7913052f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:20.429814 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b6085e29-74d0-4beb-9ce6-7ca7913052f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:20.430625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b6085e29-74d0-4beb-9ce6-7ca7913052f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:20.431058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b6085e29-74d0-4beb-9ce6-7ca7913052f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:20.538898 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-115fb964-2fdc-4db9-9040-d2d2ee63db75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:20.541426 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-115fb964-2fdc-4db9-9040-d2d2ee63db75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:20.548107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-115fb964-2fdc-4db9-9040-d2d2ee63db75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:20.548651 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-115fb964-2fdc-4db9-9040-d2d2ee63db75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:20.549505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-115fb964-2fdc-4db9-9040-d2d2ee63db75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:20.550113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-115fb964-2fdc-4db9-9040-d2d2ee63db75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:20.568459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b6085e29-74d0-4beb-9ce6-7ca7913052f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:20.576564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b6085e29-74d0-4beb-9ce6-7ca7913052f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158364 Aug 01 15:43:20.577133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 641/1363] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:20 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:20.581573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-115fb964-2fdc-4db9-9040-d2d2ee63db75 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046793 Aug 01 15:43:20.582228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 723/1364] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:43:20.674833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0b6af26d-dce6-44f3-88b6-2eea5ed2eadd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:20.676930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0b6af26d-dce6-44f3-88b6-2eea5ed2eadd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:20.683018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b6af26d-dce6-44f3-88b6-2eea5ed2eadd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:20.683488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b6af26d-dce6-44f3-88b6-2eea5ed2eadd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:20.684253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b6af26d-dce6-44f3-88b6-2eea5ed2eadd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:20.684681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b6af26d-dce6-44f3-88b6-2eea5ed2eadd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:20.714475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0b6af26d-dce6-44f3-88b6-2eea5ed2eadd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043648 Aug 01 15:43:20.715024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 642/1365] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:20 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:21.595131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5db97797-eae9-4644-a278-0b582a7a7c4a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:21.597298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5db97797-eae9-4644-a278-0b582a7a7c4a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:21.598388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5c51c083-c866-4c77-ab9e-0033d5d44bdc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:21.599120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5c51c083-c866-4c77-ab9e-0033d5d44bdc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:21.604081 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5db97797-eae9-4644-a278-0b582a7a7c4a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:21.604535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5db97797-eae9-4644-a278-0b582a7a7c4a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:21.605304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5db97797-eae9-4644-a278-0b582a7a7c4a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:21.605659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c51c083-c866-4c77-ab9e-0033d5d44bdc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:21.605772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5db97797-eae9-4644-a278-0b582a7a7c4a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:21.606159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c51c083-c866-4c77-ab9e-0033d5d44bdc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:21.607665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c51c083-c866-4c77-ab9e-0033d5d44bdc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:21.608097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c51c083-c866-4c77-ab9e-0033d5d44bdc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:21.637051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5db97797-eae9-4644-a278-0b582a7a7c4a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046710 Aug 01 15:43:21.637644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 724/1366] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:21.726840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b69fbe9e-49f2-44ca-8c98-f6de4f2dca32 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:21.729019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b69fbe9e-49f2-44ca-8c98-f6de4f2dca32 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:21.736219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b69fbe9e-49f2-44ca-8c98-f6de4f2dca32 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:21.736666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b69fbe9e-49f2-44ca-8c98-f6de4f2dca32 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:21.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b69fbe9e-49f2-44ca-8c98-f6de4f2dca32 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:21.737907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b69fbe9e-49f2-44ca-8c98-f6de4f2dca32 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:21.746335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5c51c083-c866-4c77-ab9e-0033d5d44bdc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:21.754713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5c51c083-c866-4c77-ab9e-0033d5d44bdc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.160093 Aug 01 15:43:21.755311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 643/1367] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:21 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:43:21.770291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b69fbe9e-49f2-44ca-8c98-f6de4f2dca32 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047259 Aug 01 15:43:21.770817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 725/1368] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:21 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:43:22.649330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d6f02d8c-bfdc-4eec-81fa-e6f9334ac55b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:22.651550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d6f02d8c-bfdc-4eec-81fa-e6f9334ac55b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:22.653989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=82 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:22.659453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6f02d8c-bfdc-4eec-81fa-e6f9334ac55b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:22.659902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6f02d8c-bfdc-4eec-81fa-e6f9334ac55b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:22.660676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6f02d8c-bfdc-4eec-81fa-e6f9334ac55b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:22.661300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6f02d8c-bfdc-4eec-81fa-e6f9334ac55b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:22.691360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d6f02d8c-bfdc-4eec-81fa-e6f9334ac55b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046024 Aug 01 15:43:22.691917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 644/1369] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:22 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:22.779241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fff01f10-dd08-488b-a1b6-618f56d0847b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:22.779852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fff01f10-dd08-488b-a1b6-618f56d0847b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:22.782131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f9eb68a1-0913-483d-a741-628849f2b737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:22.784307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f9eb68a1-0913-483d-a741-628849f2b737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:22.787100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fff01f10-dd08-488b-a1b6-618f56d0847b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:22.787544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fff01f10-dd08-488b-a1b6-618f56d0847b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:22.788301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fff01f10-dd08-488b-a1b6-618f56d0847b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:22.788728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fff01f10-dd08-488b-a1b6-618f56d0847b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:22.790378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9eb68a1-0913-483d-a741-628849f2b737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:22.790831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9eb68a1-0913-483d-a741-628849f2b737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:22.791632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9eb68a1-0913-483d-a741-628849f2b737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:22.792068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9eb68a1-0913-483d-a741-628849f2b737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:22.822533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f9eb68a1-0913-483d-a741-628849f2b737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Aug 01 15:43:22.823109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 645/1370] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:22 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:43:22.923693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fff01f10-dd08-488b-a1b6-618f56d0847b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:22.931261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fff01f10-dd08-488b-a1b6-618f56d0847b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155977 Aug 01 15:43:22.931811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 726/1371] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:22 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:23.704568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d35b2340-fdd8-4c22-9045-f164a4c931d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:23.706785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d35b2340-fdd8-4c22-9045-f164a4c931d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:23.713441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d35b2340-fdd8-4c22-9045-f164a4c931d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:23.713916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d35b2340-fdd8-4c22-9045-f164a4c931d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:23.714696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d35b2340-fdd8-4c22-9045-f164a4c931d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:23.715133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d35b2340-fdd8-4c22-9045-f164a4c931d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:23.744456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d35b2340-fdd8-4c22-9045-f164a4c931d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044539 Aug 01 15:43:23.745010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 646/1372] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:23.835003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6cf5d653-94c9-4835-8226-98bdbddef14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:23.837392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6cf5d653-94c9-4835-8226-98bdbddef14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:23.845102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6cf5d653-94c9-4835-8226-98bdbddef14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:23.845554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6cf5d653-94c9-4835-8226-98bdbddef14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:23.846357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6cf5d653-94c9-4835-8226-98bdbddef14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:23.846800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6cf5d653-94c9-4835-8226-98bdbddef14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:23.875863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6cf5d653-94c9-4835-8226-98bdbddef14d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Aug 01 15:43:23.876416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 727/1373] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:23 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:23.953242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d9ed40b2-1004-46b1-94d3-ed0c931ebc21 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:23.953860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d9ed40b2-1004-46b1-94d3-ed0c931ebc21 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:23.960087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9ed40b2-1004-46b1-94d3-ed0c931ebc21 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:23.960482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9ed40b2-1004-46b1-94d3-ed0c931ebc21 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:23.961244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9ed40b2-1004-46b1-94d3-ed0c931ebc21 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:23.961683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9ed40b2-1004-46b1-94d3-ed0c931ebc21 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:24.098696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d9ed40b2-1004-46b1-94d3-ed0c931ebc21 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:24.106366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d9ed40b2-1004-46b1-94d3-ed0c931ebc21 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.157097 Aug 01 15:43:24.106962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 647/1374] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:23 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:24.757449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b0337fb0-7341-41f6-b12d-76314f2abaae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:24.759724 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b0337fb0-7341-41f6-b12d-76314f2abaae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:24.766503 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0337fb0-7341-41f6-b12d-76314f2abaae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:24.766956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0337fb0-7341-41f6-b12d-76314f2abaae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:24.767729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0337fb0-7341-41f6-b12d-76314f2abaae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:24.768167 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0337fb0-7341-41f6-b12d-76314f2abaae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:24.797219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b0337fb0-7341-41f6-b12d-76314f2abaae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043775 Aug 01 15:43:24.797769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 728/1375] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:24.888878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b19e7953-647f-4e70-a2d7-b1e3dffeec1e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:24.891474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b19e7953-647f-4e70-a2d7-b1e3dffeec1e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:24.898239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b19e7953-647f-4e70-a2d7-b1e3dffeec1e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:24.898692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b19e7953-647f-4e70-a2d7-b1e3dffeec1e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:24.899471 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b19e7953-647f-4e70-a2d7-b1e3dffeec1e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:24.899910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b19e7953-647f-4e70-a2d7-b1e3dffeec1e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:24.930140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b19e7953-647f-4e70-a2d7-b1e3dffeec1e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Aug 01 15:43:24.930711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 648/1376] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:24 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:25.127718 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-72ae80d8-7d04-4379-a31c-acf8af6a86ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:25.128330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-72ae80d8-7d04-4379-a31c-acf8af6a86ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:25.134845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72ae80d8-7d04-4379-a31c-acf8af6a86ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:25.135355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72ae80d8-7d04-4379-a31c-acf8af6a86ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:25.136152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72ae80d8-7d04-4379-a31c-acf8af6a86ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:25.136587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72ae80d8-7d04-4379-a31c-acf8af6a86ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:25.285184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-72ae80d8-7d04-4379-a31c-acf8af6a86ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:25.293064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-72ae80d8-7d04-4379-a31c-acf8af6a86ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.169150 Aug 01 15:43:25.293656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 729/1377] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:25 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:25.809711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a4b3299a-f53c-4111-91dd-a3f322e46628 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:25.812595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a4b3299a-f53c-4111-91dd-a3f322e46628 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:25.818841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4b3299a-f53c-4111-91dd-a3f322e46628 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:25.819295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4b3299a-f53c-4111-91dd-a3f322e46628 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:25.820086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4b3299a-f53c-4111-91dd-a3f322e46628 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:25.820521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4b3299a-f53c-4111-91dd-a3f322e46628 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:25.851907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a4b3299a-f53c-4111-91dd-a3f322e46628 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046201 Aug 01 15:43:25.852471 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 649/1378] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:25 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:25.942478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c0ad02f1-25be-4dc1-944b-868e3b79550c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:25.944665 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c0ad02f1-25be-4dc1-944b-868e3b79550c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:25.951009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0ad02f1-25be-4dc1-944b-868e3b79550c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:25.951461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0ad02f1-25be-4dc1-944b-868e3b79550c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:25.952208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0ad02f1-25be-4dc1-944b-868e3b79550c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:25.952643 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0ad02f1-25be-4dc1-944b-868e3b79550c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:25.977988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:25.983671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c0ad02f1-25be-4dc1-944b-868e3b79550c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045191 Aug 01 15:43:25.984227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 730/1379] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:25 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:26.314636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5970d0aa-155c-4c26-afda-b61798a69892 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:26.315307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5970d0aa-155c-4c26-afda-b61798a69892 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:26.321790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5970d0aa-155c-4c26-afda-b61798a69892 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:26.322276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5970d0aa-155c-4c26-afda-b61798a69892 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:26.323039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5970d0aa-155c-4c26-afda-b61798a69892 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:26.323478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5970d0aa-155c-4c26-afda-b61798a69892 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:26.459674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5970d0aa-155c-4c26-afda-b61798a69892 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:26.467247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5970d0aa-155c-4c26-afda-b61798a69892 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.157113 Aug 01 15:43:26.467815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 650/1380] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:26 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:26.864625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-72d83fcf-5adb-42eb-befa-b994aeaacc76 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:26.866865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-72d83fcf-5adb-42eb-befa-b994aeaacc76 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:26.873466 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72d83fcf-5adb-42eb-befa-b994aeaacc76 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:26.873952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72d83fcf-5adb-42eb-befa-b994aeaacc76 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:26.874723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72d83fcf-5adb-42eb-befa-b994aeaacc76 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:26.875165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72d83fcf-5adb-42eb-befa-b994aeaacc76 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:26.905745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-72d83fcf-5adb-42eb-befa-b994aeaacc76 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045368 Aug 01 15:43:26.906336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 731/1381] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:43:26.995244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-68017b9e-72c7-4516-96a5-63a1edc8a2d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:26.997427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-68017b9e-72c7-4516-96a5-63a1edc8a2d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:27.003694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68017b9e-72c7-4516-96a5-63a1edc8a2d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:27.004144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68017b9e-72c7-4516-96a5-63a1edc8a2d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:27.004917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68017b9e-72c7-4516-96a5-63a1edc8a2d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:27.005356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68017b9e-72c7-4516-96a5-63a1edc8a2d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:27.035375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-68017b9e-72c7-4516-96a5-63a1edc8a2d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044107 Aug 01 15:43:27.035941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 651/1382] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:26 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:27.488899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c3f6dce1-7b55-4fba-a3ce-83b1fa7973aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:27.489613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c3f6dce1-7b55-4fba-a3ce-83b1fa7973aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:27.495755 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3f6dce1-7b55-4fba-a3ce-83b1fa7973aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:27.496207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3f6dce1-7b55-4fba-a3ce-83b1fa7973aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:27.496972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3f6dce1-7b55-4fba-a3ce-83b1fa7973aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:27.497409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3f6dce1-7b55-4fba-a3ce-83b1fa7973aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:27.626799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c3f6dce1-7b55-4fba-a3ce-83b1fa7973aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:27.634465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c3f6dce1-7b55-4fba-a3ce-83b1fa7973aa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.149362 Aug 01 15:43:27.635031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 732/1383] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:27 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:27.918470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d9d5829b-c496-4c55-8456-a0d13eae347f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:27.920665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d9d5829b-c496-4c55-8456-a0d13eae347f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:27.927230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9d5829b-c496-4c55-8456-a0d13eae347f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:27.927684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9d5829b-c496-4c55-8456-a0d13eae347f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:27.928451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9d5829b-c496-4c55-8456-a0d13eae347f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:27.928888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9d5829b-c496-4c55-8456-a0d13eae347f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:27.958127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d9d5829b-c496-4c55-8456-a0d13eae347f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043895 Aug 01 15:43:27.958687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 652/1384] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:28.047779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-51068575-8322-41ee-9092-2ef034023b51 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:28.050142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-51068575-8322-41ee-9092-2ef034023b51 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:28.056774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-51068575-8322-41ee-9092-2ef034023b51 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:28.057227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-51068575-8322-41ee-9092-2ef034023b51 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:28.058036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-51068575-8322-41ee-9092-2ef034023b51 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:28.058510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-51068575-8322-41ee-9092-2ef034023b51 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:28.087947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-51068575-8322-41ee-9092-2ef034023b51 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044135 Aug 01 15:43:28.088497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 733/1385] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:28 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:28.656058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b8566f95-c78f-41e1-9251-aea8a24ac6e9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:28.656705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b8566f95-c78f-41e1-9251-aea8a24ac6e9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:28.662957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b8566f95-c78f-41e1-9251-aea8a24ac6e9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:28.663405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b8566f95-c78f-41e1-9251-aea8a24ac6e9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:28.664197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b8566f95-c78f-41e1-9251-aea8a24ac6e9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:28.664625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b8566f95-c78f-41e1-9251-aea8a24ac6e9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:28.797363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b8566f95-c78f-41e1-9251-aea8a24ac6e9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:28.804833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b8566f95-c78f-41e1-9251-aea8a24ac6e9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152680 Aug 01 15:43:28.805400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 653/1386] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:28 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:28.971394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5695c5ce-85bb-47a1-a6b7-40e2ed995481 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:28.973562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5695c5ce-85bb-47a1-a6b7-40e2ed995481 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:28.979663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5695c5ce-85bb-47a1-a6b7-40e2ed995481 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:28.980110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5695c5ce-85bb-47a1-a6b7-40e2ed995481 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:28.980883 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5695c5ce-85bb-47a1-a6b7-40e2ed995481 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:28.981318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5695c5ce-85bb-47a1-a6b7-40e2ed995481 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:29.010373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5695c5ce-85bb-47a1-a6b7-40e2ed995481 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043316 Aug 01 15:43:29.010929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 734/1387] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:29.100596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c267ca2f-4e0e-47f3-b0c9-af2c2ec071a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:29.102784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c267ca2f-4e0e-47f3-b0c9-af2c2ec071a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:29.110159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c267ca2f-4e0e-47f3-b0c9-af2c2ec071a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:29.110605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c267ca2f-4e0e-47f3-b0c9-af2c2ec071a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:29.111372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c267ca2f-4e0e-47f3-b0c9-af2c2ec071a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:29.111802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c267ca2f-4e0e-47f3-b0c9-af2c2ec071a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:29.140608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c267ca2f-4e0e-47f3-b0c9-af2c2ec071a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Aug 01 15:43:29.141163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 654/1388] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:29 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:29.827666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bfe9a28f-b2b3-42b2-b808-1e31082b5db5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:29.828313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bfe9a28f-b2b3-42b2-b808-1e31082b5db5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:29.834940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bfe9a28f-b2b3-42b2-b808-1e31082b5db5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:29.835393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bfe9a28f-b2b3-42b2-b808-1e31082b5db5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:29.836162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bfe9a28f-b2b3-42b2-b808-1e31082b5db5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:29.836600 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bfe9a28f-b2b3-42b2-b808-1e31082b5db5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:29.973832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bfe9a28f-b2b3-42b2-b808-1e31082b5db5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:29.982076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bfe9a28f-b2b3-42b2-b808-1e31082b5db5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158678 Aug 01 15:43:29.982652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 735/1389] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:29 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:30.022818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-88d9c5e8-1d71-4bf4-8f1f-c496afb18bf0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:30.025312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-88d9c5e8-1d71-4bf4-8f1f-c496afb18bf0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:30.031494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-88d9c5e8-1d71-4bf4-8f1f-c496afb18bf0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:30.031946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-88d9c5e8-1d71-4bf4-8f1f-c496afb18bf0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:30.032717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-88d9c5e8-1d71-4bf4-8f1f-c496afb18bf0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:30.033155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-88d9c5e8-1d71-4bf4-8f1f-c496afb18bf0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:30.063313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-88d9c5e8-1d71-4bf4-8f1f-c496afb18bf0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044457 Aug 01 15:43:30.063882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 655/1390] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:30.152727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-847a705b-4c90-4ff8-873a-89015fdcb822 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:30.154922 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-847a705b-4c90-4ff8-873a-89015fdcb822 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:30.160962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-847a705b-4c90-4ff8-873a-89015fdcb822 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:30.161307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-847a705b-4c90-4ff8-873a-89015fdcb822 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:30.162099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-847a705b-4c90-4ff8-873a-89015fdcb822 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:30.162532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-847a705b-4c90-4ff8-873a-89015fdcb822 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:30.191608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-847a705b-4c90-4ff8-873a-89015fdcb822 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042872 Aug 01 15:43:30.192152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 736/1391] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:31.002634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-09eed21c-01c5-49e0-8bac-b15f5d64dcae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:31.003226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-09eed21c-01c5-49e0-8bac-b15f5d64dcae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:31.009679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09eed21c-01c5-49e0-8bac-b15f5d64dcae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:31.010151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09eed21c-01c5-49e0-8bac-b15f5d64dcae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:31.010915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09eed21c-01c5-49e0-8bac-b15f5d64dcae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:31.011341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09eed21c-01c5-49e0-8bac-b15f5d64dcae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:31.076303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b856229e-650f-40ea-ab90-179341855c2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:31.078648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b856229e-650f-40ea-ab90-179341855c2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:31.085299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b856229e-650f-40ea-ab90-179341855c2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:31.085752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b856229e-650f-40ea-ab90-179341855c2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:31.086561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b856229e-650f-40ea-ab90-179341855c2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:31.086998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b856229e-650f-40ea-ab90-179341855c2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:31.118604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b856229e-650f-40ea-ab90-179341855c2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046733 Aug 01 15:43:31.119180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 737/1392] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:43:31.145192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-09eed21c-01c5-49e0-8bac-b15f5d64dcae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:31.152820 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-09eed21c-01c5-49e0-8bac-b15f5d64dcae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154096 Aug 01 15:43:31.153390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 656/1393] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:30 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:31.204305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ca6f12d9-6651-4f50-9921-ece018dbea78 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:31.206544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ca6f12d9-6651-4f50-9921-ece018dbea78 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:31.212640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca6f12d9-6651-4f50-9921-ece018dbea78 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:31.213088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca6f12d9-6651-4f50-9921-ece018dbea78 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:31.213859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca6f12d9-6651-4f50-9921-ece018dbea78 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:31.214321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca6f12d9-6651-4f50-9921-ece018dbea78 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:31.243151 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ca6f12d9-6651-4f50-9921-ece018dbea78 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043445 Aug 01 15:43:31.243704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 738/1394] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:31 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:32.131512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d20a7a4b-8a73-4d9e-87de-62189cc0c891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:32.133649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d20a7a4b-8a73-4d9e-87de-62189cc0c891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:32.140212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d20a7a4b-8a73-4d9e-87de-62189cc0c891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:32.140659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d20a7a4b-8a73-4d9e-87de-62189cc0c891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:32.141416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d20a7a4b-8a73-4d9e-87de-62189cc0c891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:32.141842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d20a7a4b-8a73-4d9e-87de-62189cc0c891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:32.144200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:32.173792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d20a7a4b-8a73-4d9e-87de-62189cc0c891 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045913 Aug 01 15:43:32.174757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 657/1395] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:32.174999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a40283e5-7bff-4d64-89ee-bbbc4d73fbfa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:32.175612 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a40283e5-7bff-4d64-89ee-bbbc4d73fbfa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:32.178088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=86 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:32.183128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a40283e5-7bff-4d64-89ee-bbbc4d73fbfa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:32.183666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a40283e5-7bff-4d64-89ee-bbbc4d73fbfa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:32.184761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a40283e5-7bff-4d64-89ee-bbbc4d73fbfa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:32.185196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a40283e5-7bff-4d64-89ee-bbbc4d73fbfa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:32.256437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-da55d553-ebfb-4871-a2a6-5fd485d7c781 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:32.258730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-da55d553-ebfb-4871-a2a6-5fd485d7c781 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:32.265341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da55d553-ebfb-4871-a2a6-5fd485d7c781 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:32.265805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da55d553-ebfb-4871-a2a6-5fd485d7c781 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:32.266720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da55d553-ebfb-4871-a2a6-5fd485d7c781 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:32.267190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da55d553-ebfb-4871-a2a6-5fd485d7c781 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:32.298004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-da55d553-ebfb-4871-a2a6-5fd485d7c781 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045656 Aug 01 15:43:32.298622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 658/1396] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:32 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:43:32.335888 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a40283e5-7bff-4d64-89ee-bbbc4d73fbfa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:32.344407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a40283e5-7bff-4d64-89ee-bbbc4d73fbfa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.173213 Aug 01 15:43:32.344963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 739/1397] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:32 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:43:33.191258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a40b183d-aea7-4352-88f1-215ec19f5c47 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:33.193594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a40b183d-aea7-4352-88f1-215ec19f5c47 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:33.200152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a40b183d-aea7-4352-88f1-215ec19f5c47 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:33.200596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a40b183d-aea7-4352-88f1-215ec19f5c47 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:33.201355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a40b183d-aea7-4352-88f1-215ec19f5c47 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:33.201785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a40b183d-aea7-4352-88f1-215ec19f5c47 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:33.230150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a40b183d-aea7-4352-88f1-215ec19f5c47 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042844 Aug 01 15:43:33.230742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 659/1398] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:33.310781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-67036cac-ba98-42ce-9b14-12f47f139ff2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:33.312876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-67036cac-ba98-42ce-9b14-12f47f139ff2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:33.319474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67036cac-ba98-42ce-9b14-12f47f139ff2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:33.319924 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67036cac-ba98-42ce-9b14-12f47f139ff2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:33.320693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67036cac-ba98-42ce-9b14-12f47f139ff2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:33.321130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-67036cac-ba98-42ce-9b14-12f47f139ff2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:33.350850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-67036cac-ba98-42ce-9b14-12f47f139ff2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044687 Aug 01 15:43:33.351362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 740/1399] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:33 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:33.364673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-962cb4c3-1fee-4b8e-9ef2-f78f2287be3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:33.365286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-962cb4c3-1fee-4b8e-9ef2-f78f2287be3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:33.371328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-962cb4c3-1fee-4b8e-9ef2-f78f2287be3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:33.371810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-962cb4c3-1fee-4b8e-9ef2-f78f2287be3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:33.373271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-962cb4c3-1fee-4b8e-9ef2-f78f2287be3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:33.373710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-962cb4c3-1fee-4b8e-9ef2-f78f2287be3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:33.504980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-962cb4c3-1fee-4b8e-9ef2-f78f2287be3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:33.512750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-962cb4c3-1fee-4b8e-9ef2-f78f2287be3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151854 Aug 01 15:43:33.513407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 660/1400] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:33 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:34.243775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-37f00c93-0f15-4029-b2c7-518c7bdf397b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:34.245881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-37f00c93-0f15-4029-b2c7-518c7bdf397b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:34.257304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37f00c93-0f15-4029-b2c7-518c7bdf397b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:34.257828 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37f00c93-0f15-4029-b2c7-518c7bdf397b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:34.258639 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37f00c93-0f15-4029-b2c7-518c7bdf397b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:34.259070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37f00c93-0f15-4029-b2c7-518c7bdf397b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:34.290179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-37f00c93-0f15-4029-b2c7-518c7bdf397b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050950 Aug 01 15:43:34.290720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 741/1401] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:43:34.363575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-76d4cd41-37f6-4bf3-9797-bb54c7ed082f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:34.365762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-76d4cd41-37f6-4bf3-9797-bb54c7ed082f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:34.372735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76d4cd41-37f6-4bf3-9797-bb54c7ed082f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:34.373342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76d4cd41-37f6-4bf3-9797-bb54c7ed082f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:34.374298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76d4cd41-37f6-4bf3-9797-bb54c7ed082f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:34.374815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76d4cd41-37f6-4bf3-9797-bb54c7ed082f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:34.405400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-76d4cd41-37f6-4bf3-9797-bb54c7ed082f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Aug 01 15:43:34.405977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 661/1402] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:34 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:34.535863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-13a9f954-08ef-4076-841f-f0eca00ad159 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:34.538804 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-13a9f954-08ef-4076-841f-f0eca00ad159 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:34.547039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13a9f954-08ef-4076-841f-f0eca00ad159 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:34.547492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13a9f954-08ef-4076-841f-f0eca00ad159 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:34.549798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13a9f954-08ef-4076-841f-f0eca00ad159 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:34.552161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13a9f954-08ef-4076-841f-f0eca00ad159 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:34.684788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-13a9f954-08ef-4076-841f-f0eca00ad159 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:34.692322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-13a9f954-08ef-4076-841f-f0eca00ad159 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.161014 Aug 01 15:43:34.692885 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 742/1403] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:34 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:43:35.303260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4d6dafc1-c04f-4fcb-a761-b470155dcdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:35.305471 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4d6dafc1-c04f-4fcb-a761-b470155dcdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:35.312199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d6dafc1-c04f-4fcb-a761-b470155dcdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:35.312641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d6dafc1-c04f-4fcb-a761-b470155dcdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:35.313396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d6dafc1-c04f-4fcb-a761-b470155dcdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:35.313832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d6dafc1-c04f-4fcb-a761-b470155dcdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:35.342211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4d6dafc1-c04f-4fcb-a761-b470155dcdf9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042892 Aug 01 15:43:35.342785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 662/1404] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:35.418663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9d576dfd-65b6-45a1-ad54-4d99098cfea5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:35.421391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9d576dfd-65b6-45a1-ad54-4d99098cfea5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:35.427610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d576dfd-65b6-45a1-ad54-4d99098cfea5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:35.428064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d576dfd-65b6-45a1-ad54-4d99098cfea5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:35.428833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d576dfd-65b6-45a1-ad54-4d99098cfea5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:35.429271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d576dfd-65b6-45a1-ad54-4d99098cfea5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:35.457981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9d576dfd-65b6-45a1-ad54-4d99098cfea5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 Aug 01 15:43:35.458724 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 743/1405] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:35 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:43:35.714186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bd9e8104-b1be-444b-814d-017b64fcc2f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:35.714788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bd9e8104-b1be-444b-814d-017b64fcc2f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:35.722018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd9e8104-b1be-444b-814d-017b64fcc2f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:35.722461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd9e8104-b1be-444b-814d-017b64fcc2f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:35.723217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd9e8104-b1be-444b-814d-017b64fcc2f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:35.723650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd9e8104-b1be-444b-814d-017b64fcc2f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:35.858953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bd9e8104-b1be-444b-814d-017b64fcc2f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:35.871396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bd9e8104-b1be-444b-814d-017b64fcc2f5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.160911 Aug 01 15:43:35.872278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 663/1406] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:35 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:36.355410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d9d46e97-1ae3-49e5-89a0-528eef3c81bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:36.357475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d9d46e97-1ae3-49e5-89a0-528eef3c81bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:36.364250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9d46e97-1ae3-49e5-89a0-528eef3c81bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:36.364698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9d46e97-1ae3-49e5-89a0-528eef3c81bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:36.365456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9d46e97-1ae3-49e5-89a0-528eef3c81bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:36.365910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9d46e97-1ae3-49e5-89a0-528eef3c81bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:36.396890 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d9d46e97-1ae3-49e5-89a0-528eef3c81bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045527 Aug 01 15:43:36.397455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 744/1407] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:36.471435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e17a949e-173c-4d58-b23e-57042c2a86f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:36.473714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e17a949e-173c-4d58-b23e-57042c2a86f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:36.480681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e17a949e-173c-4d58-b23e-57042c2a86f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:36.481403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e17a949e-173c-4d58-b23e-57042c2a86f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:36.482664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e17a949e-173c-4d58-b23e-57042c2a86f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:36.483434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e17a949e-173c-4d58-b23e-57042c2a86f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:36.514594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e17a949e-173c-4d58-b23e-57042c2a86f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047729 Aug 01 15:43:36.515146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 664/1408] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:36 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:36.899836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3928746d-b5ad-41bf-ac8d-51230e60a5ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:36.900464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3928746d-b5ad-41bf-ac8d-51230e60a5ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:36.906983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3928746d-b5ad-41bf-ac8d-51230e60a5ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:36.907434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3928746d-b5ad-41bf-ac8d-51230e60a5ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:36.908203 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3928746d-b5ad-41bf-ac8d-51230e60a5ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:36.908636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3928746d-b5ad-41bf-ac8d-51230e60a5ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:37.037134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3928746d-b5ad-41bf-ac8d-51230e60a5ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:37.045205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3928746d-b5ad-41bf-ac8d-51230e60a5ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.149315 Aug 01 15:43:37.045770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 745/1409] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:36 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:37.409431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0a466aa5-896f-47ad-bcb1-1a09443e7ad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:37.411672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0a466aa5-896f-47ad-bcb1-1a09443e7ad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:37.418401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a466aa5-896f-47ad-bcb1-1a09443e7ad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:37.419520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a466aa5-896f-47ad-bcb1-1a09443e7ad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:37.420298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a466aa5-896f-47ad-bcb1-1a09443e7ad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:37.420740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a466aa5-896f-47ad-bcb1-1a09443e7ad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:37.449701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0a466aa5-896f-47ad-bcb1-1a09443e7ad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044242 Aug 01 15:43:37.450292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 665/1410] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:37.527150 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6d66a61a-f7d6-4b46-9cea-38eedcdcec8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:37.530096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6d66a61a-f7d6-4b46-9cea-38eedcdcec8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:37.536664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d66a61a-f7d6-4b46-9cea-38eedcdcec8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:37.537111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d66a61a-f7d6-4b46-9cea-38eedcdcec8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:37.537929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d66a61a-f7d6-4b46-9cea-38eedcdcec8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:37.538368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d66a61a-f7d6-4b46-9cea-38eedcdcec8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:37.567944 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6d66a61a-f7d6-4b46-9cea-38eedcdcec8e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Aug 01 15:43:37.568585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 746/1411] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:37 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:38.066675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2f8b9ae1-f659-4506-a270-03110161f541 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:38.067283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2f8b9ae1-f659-4506-a270-03110161f541 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:38.073348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f8b9ae1-f659-4506-a270-03110161f541 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:38.073794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f8b9ae1-f659-4506-a270-03110161f541 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:38.074606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f8b9ae1-f659-4506-a270-03110161f541 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:38.075635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f8b9ae1-f659-4506-a270-03110161f541 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:38.209226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2f8b9ae1-f659-4506-a270-03110161f541 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:38.217086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2f8b9ae1-f659-4506-a270-03110161f541 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154264 Aug 01 15:43:38.217693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 666/1412] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:38 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:38.462496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9e608c9f-9bde-4a79-8cad-0d7a205452d5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:38.464663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9e608c9f-9bde-4a79-8cad-0d7a205452d5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:38.471070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e608c9f-9bde-4a79-8cad-0d7a205452d5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:38.471508 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e608c9f-9bde-4a79-8cad-0d7a205452d5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:38.472271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e608c9f-9bde-4a79-8cad-0d7a205452d5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:38.472707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e608c9f-9bde-4a79-8cad-0d7a205452d5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:38.489685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:38.503674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9e608c9f-9bde-4a79-8cad-0d7a205452d5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045301 Aug 01 15:43:38.504320 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 747/1413] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:38.579673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2ad6b280-0585-4a97-8d47-5b5a7608ed25 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:38.581876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2ad6b280-0585-4a97-8d47-5b5a7608ed25 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:38.588403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ad6b280-0585-4a97-8d47-5b5a7608ed25 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:38.588857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ad6b280-0585-4a97-8d47-5b5a7608ed25 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:38.589621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ad6b280-0585-4a97-8d47-5b5a7608ed25 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:38.590096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ad6b280-0585-4a97-8d47-5b5a7608ed25 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:38.620922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2ad6b280-0585-4a97-8d47-5b5a7608ed25 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045254 Aug 01 15:43:38.621510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 667/1414] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:38 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:39.238536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-08667f0f-f777-4463-bc8b-24006c2ca7d9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:39.239152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-08667f0f-f777-4463-bc8b-24006c2ca7d9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:39.245621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08667f0f-f777-4463-bc8b-24006c2ca7d9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:39.246188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08667f0f-f777-4463-bc8b-24006c2ca7d9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:39.247599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08667f0f-f777-4463-bc8b-24006c2ca7d9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:39.248034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08667f0f-f777-4463-bc8b-24006c2ca7d9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:39.380030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-08667f0f-f777-4463-bc8b-24006c2ca7d9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:39.388031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-08667f0f-f777-4463-bc8b-24006c2ca7d9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153546 Aug 01 15:43:39.388601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 748/1415] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:39 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:39.516257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-950b156f-6151-4431-a55f-b9ab0bea71c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:39.518495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-950b156f-6151-4431-a55f-b9ab0bea71c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:39.524620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-950b156f-6151-4431-a55f-b9ab0bea71c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:39.525074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-950b156f-6151-4431-a55f-b9ab0bea71c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:39.525840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-950b156f-6151-4431-a55f-b9ab0bea71c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:39.526307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-950b156f-6151-4431-a55f-b9ab0bea71c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:39.556169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-950b156f-6151-4431-a55f-b9ab0bea71c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043971 Aug 01 15:43:39.556728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 668/1416] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:39.634016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3744312b-f330-499d-ba61-5a1fde5253d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:39.636263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3744312b-f330-499d-ba61-5a1fde5253d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:39.642350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3744312b-f330-499d-ba61-5a1fde5253d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:39.642807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3744312b-f330-499d-ba61-5a1fde5253d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:39.643569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3744312b-f330-499d-ba61-5a1fde5253d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:39.644006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3744312b-f330-499d-ba61-5a1fde5253d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:39.673820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3744312b-f330-499d-ba61-5a1fde5253d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Aug 01 15:43:39.674411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 749/1417] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:39 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:40.409942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-44873294-7657-410c-8f9f-4e4a760e9b56 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:40.410598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-44873294-7657-410c-8f9f-4e4a760e9b56 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:40.417176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-44873294-7657-410c-8f9f-4e4a760e9b56 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:40.417626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-44873294-7657-410c-8f9f-4e4a760e9b56 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:40.418438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-44873294-7657-410c-8f9f-4e4a760e9b56 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:40.418887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-44873294-7657-410c-8f9f-4e4a760e9b56 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:40.554268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-44873294-7657-410c-8f9f-4e4a760e9b56 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:40.562496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-44873294-7657-410c-8f9f-4e4a760e9b56 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156430 Aug 01 15:43:40.563300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 669/1418] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:40 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:40.568636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-18877f62-cd95-4bf4-a56f-ae625df80802 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:40.570824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-18877f62-cd95-4bf4-a56f-ae625df80802 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:40.577398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18877f62-cd95-4bf4-a56f-ae625df80802 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:40.577847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18877f62-cd95-4bf4-a56f-ae625df80802 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:40.578644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18877f62-cd95-4bf4-a56f-ae625df80802 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:40.579080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18877f62-cd95-4bf4-a56f-ae625df80802 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:40.608275 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-18877f62-cd95-4bf4-a56f-ae625df80802 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043620 Aug 01 15:43:40.608826 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 750/1419] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:40.687531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2940ea51-11bd-4768-b329-63e70163aaa7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:40.689702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2940ea51-11bd-4768-b329-63e70163aaa7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:40.695864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2940ea51-11bd-4768-b329-63e70163aaa7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:40.696316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2940ea51-11bd-4768-b329-63e70163aaa7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:40.697095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2940ea51-11bd-4768-b329-63e70163aaa7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:40.697530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2940ea51-11bd-4768-b329-63e70163aaa7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:40.727522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2940ea51-11bd-4768-b329-63e70163aaa7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Aug 01 15:43:40.728081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 670/1420] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:40 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:41.584317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3429f5e2-5a23-4eed-b8ae-62833737d6d1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:41.584935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3429f5e2-5a23-4eed-b8ae-62833737d6d1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:41.592166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3429f5e2-5a23-4eed-b8ae-62833737d6d1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:41.592616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3429f5e2-5a23-4eed-b8ae-62833737d6d1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:41.593391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3429f5e2-5a23-4eed-b8ae-62833737d6d1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:41.594130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3429f5e2-5a23-4eed-b8ae-62833737d6d1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:41.619969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-07368eec-8673-4fa1-911c-2fdc797e011f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:41.622905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-07368eec-8673-4fa1-911c-2fdc797e011f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:41.631373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-07368eec-8673-4fa1-911c-2fdc797e011f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:41.632063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-07368eec-8673-4fa1-911c-2fdc797e011f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:41.632882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-07368eec-8673-4fa1-911c-2fdc797e011f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:41.633377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-07368eec-8673-4fa1-911c-2fdc797e011f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:41.664191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-07368eec-8673-4fa1-911c-2fdc797e011f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048141 Aug 01 15:43:41.664766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 671/1421] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:43:41.731648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3429f5e2-5a23-4eed-b8ae-62833737d6d1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:41.739345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3429f5e2-5a23-4eed-b8ae-62833737d6d1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158891 Aug 01 15:43:41.739909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 751/1422] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:41 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:41.740245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f4877557-6eb6-45a7-80fa-736d35fa7c4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:41.742509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f4877557-6eb6-45a7-80fa-736d35fa7c4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:41.749307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4877557-6eb6-45a7-80fa-736d35fa7c4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:41.749744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4877557-6eb6-45a7-80fa-736d35fa7c4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:41.750537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4877557-6eb6-45a7-80fa-736d35fa7c4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:41.750965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4877557-6eb6-45a7-80fa-736d35fa7c4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:41.782312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f4877557-6eb6-45a7-80fa-736d35fa7c4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045964 Aug 01 15:43:41.782874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 672/1423] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:43:42.676647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3f445cdb-890c-4566-bb1f-b941f597a34b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:42.678871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3f445cdb-890c-4566-bb1f-b941f597a34b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:42.685430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3f445cdb-890c-4566-bb1f-b941f597a34b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:42.685881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3f445cdb-890c-4566-bb1f-b941f597a34b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:42.686677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3f445cdb-890c-4566-bb1f-b941f597a34b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:42.687110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3f445cdb-890c-4566-bb1f-b941f597a34b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:42.717205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3f445cdb-890c-4566-bb1f-b941f597a34b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044541 Aug 01 15:43:42.717761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 752/1424] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:42 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:42.761238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8032330c-4891-4372-9cee-f879ceb238db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:42.761861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8032330c-4891-4372-9cee-f879ceb238db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:42.768590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8032330c-4891-4372-9cee-f879ceb238db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:42.769038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8032330c-4891-4372-9cee-f879ceb238db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:42.769810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8032330c-4891-4372-9cee-f879ceb238db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:42.770279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8032330c-4891-4372-9cee-f879ceb238db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:42.794764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0caa9b8c-6a26-40d0-b468-12d900b860e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:42.797009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0caa9b8c-6a26-40d0-b468-12d900b860e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:42.803196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0caa9b8c-6a26-40d0-b468-12d900b860e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:42.803572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0caa9b8c-6a26-40d0-b468-12d900b860e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:42.804340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0caa9b8c-6a26-40d0-b468-12d900b860e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:42.804772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0caa9b8c-6a26-40d0-b468-12d900b860e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:42.834827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0caa9b8c-6a26-40d0-b468-12d900b860e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043919 Aug 01 15:43:42.835609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 753/1425] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:42 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:43:42.902551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8032330c-4891-4372-9cee-f879ceb238db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:42.905459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:42.912148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8032330c-4891-4372-9cee-f879ceb238db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154831 Aug 01 15:43:42.912717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 673/1426] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:42 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:43.730179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-db820088-9d9c-487f-a69a-ffb53c7a9719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:43.732846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-db820088-9d9c-487f-a69a-ffb53c7a9719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:43.739326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db820088-9d9c-487f-a69a-ffb53c7a9719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:43.739766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db820088-9d9c-487f-a69a-ffb53c7a9719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:43.740518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db820088-9d9c-487f-a69a-ffb53c7a9719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:43.740945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db820088-9d9c-487f-a69a-ffb53c7a9719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:43.770851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-db820088-9d9c-487f-a69a-ffb53c7a9719 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044871 Aug 01 15:43:43.771409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 754/1427] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:43.848114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9c6bb7ec-6389-491c-98c9-0d0d6c9b0507 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:43.850348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9c6bb7ec-6389-491c-98c9-0d0d6c9b0507 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:43.857523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c6bb7ec-6389-491c-98c9-0d0d6c9b0507 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:43.858011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c6bb7ec-6389-491c-98c9-0d0d6c9b0507 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:43.858812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c6bb7ec-6389-491c-98c9-0d0d6c9b0507 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:43.859253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c6bb7ec-6389-491c-98c9-0d0d6c9b0507 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:43.888085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9c6bb7ec-6389-491c-98c9-0d0d6c9b0507 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044155 Aug 01 15:43:43.888638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 674/1428] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:43 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:43.933405 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b1296523-7c89-4f08-9529-9c9f3eef9b79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:43.934042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b1296523-7c89-4f08-9529-9c9f3eef9b79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:43.940069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1296523-7c89-4f08-9529-9c9f3eef9b79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:43.940519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1296523-7c89-4f08-9529-9c9f3eef9b79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:43.941275 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1296523-7c89-4f08-9529-9c9f3eef9b79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:43.941709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1296523-7c89-4f08-9529-9c9f3eef9b79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:44.077980 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b1296523-7c89-4f08-9529-9c9f3eef9b79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:44.085552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b1296523-7c89-4f08-9529-9c9f3eef9b79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156048 Aug 01 15:43:44.086153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 755/1429] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:43 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:44.783548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fd211a2e-4577-4a64-aa4d-3a801e859fc6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:44.785841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fd211a2e-4577-4a64-aa4d-3a801e859fc6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:44.792042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd211a2e-4577-4a64-aa4d-3a801e859fc6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:44.792490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd211a2e-4577-4a64-aa4d-3a801e859fc6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:44.793268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd211a2e-4577-4a64-aa4d-3a801e859fc6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:44.793711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd211a2e-4577-4a64-aa4d-3a801e859fc6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:44.823143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fd211a2e-4577-4a64-aa4d-3a801e859fc6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043567 Aug 01 15:43:44.823702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 675/1430] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:44.900297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-52cc658e-1e46-4d28-ae9f-ad2234ce6494 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:44.902638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-52cc658e-1e46-4d28-ae9f-ad2234ce6494 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:44.909255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52cc658e-1e46-4d28-ae9f-ad2234ce6494 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:44.909699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52cc658e-1e46-4d28-ae9f-ad2234ce6494 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:44.910495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52cc658e-1e46-4d28-ae9f-ad2234ce6494 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:44.910921 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52cc658e-1e46-4d28-ae9f-ad2234ce6494 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:44.940587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-52cc658e-1e46-4d28-ae9f-ad2234ce6494 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044217 Aug 01 15:43:44.941146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 756/1431] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:44 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:45.107984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ace9f5ef-3641-4218-bd67-e3e52d982aab tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:45.108599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ace9f5ef-3641-4218-bd67-e3e52d982aab tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:45.115094 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ace9f5ef-3641-4218-bd67-e3e52d982aab tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:45.115548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ace9f5ef-3641-4218-bd67-e3e52d982aab tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:45.116319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ace9f5ef-3641-4218-bd67-e3e52d982aab tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:45.116763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ace9f5ef-3641-4218-bd67-e3e52d982aab tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:45.248879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ace9f5ef-3641-4218-bd67-e3e52d982aab tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:45.256463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ace9f5ef-3641-4218-bd67-e3e52d982aab tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152835 Aug 01 15:43:45.257036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 676/1432] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:45 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:45.835630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d0979456-ab06-4626-a548-1c3579a7aec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:45.837937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d0979456-ab06-4626-a548-1c3579a7aec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:45.845251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d0979456-ab06-4626-a548-1c3579a7aec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:45.845701 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d0979456-ab06-4626-a548-1c3579a7aec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:45.846557 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d0979456-ab06-4626-a548-1c3579a7aec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:45.846991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d0979456-ab06-4626-a548-1c3579a7aec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:45.877507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d0979456-ab06-4626-a548-1c3579a7aec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046057 Aug 01 15:43:45.878236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 757/1433] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:45.953061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c1f1b406-bc3e-43f4-837b-2940ac75bd91 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:45.955407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c1f1b406-bc3e-43f4-837b-2940ac75bd91 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:45.961391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c1f1b406-bc3e-43f4-837b-2940ac75bd91 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:45.961911 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c1f1b406-bc3e-43f4-837b-2940ac75bd91 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:45.962713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c1f1b406-bc3e-43f4-837b-2940ac75bd91 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:45.963143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c1f1b406-bc3e-43f4-837b-2940ac75bd91 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:45.992925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c1f1b406-bc3e-43f4-837b-2940ac75bd91 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044345 Aug 01 15:43:45.993495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 677/1434] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:45 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:46.277605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f761e137-49ba-4116-a2bc-fdc539b7a3ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:46.278310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f761e137-49ba-4116-a2bc-fdc539b7a3ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:46.284424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f761e137-49ba-4116-a2bc-fdc539b7a3ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:46.284863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f761e137-49ba-4116-a2bc-fdc539b7a3ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:46.285610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f761e137-49ba-4116-a2bc-fdc539b7a3ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:46.286074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f761e137-49ba-4116-a2bc-fdc539b7a3ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:46.420998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f761e137-49ba-4116-a2bc-fdc539b7a3ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:46.428625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f761e137-49ba-4116-a2bc-fdc539b7a3ed tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154908 Aug 01 15:43:46.429186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 758/1435] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:46 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:46.890383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6cbbb924-8132-4b3a-8e52-e9639712baae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:46.892563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6cbbb924-8132-4b3a-8e52-e9639712baae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:46.899122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6cbbb924-8132-4b3a-8e52-e9639712baae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:46.899571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6cbbb924-8132-4b3a-8e52-e9639712baae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:46.900337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6cbbb924-8132-4b3a-8e52-e9639712baae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:46.900773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6cbbb924-8132-4b3a-8e52-e9639712baae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:46.930373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6cbbb924-8132-4b3a-8e52-e9639712baae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044532 Aug 01 15:43:46.930939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 678/1436] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:47.004850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9d9b7988-591b-4bfd-9483-e5796897ae2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:47.007071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9d9b7988-591b-4bfd-9483-e5796897ae2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:47.014381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d9b7988-591b-4bfd-9483-e5796897ae2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:47.015063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d9b7988-591b-4bfd-9483-e5796897ae2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:47.015841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d9b7988-591b-4bfd-9483-e5796897ae2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:47.016282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d9b7988-591b-4bfd-9483-e5796897ae2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:47.045328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9d9b7988-591b-4bfd-9483-e5796897ae2d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Aug 01 15:43:47.045900 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 759/1437] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:46 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:47.449558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-39e031e9-d5a1-47ae-90d5-7144939915c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:47.450236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-39e031e9-d5a1-47ae-90d5-7144939915c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:47.456535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39e031e9-d5a1-47ae-90d5-7144939915c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:47.457001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39e031e9-d5a1-47ae-90d5-7144939915c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:47.457781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39e031e9-d5a1-47ae-90d5-7144939915c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:47.458260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39e031e9-d5a1-47ae-90d5-7144939915c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:47.593172 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-39e031e9-d5a1-47ae-90d5-7144939915c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:47.602266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-39e031e9-d5a1-47ae-90d5-7144939915c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156523 Aug 01 15:43:47.602934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 679/1438] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:47 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:47.943006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c366d373-ff2a-4749-829a-c1d6fbd0ac88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:47.945158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c366d373-ff2a-4749-829a-c1d6fbd0ac88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:47.952012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c366d373-ff2a-4749-829a-c1d6fbd0ac88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:47.952462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c366d373-ff2a-4749-829a-c1d6fbd0ac88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:47.953258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c366d373-ff2a-4749-829a-c1d6fbd0ac88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:47.953692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c366d373-ff2a-4749-829a-c1d6fbd0ac88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:47.982887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c366d373-ff2a-4749-829a-c1d6fbd0ac88 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043865 Aug 01 15:43:47.983444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 760/1439] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:48.057361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7b122cd6-45f5-48aa-884b-1634b4833a15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:48.059567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7b122cd6-45f5-48aa-884b-1634b4833a15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:48.066864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b122cd6-45f5-48aa-884b-1634b4833a15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:48.067320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b122cd6-45f5-48aa-884b-1634b4833a15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:48.068100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b122cd6-45f5-48aa-884b-1634b4833a15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:48.068540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b122cd6-45f5-48aa-884b-1634b4833a15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:48.097412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7b122cd6-45f5-48aa-884b-1634b4833a15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043999 Aug 01 15:43:48.097993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 680/1440] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:48 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:48.623816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a0051598-9e6d-4d2b-8b65-b7b62d346efc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:48.624435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a0051598-9e6d-4d2b-8b65-b7b62d346efc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:48.631020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0051598-9e6d-4d2b-8b65-b7b62d346efc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:48.631472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0051598-9e6d-4d2b-8b65-b7b62d346efc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:48.632249 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0051598-9e6d-4d2b-8b65-b7b62d346efc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:48.632691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0051598-9e6d-4d2b-8b65-b7b62d346efc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:48.834982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a0051598-9e6d-4d2b-8b65-b7b62d346efc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:48.843236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a0051598-9e6d-4d2b-8b65-b7b62d346efc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.223334 Aug 01 15:43:48.844084 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 761/1441] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:48 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:48.995391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d7220be0-fb8d-4f62-ace4-b976747107bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:48.997608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d7220be0-fb8d-4f62-ace4-b976747107bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:49.003659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7220be0-fb8d-4f62-ace4-b976747107bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:49.004104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7220be0-fb8d-4f62-ace4-b976747107bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:49.004862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7220be0-fb8d-4f62-ace4-b976747107bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:49.005294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7220be0-fb8d-4f62-ace4-b976747107bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:49.034608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d7220be0-fb8d-4f62-ace4-b976747107bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043307 Aug 01 15:43:49.035152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 681/1442] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:49.109953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5a37d010-cbb9-4ddf-afdd-b1b2e897fa82 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:49.112120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5a37d010-cbb9-4ddf-afdd-b1b2e897fa82 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:49.118202 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a37d010-cbb9-4ddf-afdd-b1b2e897fa82 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:49.118649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a37d010-cbb9-4ddf-afdd-b1b2e897fa82 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:49.119427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a37d010-cbb9-4ddf-afdd-b1b2e897fa82 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:49.119867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5a37d010-cbb9-4ddf-afdd-b1b2e897fa82 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:49.150273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5a37d010-cbb9-4ddf-afdd-b1b2e897fa82 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044327 Aug 01 15:43:49.150817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 762/1443] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:49.864737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5834ef32-43a7-4bbd-b88c-4f37a67774b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:49.865350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5834ef32-43a7-4bbd-b88c-4f37a67774b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:49.872338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5834ef32-43a7-4bbd-b88c-4f37a67774b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:49.872818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5834ef32-43a7-4bbd-b88c-4f37a67774b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:49.873560 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5834ef32-43a7-4bbd-b88c-4f37a67774b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:49.874036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5834ef32-43a7-4bbd-b88c-4f37a67774b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:50.010209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5834ef32-43a7-4bbd-b88c-4f37a67774b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:50.017845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5834ef32-43a7-4bbd-b88c-4f37a67774b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.157034 Aug 01 15:43:50.018448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 682/1444] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:49 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:50.047586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fce20e6f-34cd-43de-8679-a14d416ff20b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:50.049746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fce20e6f-34cd-43de-8679-a14d416ff20b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:50.056376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fce20e6f-34cd-43de-8679-a14d416ff20b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:50.056836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fce20e6f-34cd-43de-8679-a14d416ff20b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:50.057606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fce20e6f-34cd-43de-8679-a14d416ff20b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:50.058094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fce20e6f-34cd-43de-8679-a14d416ff20b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:50.087479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fce20e6f-34cd-43de-8679-a14d416ff20b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044520 Aug 01 15:43:50.088039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 763/1445] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:50.162917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8f31e1cb-7612-4511-8003-b4d8044c002d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:50.165026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8f31e1cb-7612-4511-8003-b4d8044c002d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:50.171852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f31e1cb-7612-4511-8003-b4d8044c002d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:50.172312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f31e1cb-7612-4511-8003-b4d8044c002d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:50.173185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f31e1cb-7612-4511-8003-b4d8044c002d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:50.173624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f31e1cb-7612-4511-8003-b4d8044c002d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:50.202528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8f31e1cb-7612-4511-8003-b4d8044c002d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043668 Aug 01 15:43:50.203085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 683/1446] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:50 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:51.040322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-93101e39-eccc-4031-a3c1-4f25e563e0fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:51.040936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-93101e39-eccc-4031-a3c1-4f25e563e0fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:51.047586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93101e39-eccc-4031-a3c1-4f25e563e0fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:51.048038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93101e39-eccc-4031-a3c1-4f25e563e0fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:51.048803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93101e39-eccc-4031-a3c1-4f25e563e0fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:51.049242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93101e39-eccc-4031-a3c1-4f25e563e0fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:51.053646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:51.100714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-603f0566-956e-4f11-9dfd-55f9a6c6294f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:51.102876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-603f0566-956e-4f11-9dfd-55f9a6c6294f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:51.109913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-603f0566-956e-4f11-9dfd-55f9a6c6294f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:51.110388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-603f0566-956e-4f11-9dfd-55f9a6c6294f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:51.111135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-603f0566-956e-4f11-9dfd-55f9a6c6294f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:51.111569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-603f0566-956e-4f11-9dfd-55f9a6c6294f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:51.141811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-603f0566-956e-4f11-9dfd-55f9a6c6294f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045085 Aug 01 15:43:51.142425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 684/1447] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:43:51.203493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-93101e39-eccc-4031-a3c1-4f25e563e0fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:51.212517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-93101e39-eccc-4031-a3c1-4f25e563e0fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.176043 Aug 01 15:43:51.213125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 764/1448] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:51 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:43:51.215323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-24319ff3-b2d4-4aae-abaa-77a290db5320 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:51.218006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-24319ff3-b2d4-4aae-abaa-77a290db5320 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:51.224423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24319ff3-b2d4-4aae-abaa-77a290db5320 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:51.224864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24319ff3-b2d4-4aae-abaa-77a290db5320 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:51.225628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24319ff3-b2d4-4aae-abaa-77a290db5320 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:51.226099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24319ff3-b2d4-4aae-abaa-77a290db5320 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:51.256245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-24319ff3-b2d4-4aae-abaa-77a290db5320 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Aug 01 15:43:51.256799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 685/1449] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:51 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:43:52.154911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f52f3abb-1ecb-4279-a68f-77ae6267dcc8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:52.157053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f52f3abb-1ecb-4279-a68f-77ae6267dcc8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:52.163572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f52f3abb-1ecb-4279-a68f-77ae6267dcc8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:52.164012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f52f3abb-1ecb-4279-a68f-77ae6267dcc8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:52.164761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f52f3abb-1ecb-4279-a68f-77ae6267dcc8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:52.165189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f52f3abb-1ecb-4279-a68f-77ae6267dcc8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:52.193512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f52f3abb-1ecb-4279-a68f-77ae6267dcc8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043222 Aug 01 15:43:52.194100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 765/1450] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:52.234859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-106b5a8b-03ac-4175-a586-9ff3385c7226 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:52.235531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-106b5a8b-03ac-4175-a586-9ff3385c7226 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:52.242134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-106b5a8b-03ac-4175-a586-9ff3385c7226 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:52.242595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-106b5a8b-03ac-4175-a586-9ff3385c7226 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:52.243368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-106b5a8b-03ac-4175-a586-9ff3385c7226 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:52.243812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-106b5a8b-03ac-4175-a586-9ff3385c7226 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:52.268670 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4253b696-1506-47b4-86aa-292135ac99c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:52.272440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4253b696-1506-47b4-86aa-292135ac99c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:52.277140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4253b696-1506-47b4-86aa-292135ac99c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:52.277589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4253b696-1506-47b4-86aa-292135ac99c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:52.278877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4253b696-1506-47b4-86aa-292135ac99c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:52.279338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4253b696-1506-47b4-86aa-292135ac99c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:52.310163 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4253b696-1506-47b4-86aa-292135ac99c8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Aug 01 15:43:52.310900 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 766/1451] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:52 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:43:52.436147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-106b5a8b-03ac-4175-a586-9ff3385c7226 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:52.444023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-106b5a8b-03ac-4175-a586-9ff3385c7226 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.213807 Aug 01 15:43:52.444604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 686/1452] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:52 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:53.207074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-526110b1-adb7-47c5-b5db-d43b7f47ef0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:53.209218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-526110b1-adb7-47c5-b5db-d43b7f47ef0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:53.215758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-526110b1-adb7-47c5-b5db-d43b7f47ef0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:53.216212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-526110b1-adb7-47c5-b5db-d43b7f47ef0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:53.216967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-526110b1-adb7-47c5-b5db-d43b7f47ef0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:53.217401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-526110b1-adb7-47c5-b5db-d43b7f47ef0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:53.246638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-526110b1-adb7-47c5-b5db-d43b7f47ef0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043556 Aug 01 15:43:53.247745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 767/1453] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:53.322931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6a57a074-4c52-4e6d-8024-b00f271d6b13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:53.325224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6a57a074-4c52-4e6d-8024-b00f271d6b13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:53.327780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=86 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:53.333292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a57a074-4c52-4e6d-8024-b00f271d6b13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:53.333744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a57a074-4c52-4e6d-8024-b00f271d6b13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:53.334596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a57a074-4c52-4e6d-8024-b00f271d6b13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:53.335551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a57a074-4c52-4e6d-8024-b00f271d6b13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:53.366860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6a57a074-4c52-4e6d-8024-b00f271d6b13 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048490 Aug 01 15:43:53.367426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 687/1454] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:53 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:53.465983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4f2fb2c4-182a-4214-9982-de90d4078ff1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:53.466526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4f2fb2c4-182a-4214-9982-de90d4078ff1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:53.473085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f2fb2c4-182a-4214-9982-de90d4078ff1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:53.473567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f2fb2c4-182a-4214-9982-de90d4078ff1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:53.474381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f2fb2c4-182a-4214-9982-de90d4078ff1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:53.474818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f2fb2c4-182a-4214-9982-de90d4078ff1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:53.614351 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4f2fb2c4-182a-4214-9982-de90d4078ff1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:53.623042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4f2fb2c4-182a-4214-9982-de90d4078ff1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.161049 Aug 01 15:43:53.623606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 768/1455] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:53 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:54.259417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e17461bb-e8dc-4d43-b72f-6b6531ceac52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:54.261520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e17461bb-e8dc-4d43-b72f-6b6531ceac52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:54.267633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e17461bb-e8dc-4d43-b72f-6b6531ceac52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:54.268086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e17461bb-e8dc-4d43-b72f-6b6531ceac52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:54.268860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e17461bb-e8dc-4d43-b72f-6b6531ceac52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:54.269300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e17461bb-e8dc-4d43-b72f-6b6531ceac52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:54.299044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e17461bb-e8dc-4d43-b72f-6b6531ceac52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043740 Aug 01 15:43:54.299609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 688/1456] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:54.379299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-30fa9f51-96a5-4d5c-aead-b1900c174d0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:54.381485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-30fa9f51-96a5-4d5c-aead-b1900c174d0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:54.388334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30fa9f51-96a5-4d5c-aead-b1900c174d0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:54.388783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30fa9f51-96a5-4d5c-aead-b1900c174d0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:54.389544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30fa9f51-96a5-4d5c-aead-b1900c174d0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:54.390006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30fa9f51-96a5-4d5c-aead-b1900c174d0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:54.419881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-30fa9f51-96a5-4d5c-aead-b1900c174d0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043847 Aug 01 15:43:54.420436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 769/1457] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:54 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:54.644573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f1c13f5a-fae8-4a19-a4e8-ce9b55edd745 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:54.645191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f1c13f5a-fae8-4a19-a4e8-ce9b55edd745 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:54.651767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1c13f5a-fae8-4a19-a4e8-ce9b55edd745 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:54.652217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1c13f5a-fae8-4a19-a4e8-ce9b55edd745 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:54.653000 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1c13f5a-fae8-4a19-a4e8-ce9b55edd745 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:54.653462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1c13f5a-fae8-4a19-a4e8-ce9b55edd745 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:54.829622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f1c13f5a-fae8-4a19-a4e8-ce9b55edd745 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:54.837216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f1c13f5a-fae8-4a19-a4e8-ce9b55edd745 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.196564 Aug 01 15:43:54.837785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 689/1458] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:54 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:55.312091 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7c6dff47-843f-4eb8-bb75-f32c01d9f56a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:55.314226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7c6dff47-843f-4eb8-bb75-f32c01d9f56a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:55.320305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c6dff47-843f-4eb8-bb75-f32c01d9f56a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:55.320764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c6dff47-843f-4eb8-bb75-f32c01d9f56a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:55.321528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c6dff47-843f-4eb8-bb75-f32c01d9f56a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:55.321994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c6dff47-843f-4eb8-bb75-f32c01d9f56a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:55.351499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7c6dff47-843f-4eb8-bb75-f32c01d9f56a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044085 Aug 01 15:43:55.352053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 770/1459] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:55.432717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ac74528f-0a66-4efa-a75e-52f48ccdce2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:55.434870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ac74528f-0a66-4efa-a75e-52f48ccdce2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:55.441680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac74528f-0a66-4efa-a75e-52f48ccdce2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:55.442160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac74528f-0a66-4efa-a75e-52f48ccdce2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:55.442916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac74528f-0a66-4efa-a75e-52f48ccdce2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:55.443346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac74528f-0a66-4efa-a75e-52f48ccdce2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:55.457479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:43:55.473419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ac74528f-0a66-4efa-a75e-52f48ccdce2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044762 Aug 01 15:43:55.473993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 690/1460] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:55 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:55.858962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b057f46c-cb0b-4808-a821-7aa11f6fb394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:55.859688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b057f46c-cb0b-4808-a821-7aa11f6fb394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:55.866352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b057f46c-cb0b-4808-a821-7aa11f6fb394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:55.866816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b057f46c-cb0b-4808-a821-7aa11f6fb394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:55.867609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b057f46c-cb0b-4808-a821-7aa11f6fb394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:55.868059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b057f46c-cb0b-4808-a821-7aa11f6fb394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:56.001775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b057f46c-cb0b-4808-a821-7aa11f6fb394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:56.009357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b057f46c-cb0b-4808-a821-7aa11f6fb394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154557 Aug 01 15:43:56.009923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 771/1461] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:55 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:56.364015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6768713b-7134-48a1-9c4a-ea7f4da9477b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:56.366249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6768713b-7134-48a1-9c4a-ea7f4da9477b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:56.372750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6768713b-7134-48a1-9c4a-ea7f4da9477b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:56.373155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6768713b-7134-48a1-9c4a-ea7f4da9477b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:56.373927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6768713b-7134-48a1-9c4a-ea7f4da9477b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:56.374364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6768713b-7134-48a1-9c4a-ea7f4da9477b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:56.406185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6768713b-7134-48a1-9c4a-ea7f4da9477b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046155 Aug 01 15:43:56.406743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 691/1462] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:56.486280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-365ab37f-b07b-4f3d-b822-d743fc0c4552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:56.488487 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-365ab37f-b07b-4f3d-b822-d743fc0c4552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:56.494648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-365ab37f-b07b-4f3d-b822-d743fc0c4552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:56.495101 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-365ab37f-b07b-4f3d-b822-d743fc0c4552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:56.495865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-365ab37f-b07b-4f3d-b822-d743fc0c4552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:56.496424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-365ab37f-b07b-4f3d-b822-d743fc0c4552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:56.526581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-365ab37f-b07b-4f3d-b822-d743fc0c4552 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Aug 01 15:43:56.527143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 772/1463] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:56 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:43:57.032405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4088cf7b-4800-4f13-a1dd-e2f84e5cbc41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:57.033023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4088cf7b-4800-4f13-a1dd-e2f84e5cbc41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:57.039300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4088cf7b-4800-4f13-a1dd-e2f84e5cbc41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:57.039754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4088cf7b-4800-4f13-a1dd-e2f84e5cbc41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:57.040524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4088cf7b-4800-4f13-a1dd-e2f84e5cbc41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:57.040966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4088cf7b-4800-4f13-a1dd-e2f84e5cbc41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:57.174581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4088cf7b-4800-4f13-a1dd-e2f84e5cbc41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:57.182111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4088cf7b-4800-4f13-a1dd-e2f84e5cbc41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154396 Aug 01 15:43:57.182686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 692/1464] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:57 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:57.418776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-447c301e-9fb3-41c3-abb1-97acae35e016 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:57.420908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-447c301e-9fb3-41c3-abb1-97acae35e016 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:57.427493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-447c301e-9fb3-41c3-abb1-97acae35e016 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:57.428296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-447c301e-9fb3-41c3-abb1-97acae35e016 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:57.428951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-447c301e-9fb3-41c3-abb1-97acae35e016 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:57.429946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-447c301e-9fb3-41c3-abb1-97acae35e016 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:57.460018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-447c301e-9fb3-41c3-abb1-97acae35e016 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045220 Aug 01 15:43:57.460575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 773/1465] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:57.539100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-84320b49-d45f-4866-97b6-1d3d1db39669 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:57.541266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-84320b49-d45f-4866-97b6-1d3d1db39669 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:57.547862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84320b49-d45f-4866-97b6-1d3d1db39669 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:57.548313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84320b49-d45f-4866-97b6-1d3d1db39669 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:57.549075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84320b49-d45f-4866-97b6-1d3d1db39669 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:57.549509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84320b49-d45f-4866-97b6-1d3d1db39669 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:57.579249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-84320b49-d45f-4866-97b6-1d3d1db39669 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044148 Aug 01 15:43:57.579804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 693/1466] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:57 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:58.203692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-397e41b2-dbd5-41a8-9b27-a37e40d58870 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:58.204300 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-397e41b2-dbd5-41a8-9b27-a37e40d58870 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:58.210309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-397e41b2-dbd5-41a8-9b27-a37e40d58870 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:58.210749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-397e41b2-dbd5-41a8-9b27-a37e40d58870 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:58.211499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-397e41b2-dbd5-41a8-9b27-a37e40d58870 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:58.211929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-397e41b2-dbd5-41a8-9b27-a37e40d58870 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:58.342533 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-397e41b2-dbd5-41a8-9b27-a37e40d58870 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:58.350289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-397e41b2-dbd5-41a8-9b27-a37e40d58870 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.150543 Aug 01 15:43:58.350856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 774/1467] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:58 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:58.472853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-48e1dedc-c8e6-4cd3-b991-695ee060682d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:58.475057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-48e1dedc-c8e6-4cd3-b991-695ee060682d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:58.481258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48e1dedc-c8e6-4cd3-b991-695ee060682d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:58.481708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48e1dedc-c8e6-4cd3-b991-695ee060682d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:58.483014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48e1dedc-c8e6-4cd3-b991-695ee060682d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:58.483452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48e1dedc-c8e6-4cd3-b991-695ee060682d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:58.512521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-48e1dedc-c8e6-4cd3-b991-695ee060682d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043982 Aug 01 15:43:58.513083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 694/1468] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:43:58.591272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cef3d1ca-923f-4cba-a7b3-21111ed40ed3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:58.594308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cef3d1ca-923f-4cba-a7b3-21111ed40ed3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:58.600719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cef3d1ca-923f-4cba-a7b3-21111ed40ed3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:58.601160 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cef3d1ca-923f-4cba-a7b3-21111ed40ed3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:58.602004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cef3d1ca-923f-4cba-a7b3-21111ed40ed3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:58.602442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cef3d1ca-923f-4cba-a7b3-21111ed40ed3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:58.631191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cef3d1ca-923f-4cba-a7b3-21111ed40ed3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 Aug 01 15:43:58.631739 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 775/1469] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:58 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:43:59.371860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-17cf2c80-91a8-4a0e-ab2c-dec38860e9c1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:59.372514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-17cf2c80-91a8-4a0e-ab2c-dec38860e9c1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:59.379973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-17cf2c80-91a8-4a0e-ab2c-dec38860e9c1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:59.380506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-17cf2c80-91a8-4a0e-ab2c-dec38860e9c1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:59.381290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-17cf2c80-91a8-4a0e-ab2c-dec38860e9c1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:59.381969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-17cf2c80-91a8-4a0e-ab2c-dec38860e9c1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:59.514980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-17cf2c80-91a8-4a0e-ab2c-dec38860e9c1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:43:59.522543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-17cf2c80-91a8-4a0e-ab2c-dec38860e9c1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154613 Aug 01 15:43:59.523111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 695/1470] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:43:59 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:43:59.525439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a831a97b-eb82-4b35-bab4-f9af1fc375b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:59.527626 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a831a97b-eb82-4b35-bab4-f9af1fc375b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:59.533837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a831a97b-eb82-4b35-bab4-f9af1fc375b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:59.534325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a831a97b-eb82-4b35-bab4-f9af1fc375b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:59.535094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a831a97b-eb82-4b35-bab4-f9af1fc375b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:59.535532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a831a97b-eb82-4b35-bab4-f9af1fc375b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:59.565450 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a831a97b-eb82-4b35-bab4-f9af1fc375b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043874 Aug 01 15:43:59.566036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 776/1471] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:43:59 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:43:59.643531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2ed59209-06d8-4f8e-bf0f-8c7789305780 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:43:59.645631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2ed59209-06d8-4f8e-bf0f-8c7789305780 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:43:59.651736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ed59209-06d8-4f8e-bf0f-8c7789305780 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:59.652188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ed59209-06d8-4f8e-bf0f-8c7789305780 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:59.652971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ed59209-06d8-4f8e-bf0f-8c7789305780 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:43:59.653396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ed59209-06d8-4f8e-bf0f-8c7789305780 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:43:59.683250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2ed59209-06d8-4f8e-bf0f-8c7789305780 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043727 Aug 01 15:43:59.683792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 696/1472] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:43:59 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:00.544539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-797c2251-4e71-4514-ba78-b91363937f13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:00.545183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-797c2251-4e71-4514-ba78-b91363937f13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:00.551655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-797c2251-4e71-4514-ba78-b91363937f13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:00.552100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-797c2251-4e71-4514-ba78-b91363937f13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:00.552854 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-797c2251-4e71-4514-ba78-b91363937f13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:00.553285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-797c2251-4e71-4514-ba78-b91363937f13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:00.578660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1ce80033-5334-48e5-aad9-f86e56bdd033 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:00.580834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1ce80033-5334-48e5-aad9-f86e56bdd033 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:00.587606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ce80033-5334-48e5-aad9-f86e56bdd033 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:00.588063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ce80033-5334-48e5-aad9-f86e56bdd033 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:00.588848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ce80033-5334-48e5-aad9-f86e56bdd033 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:00.589286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ce80033-5334-48e5-aad9-f86e56bdd033 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:00.619580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1ce80033-5334-48e5-aad9-f86e56bdd033 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045573 Aug 01 15:44:00.620156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 697/1473] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:44:00.687670 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-797c2251-4e71-4514-ba78-b91363937f13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:00.695313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-797c2251-4e71-4514-ba78-b91363937f13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154615 Aug 01 15:44:00.695562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-19b21b56-978e-4d07-99b2-fadcb3123c33 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:00.695917 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 777/1474] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:00 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:00.697871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-19b21b56-978e-4d07-99b2-fadcb3123c33 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:00.704830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19b21b56-978e-4d07-99b2-fadcb3123c33 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:00.705335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19b21b56-978e-4d07-99b2-fadcb3123c33 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:00.706142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19b21b56-978e-4d07-99b2-fadcb3123c33 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:00.706577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19b21b56-978e-4d07-99b2-fadcb3123c33 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:00.736614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-19b21b56-978e-4d07-99b2-fadcb3123c33 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045069 Aug 01 15:44:00.737171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 698/1475] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:00 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:44:01.632563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8db61dc2-aa12-486b-a33c-ed74b47ff601 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:01.634756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8db61dc2-aa12-486b-a33c-ed74b47ff601 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:01.641250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8db61dc2-aa12-486b-a33c-ed74b47ff601 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:01.641699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8db61dc2-aa12-486b-a33c-ed74b47ff601 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:01.642504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8db61dc2-aa12-486b-a33c-ed74b47ff601 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:01.642942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8db61dc2-aa12-486b-a33c-ed74b47ff601 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:01.671707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8db61dc2-aa12-486b-a33c-ed74b47ff601 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043133 Aug 01 15:44:01.672264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 778/1476] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:01.716720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0cf8297a-b190-45f8-95f2-cc21d9231c4a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:01.717327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0cf8297a-b190-45f8-95f2-cc21d9231c4a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:01.724085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0cf8297a-b190-45f8-95f2-cc21d9231c4a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:01.724525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0cf8297a-b190-45f8-95f2-cc21d9231c4a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:01.725277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0cf8297a-b190-45f8-95f2-cc21d9231c4a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:01.725708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0cf8297a-b190-45f8-95f2-cc21d9231c4a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:01.749263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0aa18798-8be0-43d0-b088-ea735df090e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:01.751449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0aa18798-8be0-43d0-b088-ea735df090e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:01.757604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0aa18798-8be0-43d0-b088-ea735df090e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:01.758085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0aa18798-8be0-43d0-b088-ea735df090e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:01.758849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0aa18798-8be0-43d0-b088-ea735df090e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:01.759283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0aa18798-8be0-43d0-b088-ea735df090e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:01.789408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0aa18798-8be0-43d0-b088-ea735df090e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044588 Aug 01 15:44:01.790175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 779/1477] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:01 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:44:01.865528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0cf8297a-b190-45f8-95f2-cc21d9231c4a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:01.873146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0cf8297a-b190-45f8-95f2-cc21d9231c4a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.160361 Aug 01 15:44:01.873713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 699/1478] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:01 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:02.684449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b47dc59f-d3a5-4c28-9cbc-cbc2387dc62e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:02.687128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b47dc59f-d3a5-4c28-9cbc-cbc2387dc62e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:02.689460 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=82 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:02.694827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b47dc59f-d3a5-4c28-9cbc-cbc2387dc62e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:02.695276 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b47dc59f-d3a5-4c28-9cbc-cbc2387dc62e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:02.696043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b47dc59f-d3a5-4c28-9cbc-cbc2387dc62e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:02.696478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b47dc59f-d3a5-4c28-9cbc-cbc2387dc62e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:02.722338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:02.727392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b47dc59f-d3a5-4c28-9cbc-cbc2387dc62e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047032 Aug 01 15:44:02.727954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 780/1479] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:02.801939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0fc3ebf5-37f8-4dc4-9bbb-adf4a36499ba tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:02.804093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0fc3ebf5-37f8-4dc4-9bbb-adf4a36499ba tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:02.811326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0fc3ebf5-37f8-4dc4-9bbb-adf4a36499ba tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:02.811775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0fc3ebf5-37f8-4dc4-9bbb-adf4a36499ba tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:02.812542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0fc3ebf5-37f8-4dc4-9bbb-adf4a36499ba tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:02.812974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0fc3ebf5-37f8-4dc4-9bbb-adf4a36499ba tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:02.842280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0fc3ebf5-37f8-4dc4-9bbb-adf4a36499ba tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Aug 01 15:44:02.842843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 700/1480] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:02 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:02.894734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6a299f9d-676f-4ccc-85b2-2a25d66dabc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:02.895338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6a299f9d-676f-4ccc-85b2-2a25d66dabc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:02.901456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a299f9d-676f-4ccc-85b2-2a25d66dabc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:02.901917 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a299f9d-676f-4ccc-85b2-2a25d66dabc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:02.902712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a299f9d-676f-4ccc-85b2-2a25d66dabc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:02.903142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a299f9d-676f-4ccc-85b2-2a25d66dabc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:03.036905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6a299f9d-676f-4ccc-85b2-2a25d66dabc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:03.044447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6a299f9d-676f-4ccc-85b2-2a25d66dabc4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153732 Aug 01 15:44:03.045505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 781/1481] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:02 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:44:03.802263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-244a8997-7f6f-4a5f-b054-db96dc253c0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:03.804578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-244a8997-7f6f-4a5f-b054-db96dc253c0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:03.811506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-244a8997-7f6f-4a5f-b054-db96dc253c0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:03.811956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-244a8997-7f6f-4a5f-b054-db96dc253c0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:03.812718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-244a8997-7f6f-4a5f-b054-db96dc253c0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:03.813155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-244a8997-7f6f-4a5f-b054-db96dc253c0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:03.841681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-244a8997-7f6f-4a5f-b054-db96dc253c0e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105525 Aug 01 15:44:03.842274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 701/1482] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:03.854975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9355280c-0a8d-4435-9dd8-431333f0928f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:03.857148 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9355280c-0a8d-4435-9dd8-431333f0928f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:03.864277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9355280c-0a8d-4435-9dd8-431333f0928f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:03.864725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9355280c-0a8d-4435-9dd8-431333f0928f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:03.865488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9355280c-0a8d-4435-9dd8-431333f0928f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:03.865955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9355280c-0a8d-4435-9dd8-431333f0928f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:03.896112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9355280c-0a8d-4435-9dd8-431333f0928f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045186 Aug 01 15:44:03.896677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 782/1483] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:03 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:04.067133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-65d0bf18-11c8-48d0-81f0-a92de8e3ed51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:04.067749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-65d0bf18-11c8-48d0-81f0-a92de8e3ed51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:04.073858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65d0bf18-11c8-48d0-81f0-a92de8e3ed51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:04.074349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65d0bf18-11c8-48d0-81f0-a92de8e3ed51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:04.075119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65d0bf18-11c8-48d0-81f0-a92de8e3ed51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:04.075585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65d0bf18-11c8-48d0-81f0-a92de8e3ed51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:04.205919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-65d0bf18-11c8-48d0-81f0-a92de8e3ed51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:04.213524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-65d0bf18-11c8-48d0-81f0-a92de8e3ed51 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.150269 Aug 01 15:44:04.214118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 702/1484] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:04 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:04.856192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f64be496-a2b7-467d-934a-9f3a765483af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:04.858463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f64be496-a2b7-467d-934a-9f3a765483af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:04.865144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f64be496-a2b7-467d-934a-9f3a765483af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:04.865589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f64be496-a2b7-467d-934a-9f3a765483af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:04.866380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f64be496-a2b7-467d-934a-9f3a765483af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:04.866814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f64be496-a2b7-467d-934a-9f3a765483af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:04.897911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f64be496-a2b7-467d-934a-9f3a765483af tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045757 Aug 01 15:44:04.898488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 783/1485] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:04 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:04.908514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-15e38718-91ae-48c6-9c11-4fb089064b4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:04.910783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-15e38718-91ae-48c6-9c11-4fb089064b4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:04.917332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15e38718-91ae-48c6-9c11-4fb089064b4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:04.917777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15e38718-91ae-48c6-9c11-4fb089064b4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:04.918572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15e38718-91ae-48c6-9c11-4fb089064b4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:04.919002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15e38718-91ae-48c6-9c11-4fb089064b4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:04.947903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-15e38718-91ae-48c6-9c11-4fb089064b4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043385 Aug 01 15:44:04.948457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 703/1486] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:04 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:05.235746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e1fc31e2-c287-41c2-a38d-c9d8a1fe8e63 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:05.236391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e1fc31e2-c287-41c2-a38d-c9d8a1fe8e63 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:05.242487 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e1fc31e2-c287-41c2-a38d-c9d8a1fe8e63 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:05.242937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e1fc31e2-c287-41c2-a38d-c9d8a1fe8e63 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:05.243698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e1fc31e2-c287-41c2-a38d-c9d8a1fe8e63 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:05.244142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e1fc31e2-c287-41c2-a38d-c9d8a1fe8e63 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:05.394321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e1fc31e2-c287-41c2-a38d-c9d8a1fe8e63 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:05.401863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e1fc31e2-c287-41c2-a38d-c9d8a1fe8e63 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.170096 Aug 01 15:44:05.402450 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 784/1487] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:05 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:05.910968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9e501a34-8fa8-4f16-9d67-76fd0b66d81f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:05.913056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9e501a34-8fa8-4f16-9d67-76fd0b66d81f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:05.919627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e501a34-8fa8-4f16-9d67-76fd0b66d81f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:05.920111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e501a34-8fa8-4f16-9d67-76fd0b66d81f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:05.920880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e501a34-8fa8-4f16-9d67-76fd0b66d81f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:05.921317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e501a34-8fa8-4f16-9d67-76fd0b66d81f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:05.950718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9e501a34-8fa8-4f16-9d67-76fd0b66d81f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044147 Aug 01 15:44:05.951964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 704/1488] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:05.969919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-41db6522-7e14-4c10-801c-f3e9b59afafc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:05.972307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-41db6522-7e14-4c10-801c-f3e9b59afafc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:05.979679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41db6522-7e14-4c10-801c-f3e9b59afafc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:05.980117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41db6522-7e14-4c10-801c-f3e9b59afafc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:05.980882 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41db6522-7e14-4c10-801c-f3e9b59afafc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:05.981310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41db6522-7e14-4c10-801c-f3e9b59afafc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:06.012616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-41db6522-7e14-4c10-801c-f3e9b59afafc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048520 Aug 01 15:44:06.013315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 785/1489] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:05 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:06.424362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a4aa3a27-7555-412f-bf07-8771bbe4d2eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:06.424981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a4aa3a27-7555-412f-bf07-8771bbe4d2eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:06.431080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4aa3a27-7555-412f-bf07-8771bbe4d2eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:06.431529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4aa3a27-7555-412f-bf07-8771bbe4d2eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:06.432294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4aa3a27-7555-412f-bf07-8771bbe4d2eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:06.432734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4aa3a27-7555-412f-bf07-8771bbe4d2eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:06.561527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a4aa3a27-7555-412f-bf07-8771bbe4d2eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:06.569011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a4aa3a27-7555-412f-bf07-8771bbe4d2eb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.149177 Aug 01 15:44:06.569636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 705/1490] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:06 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:06.968111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-88622062-1858-4921-b137-a0d6fef9243e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:06.970587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-88622062-1858-4921-b137-a0d6fef9243e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:06.977315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-88622062-1858-4921-b137-a0d6fef9243e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:06.977777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-88622062-1858-4921-b137-a0d6fef9243e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:06.978567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-88622062-1858-4921-b137-a0d6fef9243e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:06.979008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-88622062-1858-4921-b137-a0d6fef9243e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:07.009304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-88622062-1858-4921-b137-a0d6fef9243e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045775 Aug 01 15:44:07.009877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 786/1491] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:07.026563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4a37db6d-4b01-45d7-a4bb-aa69d23b0e6f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:07.028810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4a37db6d-4b01-45d7-a4bb-aa69d23b0e6f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:07.036191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a37db6d-4b01-45d7-a4bb-aa69d23b0e6f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:07.036623 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a37db6d-4b01-45d7-a4bb-aa69d23b0e6f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:07.037496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a37db6d-4b01-45d7-a4bb-aa69d23b0e6f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:07.037822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a37db6d-4b01-45d7-a4bb-aa69d23b0e6f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:07.070742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4a37db6d-4b01-45d7-a4bb-aa69d23b0e6f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049414 Aug 01 15:44:07.071308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 706/1492] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:07 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:07.590411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5587fb99-9b9a-447a-8ba1-4eba7c548349 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:07.591016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5587fb99-9b9a-447a-8ba1-4eba7c548349 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:07.597315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5587fb99-9b9a-447a-8ba1-4eba7c548349 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:07.597753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5587fb99-9b9a-447a-8ba1-4eba7c548349 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:07.598535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5587fb99-9b9a-447a-8ba1-4eba7c548349 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:07.598961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5587fb99-9b9a-447a-8ba1-4eba7c548349 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:07.738313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5587fb99-9b9a-447a-8ba1-4eba7c548349 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:07.745753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5587fb99-9b9a-447a-8ba1-4eba7c548349 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.159152 Aug 01 15:44:07.746339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 787/1493] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:07 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:08.022335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4f7b312d-7bcd-4306-aaab-2ea2b7b61f05 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:08.024581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4f7b312d-7bcd-4306-aaab-2ea2b7b61f05 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:08.031456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f7b312d-7bcd-4306-aaab-2ea2b7b61f05 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:08.032058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f7b312d-7bcd-4306-aaab-2ea2b7b61f05 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:08.032671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f7b312d-7bcd-4306-aaab-2ea2b7b61f05 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:08.033109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f7b312d-7bcd-4306-aaab-2ea2b7b61f05 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:08.036017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:08.064247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4f7b312d-7bcd-4306-aaab-2ea2b7b61f05 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045892 Aug 01 15:44:08.064830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 707/1494] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:08.082747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1e5d1738-8a38-4982-847e-7cdb8e42189d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:08.084916 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1e5d1738-8a38-4982-847e-7cdb8e42189d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:08.091404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e5d1738-8a38-4982-847e-7cdb8e42189d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:08.092367 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e5d1738-8a38-4982-847e-7cdb8e42189d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:08.093130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e5d1738-8a38-4982-847e-7cdb8e42189d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:08.093821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e5d1738-8a38-4982-847e-7cdb8e42189d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:08.122950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1e5d1738-8a38-4982-847e-7cdb8e42189d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043994 Aug 01 15:44:08.123501 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 788/1495] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:08 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:08.768296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-302b5e1a-2fd6-4ec0-9102-e4ce85a89f06 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:08.768914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-302b5e1a-2fd6-4ec0-9102-e4ce85a89f06 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:08.775169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-302b5e1a-2fd6-4ec0-9102-e4ce85a89f06 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:08.775647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-302b5e1a-2fd6-4ec0-9102-e4ce85a89f06 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:08.776420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-302b5e1a-2fd6-4ec0-9102-e4ce85a89f06 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:08.776938 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-302b5e1a-2fd6-4ec0-9102-e4ce85a89f06 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:08.908640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-302b5e1a-2fd6-4ec0-9102-e4ce85a89f06 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:08.916334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-302b5e1a-2fd6-4ec0-9102-e4ce85a89f06 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152545 Aug 01 15:44:08.916914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 708/1496] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:08 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:09.076629 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d38dcd89-e187-42e1-b38f-7abe1015a4c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:09.078835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d38dcd89-e187-42e1-b38f-7abe1015a4c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:09.084939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d38dcd89-e187-42e1-b38f-7abe1015a4c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:09.085502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d38dcd89-e187-42e1-b38f-7abe1015a4c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:09.086180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d38dcd89-e187-42e1-b38f-7abe1015a4c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:09.086621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d38dcd89-e187-42e1-b38f-7abe1015a4c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:09.116776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d38dcd89-e187-42e1-b38f-7abe1015a4c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044122 Aug 01 15:44:09.117405 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 789/1497] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:09.134512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8aaca7d9-3f3e-40cd-85e6-07180f22cc3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:09.136749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8aaca7d9-3f3e-40cd-85e6-07180f22cc3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:09.143251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8aaca7d9-3f3e-40cd-85e6-07180f22cc3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:09.143700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8aaca7d9-3f3e-40cd-85e6-07180f22cc3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:09.144464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8aaca7d9-3f3e-40cd-85e6-07180f22cc3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:09.144900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8aaca7d9-3f3e-40cd-85e6-07180f22cc3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:09.174131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8aaca7d9-3f3e-40cd-85e6-07180f22cc3a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Aug 01 15:44:09.174692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 709/1498] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:09 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:09.938399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-97b712d4-32f2-416f-bd29-93eacfb047c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:09.939046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-97b712d4-32f2-416f-bd29-93eacfb047c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:09.945198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-97b712d4-32f2-416f-bd29-93eacfb047c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:09.945650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-97b712d4-32f2-416f-bd29-93eacfb047c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:09.946455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-97b712d4-32f2-416f-bd29-93eacfb047c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:09.946897 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-97b712d4-32f2-416f-bd29-93eacfb047c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:10.080434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-97b712d4-32f2-416f-bd29-93eacfb047c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:10.088428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-97b712d4-32f2-416f-bd29-93eacfb047c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154011 Aug 01 15:44:10.089036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 790/1499] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:09 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:10.130290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-35bd5cb3-6314-4bb9-a6e0-aa68a36f7989 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:10.132511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-35bd5cb3-6314-4bb9-a6e0-aa68a36f7989 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:10.139327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35bd5cb3-6314-4bb9-a6e0-aa68a36f7989 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:10.139914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35bd5cb3-6314-4bb9-a6e0-aa68a36f7989 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:10.140519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35bd5cb3-6314-4bb9-a6e0-aa68a36f7989 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:10.140950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35bd5cb3-6314-4bb9-a6e0-aa68a36f7989 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:10.169721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-35bd5cb3-6314-4bb9-a6e0-aa68a36f7989 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043652 Aug 01 15:44:10.170314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 710/1500] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:10 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:10.186815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0a20ea52-e3c1-4e7b-99f0-44eb4867517e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:10.189043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0a20ea52-e3c1-4e7b-99f0-44eb4867517e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:10.195514 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0a20ea52-e3c1-4e7b-99f0-44eb4867517e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:10.195966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0a20ea52-e3c1-4e7b-99f0-44eb4867517e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:10.196731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0a20ea52-e3c1-4e7b-99f0-44eb4867517e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:10.197167 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0a20ea52-e3c1-4e7b-99f0-44eb4867517e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:10.226518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0a20ea52-e3c1-4e7b-99f0-44eb4867517e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Aug 01 15:44:10.227077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 791/1501] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:10 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:11.113546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-085a4626-d13a-4e4c-a25e-334b2a1ab2ef tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:11.114190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-085a4626-d13a-4e4c-a25e-334b2a1ab2ef tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:11.120214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-085a4626-d13a-4e4c-a25e-334b2a1ab2ef tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:11.120661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-085a4626-d13a-4e4c-a25e-334b2a1ab2ef tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:11.121422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-085a4626-d13a-4e4c-a25e-334b2a1ab2ef tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:11.121859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-085a4626-d13a-4e4c-a25e-334b2a1ab2ef tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:11.182500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e9031d25-fa85-4be8-be17-c9da6573a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:11.185056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e9031d25-fa85-4be8-be17-c9da6573a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:11.191751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9031d25-fa85-4be8-be17-c9da6573a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:11.192206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9031d25-fa85-4be8-be17-c9da6573a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:11.192983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9031d25-fa85-4be8-be17-c9da6573a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:11.193452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9031d25-fa85-4be8-be17-c9da6573a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:11.224788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e9031d25-fa85-4be8-be17-c9da6573a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046382 Aug 01 15:44:11.225354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 792/1502] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:11 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:44:11.238811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0bbce0e8-6e00-4399-b830-8abad6bd2408 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:11.240886 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0bbce0e8-6e00-4399-b830-8abad6bd2408 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:11.246938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0bbce0e8-6e00-4399-b830-8abad6bd2408 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:11.247386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0bbce0e8-6e00-4399-b830-8abad6bd2408 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:11.248194 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0bbce0e8-6e00-4399-b830-8abad6bd2408 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:11.248702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0bbce0e8-6e00-4399-b830-8abad6bd2408 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:11.260039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-085a4626-d13a-4e4c-a25e-334b2a1ab2ef tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:11.268043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-085a4626-d13a-4e4c-a25e-334b2a1ab2ef tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158384 Aug 01 15:44:11.268622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 711/1503] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:11 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:11.278349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0bbce0e8-6e00-4399-b830-8abad6bd2408 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043452 Aug 01 15:44:11.278900 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 793/1504] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:11 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:44:12.237386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-71d31e39-ee3a-4e2c-b349-da8a3ea06b1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:12.239669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-71d31e39-ee3a-4e2c-b349-da8a3ea06b1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:12.246368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-71d31e39-ee3a-4e2c-b349-da8a3ea06b1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:12.246752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-71d31e39-ee3a-4e2c-b349-da8a3ea06b1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:12.247520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-71d31e39-ee3a-4e2c-b349-da8a3ea06b1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:12.248514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-71d31e39-ee3a-4e2c-b349-da8a3ea06b1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:12.277216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-71d31e39-ee3a-4e2c-b349-da8a3ea06b1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043866 Aug 01 15:44:12.277913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 712/1505] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:12.290204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9e4355bb-9a7e-4625-be8e-392f34b6c3fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:12.291119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9e4355bb-9a7e-4625-be8e-392f34b6c3fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:12.298022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e4355bb-9a7e-4625-be8e-392f34b6c3fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:12.298807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e4355bb-9a7e-4625-be8e-392f34b6c3fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:12.300251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e4355bb-9a7e-4625-be8e-392f34b6c3fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:12.300251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e4355bb-9a7e-4625-be8e-392f34b6c3fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:12.355412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-70f26399-2575-40ae-9d97-b927d5004431 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:12.358322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-70f26399-2575-40ae-9d97-b927d5004431 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:12.364786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70f26399-2575-40ae-9d97-b927d5004431 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:12.365245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70f26399-2575-40ae-9d97-b927d5004431 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:12.366141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70f26399-2575-40ae-9d97-b927d5004431 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:12.366580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70f26399-2575-40ae-9d97-b927d5004431 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:12.396337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-70f26399-2575-40ae-9d97-b927d5004431 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109371 Aug 01 15:44:12.396916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 713/1506] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:12 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:44:12.434597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9e4355bb-9a7e-4625-be8e-392f34b6c3fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:12.442398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9e4355bb-9a7e-4625-be8e-392f34b6c3fe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156129 Aug 01 15:44:12.442968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 794/1507] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:12 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:13.288790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7b5eff7b-5069-47b8-932a-e70aabf8fc06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:13.291004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7b5eff7b-5069-47b8-932a-e70aabf8fc06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:13.297596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b5eff7b-5069-47b8-932a-e70aabf8fc06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:13.298097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b5eff7b-5069-47b8-932a-e70aabf8fc06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:13.298868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b5eff7b-5069-47b8-932a-e70aabf8fc06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:13.299305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b5eff7b-5069-47b8-932a-e70aabf8fc06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:13.328950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7b5eff7b-5069-47b8-932a-e70aabf8fc06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044051 Aug 01 15:44:13.329420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 714/1508] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:13.408663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-114495c0-ff2f-4911-837d-83c3af27b1bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:13.410855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-114495c0-ff2f-4911-837d-83c3af27b1bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:13.417733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-114495c0-ff2f-4911-837d-83c3af27b1bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:13.418226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-114495c0-ff2f-4911-837d-83c3af27b1bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:13.419021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-114495c0-ff2f-4911-837d-83c3af27b1bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:13.419509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-114495c0-ff2f-4911-837d-83c3af27b1bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:13.447906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-114495c0-ff2f-4911-837d-83c3af27b1bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043370 Aug 01 15:44:13.448458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 795/1509] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:13 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:13.463022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e907ad6d-62ee-411d-b0e5-4fb60b345906 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:13.463662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e907ad6d-62ee-411d-b0e5-4fb60b345906 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:13.470589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e907ad6d-62ee-411d-b0e5-4fb60b345906 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:13.471033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e907ad6d-62ee-411d-b0e5-4fb60b345906 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:13.471814 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e907ad6d-62ee-411d-b0e5-4fb60b345906 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:13.472246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e907ad6d-62ee-411d-b0e5-4fb60b345906 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:13.606495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e907ad6d-62ee-411d-b0e5-4fb60b345906 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:13.614155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e907ad6d-62ee-411d-b0e5-4fb60b345906 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154945 Aug 01 15:44:13.614726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 715/1510] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:13 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:14.341453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-89aadacb-0053-42dd-be5e-45954bf83523 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:14.344322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-89aadacb-0053-42dd-be5e-45954bf83523 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:14.350649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89aadacb-0053-42dd-be5e-45954bf83523 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:14.351094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89aadacb-0053-42dd-be5e-45954bf83523 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:14.351846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89aadacb-0053-42dd-be5e-45954bf83523 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:14.352279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89aadacb-0053-42dd-be5e-45954bf83523 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:14.381311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-89aadacb-0053-42dd-be5e-45954bf83523 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044020 Aug 01 15:44:14.381869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 796/1511] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:14.460845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2e7e9324-b582-4648-bff1-f537a16037ad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:14.463074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2e7e9324-b582-4648-bff1-f537a16037ad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:14.470390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e7e9324-b582-4648-bff1-f537a16037ad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:14.470862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e7e9324-b582-4648-bff1-f537a16037ad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:14.471616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e7e9324-b582-4648-bff1-f537a16037ad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:14.472051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e7e9324-b582-4648-bff1-f537a16037ad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:14.502798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2e7e9324-b582-4648-bff1-f537a16037ad tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045844 Aug 01 15:44:14.503372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 716/1512] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:14 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:14.635956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-419551ea-ebc7-41b9-95d7-70a103c43502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:14.636699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-419551ea-ebc7-41b9-95d7-70a103c43502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:14.643749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-419551ea-ebc7-41b9-95d7-70a103c43502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:14.644190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-419551ea-ebc7-41b9-95d7-70a103c43502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:14.644954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-419551ea-ebc7-41b9-95d7-70a103c43502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:14.645380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-419551ea-ebc7-41b9-95d7-70a103c43502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:14.663463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:14.778823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-419551ea-ebc7-41b9-95d7-70a103c43502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:14.787218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-419551ea-ebc7-41b9-95d7-70a103c43502 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155091 Aug 01 15:44:14.787822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 797/1513] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:14 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:15.393573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-644b12da-1a4f-4e01-98c1-bf1c998c2c5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:15.395800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-644b12da-1a4f-4e01-98c1-bf1c998c2c5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:15.401976 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-644b12da-1a4f-4e01-98c1-bf1c998c2c5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:15.402429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-644b12da-1a4f-4e01-98c1-bf1c998c2c5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:15.403198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-644b12da-1a4f-4e01-98c1-bf1c998c2c5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:15.403636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-644b12da-1a4f-4e01-98c1-bf1c998c2c5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:15.432455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-644b12da-1a4f-4e01-98c1-bf1c998c2c5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042912 Aug 01 15:44:15.433004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 717/1514] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:15.519620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-446e94f7-a2a6-4f58-ace6-33254c4c4908 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:15.521976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-446e94f7-a2a6-4f58-ace6-33254c4c4908 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:15.528383 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-446e94f7-a2a6-4f58-ace6-33254c4c4908 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:15.528844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-446e94f7-a2a6-4f58-ace6-33254c4c4908 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:15.529806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-446e94f7-a2a6-4f58-ace6-33254c4c4908 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:15.530288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-446e94f7-a2a6-4f58-ace6-33254c4c4908 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:15.559569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-446e94f7-a2a6-4f58-ace6-33254c4c4908 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047990 Aug 01 15:44:15.560127 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 798/1515] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:15 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:15.809193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e05402bf-cacf-4c90-a675-22b5517cfe3e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:15.809837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e05402bf-cacf-4c90-a675-22b5517cfe3e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:15.817859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e05402bf-cacf-4c90-a675-22b5517cfe3e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:15.817859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e05402bf-cacf-4c90-a675-22b5517cfe3e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:15.817859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e05402bf-cacf-4c90-a675-22b5517cfe3e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:15.818265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e05402bf-cacf-4c90-a675-22b5517cfe3e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:15.950341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e05402bf-cacf-4c90-a675-22b5517cfe3e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:15.957972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e05402bf-cacf-4c90-a675-22b5517cfe3e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152693 Aug 01 15:44:15.958534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 718/1516] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:15 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:16.445458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-acaeb3fd-72c2-4776-a7ac-e75ae53a9773 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:16.447729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-acaeb3fd-72c2-4776-a7ac-e75ae53a9773 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:16.454379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acaeb3fd-72c2-4776-a7ac-e75ae53a9773 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:16.454833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acaeb3fd-72c2-4776-a7ac-e75ae53a9773 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:16.455600 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acaeb3fd-72c2-4776-a7ac-e75ae53a9773 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:16.456037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acaeb3fd-72c2-4776-a7ac-e75ae53a9773 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:16.485160 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-acaeb3fd-72c2-4776-a7ac-e75ae53a9773 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043702 Aug 01 15:44:16.485719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 799/1517] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:16 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:16.572564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fcaf6bde-2104-4f26-a654-2b04f9266b90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:16.574891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fcaf6bde-2104-4f26-a654-2b04f9266b90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:16.581446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fcaf6bde-2104-4f26-a654-2b04f9266b90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:16.581904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fcaf6bde-2104-4f26-a654-2b04f9266b90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:16.582665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fcaf6bde-2104-4f26-a654-2b04f9266b90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:16.583092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fcaf6bde-2104-4f26-a654-2b04f9266b90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:16.611587 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fcaf6bde-2104-4f26-a654-2b04f9266b90 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043010 Aug 01 15:44:16.612129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 719/1518] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:16 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:16.979300 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-da6596bb-52f0-4e8b-960d-2dee6b9dd0ce tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:16.979944 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-da6596bb-52f0-4e8b-960d-2dee6b9dd0ce tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:16.987148 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da6596bb-52f0-4e8b-960d-2dee6b9dd0ce tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:16.987590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da6596bb-52f0-4e8b-960d-2dee6b9dd0ce tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:16.988339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da6596bb-52f0-4e8b-960d-2dee6b9dd0ce tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:16.988766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-da6596bb-52f0-4e8b-960d-2dee6b9dd0ce tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:17.129456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-da6596bb-52f0-4e8b-960d-2dee6b9dd0ce tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:17.137582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-da6596bb-52f0-4e8b-960d-2dee6b9dd0ce tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.162203 Aug 01 15:44:17.138283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 800/1519] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:16 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:17.498379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-427144fe-08b9-4d0a-9d2d-a3c17eab69ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:17.500626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-427144fe-08b9-4d0a-9d2d-a3c17eab69ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:17.507187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-427144fe-08b9-4d0a-9d2d-a3c17eab69ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:17.507634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-427144fe-08b9-4d0a-9d2d-a3c17eab69ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:17.508448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-427144fe-08b9-4d0a-9d2d-a3c17eab69ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:17.508840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-427144fe-08b9-4d0a-9d2d-a3c17eab69ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:17.537875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-427144fe-08b9-4d0a-9d2d-a3c17eab69ab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044156 Aug 01 15:44:17.538453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 720/1520] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:17.623969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9278cdb9-819d-49a7-9eaf-2a0334aa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:17.626799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9278cdb9-819d-49a7-9eaf-2a0334aa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:17.633214 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9278cdb9-819d-49a7-9eaf-2a0334aa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:17.633698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9278cdb9-819d-49a7-9eaf-2a0334aa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:17.634520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9278cdb9-819d-49a7-9eaf-2a0334aa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:17.635021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9278cdb9-819d-49a7-9eaf-2a0334aa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:17.665367 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9278cdb9-819d-49a7-9eaf-2a0334aa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045295 Aug 01 15:44:17.665941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 801/1521] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:17 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:18.159482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-36b9c5fb-0613-450e-a82f-9a4cf1189c08 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:18.160095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-36b9c5fb-0613-450e-a82f-9a4cf1189c08 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:18.166129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-36b9c5fb-0613-450e-a82f-9a4cf1189c08 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:18.166582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-36b9c5fb-0613-450e-a82f-9a4cf1189c08 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:18.167347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-36b9c5fb-0613-450e-a82f-9a4cf1189c08 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:18.167786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-36b9c5fb-0613-450e-a82f-9a4cf1189c08 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:18.303934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-36b9c5fb-0613-450e-a82f-9a4cf1189c08 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:18.311640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-36b9c5fb-0613-450e-a82f-9a4cf1189c08 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156584 Aug 01 15:44:18.312213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 721/1522] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:18 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:18.549824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1dede767-4fc4-41e5-b88a-05687352db63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:18.551948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1dede767-4fc4-41e5-b88a-05687352db63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:18.558650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1dede767-4fc4-41e5-b88a-05687352db63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:18.559101 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1dede767-4fc4-41e5-b88a-05687352db63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:18.559868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1dede767-4fc4-41e5-b88a-05687352db63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:18.560344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1dede767-4fc4-41e5-b88a-05687352db63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:18.589537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1dede767-4fc4-41e5-b88a-05687352db63 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043770 Aug 01 15:44:18.590141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 802/1523] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:44:18.678016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b6335f8c-768e-4055-8b47-f1e957606e10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:18.680203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b6335f8c-768e-4055-8b47-f1e957606e10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:18.687570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b6335f8c-768e-4055-8b47-f1e957606e10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:18.688019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b6335f8c-768e-4055-8b47-f1e957606e10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:18.688787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b6335f8c-768e-4055-8b47-f1e957606e10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:18.689225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b6335f8c-768e-4055-8b47-f1e957606e10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:18.720679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b6335f8c-768e-4055-8b47-f1e957606e10 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046614 Aug 01 15:44:18.721238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 722/1524] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:18 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:19.332649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cf43ade4-227f-4ef7-a182-8980573c4e0e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:19.333190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cf43ade4-227f-4ef7-a182-8980573c4e0e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:19.339308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf43ade4-227f-4ef7-a182-8980573c4e0e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:19.339756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf43ade4-227f-4ef7-a182-8980573c4e0e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:19.340520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf43ade4-227f-4ef7-a182-8980573c4e0e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:19.340959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf43ade4-227f-4ef7-a182-8980573c4e0e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:19.474737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cf43ade4-227f-4ef7-a182-8980573c4e0e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:19.482160 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cf43ade4-227f-4ef7-a182-8980573c4e0e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153468 Aug 01 15:44:19.482722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 803/1525] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:19 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:19.603086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-65fad6e3-054b-4540-9811-86b50951050e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:19.605145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-65fad6e3-054b-4540-9811-86b50951050e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:19.612720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65fad6e3-054b-4540-9811-86b50951050e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:19.613161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65fad6e3-054b-4540-9811-86b50951050e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:19.613948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65fad6e3-054b-4540-9811-86b50951050e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:19.614377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65fad6e3-054b-4540-9811-86b50951050e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:19.638380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:19.645227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-65fad6e3-054b-4540-9811-86b50951050e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046345 Aug 01 15:44:19.645778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 723/1526] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:19.732888 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4cc70b16-3846-4dbb-ace0-d364239c033a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:19.735078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4cc70b16-3846-4dbb-ace0-d364239c033a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:19.741561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4cc70b16-3846-4dbb-ace0-d364239c033a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:19.742038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4cc70b16-3846-4dbb-ace0-d364239c033a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:19.742802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4cc70b16-3846-4dbb-ace0-d364239c033a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:19.743228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4cc70b16-3846-4dbb-ace0-d364239c033a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:19.773136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4cc70b16-3846-4dbb-ace0-d364239c033a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044228 Aug 01 15:44:19.773695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 804/1527] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:19 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:44:20.508285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ebe4f6c8-4377-4b18-9b44-7345187b55d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:20.509386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ebe4f6c8-4377-4b18-9b44-7345187b55d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:20.519395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebe4f6c8-4377-4b18-9b44-7345187b55d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:20.519847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebe4f6c8-4377-4b18-9b44-7345187b55d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:20.520653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebe4f6c8-4377-4b18-9b44-7345187b55d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:20.521100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebe4f6c8-4377-4b18-9b44-7345187b55d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:20.657402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b8e76758-a06c-46b9-affd-d17fedaa61d3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:20.659642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b8e76758-a06c-46b9-affd-d17fedaa61d3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:20.659770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ebe4f6c8-4377-4b18-9b44-7345187b55d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:20.665717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b8e76758-a06c-46b9-affd-d17fedaa61d3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:20.666215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b8e76758-a06c-46b9-affd-d17fedaa61d3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:20.666986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b8e76758-a06c-46b9-affd-d17fedaa61d3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:20.667402 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ebe4f6c8-4377-4b18-9b44-7345187b55d0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.166721 Aug 01 15:44:20.667521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b8e76758-a06c-46b9-affd-d17fedaa61d3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:20.667972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 724/1528] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:20 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:20.697799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b8e76758-a06c-46b9-affd-d17fedaa61d3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044917 Aug 01 15:44:20.698383 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 805/1529] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:44:20.785416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3cc10edc-12d2-43d1-8574-eafde43d80a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:20.787587 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3cc10edc-12d2-43d1-8574-eafde43d80a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:20.794076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cc10edc-12d2-43d1-8574-eafde43d80a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:20.794527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cc10edc-12d2-43d1-8574-eafde43d80a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:20.795325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cc10edc-12d2-43d1-8574-eafde43d80a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:20.795764 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cc10edc-12d2-43d1-8574-eafde43d80a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:20.828624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3cc10edc-12d2-43d1-8574-eafde43d80a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047312 Aug 01 15:44:20.829236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 725/1530] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:20 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:21.689121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0ddfa771-3835-4423-ba3b-7b438e2faea0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:21.689707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0ddfa771-3835-4423-ba3b-7b438e2faea0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:21.696181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ddfa771-3835-4423-ba3b-7b438e2faea0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:21.696622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ddfa771-3835-4423-ba3b-7b438e2faea0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:21.697393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ddfa771-3835-4423-ba3b-7b438e2faea0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:21.697837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ddfa771-3835-4423-ba3b-7b438e2faea0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:21.711109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d03913e4-6ef6-4048-8879-d6357f37d873 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:21.713338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d03913e4-6ef6-4048-8879-d6357f37d873 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:21.720597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d03913e4-6ef6-4048-8879-d6357f37d873 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:21.721057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d03913e4-6ef6-4048-8879-d6357f37d873 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:21.721925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d03913e4-6ef6-4048-8879-d6357f37d873 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:21.722375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d03913e4-6ef6-4048-8879-d6357f37d873 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:21.755893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d03913e4-6ef6-4048-8879-d6357f37d873 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049246 Aug 01 15:44:21.756730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 726/1531] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:44:21.843236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0ddfa771-3835-4423-ba3b-7b438e2faea0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:21.845859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1237f0d4-47c2-4082-907b-9dd91a045b03 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:21.848900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1237f0d4-47c2-4082-907b-9dd91a045b03 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:21.855661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1237f0d4-47c2-4082-907b-9dd91a045b03 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:21.855962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0ddfa771-3835-4423-ba3b-7b438e2faea0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.170280 Aug 01 15:44:21.856150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1237f0d4-47c2-4082-907b-9dd91a045b03 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:21.856614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 806/1532] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:21 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:21.857037 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1237f0d4-47c2-4082-907b-9dd91a045b03 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:21.857439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1237f0d4-47c2-4082-907b-9dd91a045b03 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:21.889990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1237f0d4-47c2-4082-907b-9dd91a045b03 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052882 Aug 01 15:44:21.890625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 727/1533] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:21 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:44:22.765833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:44:22.766632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:44:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:44:22.769555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6aa40060-fa12-41d3-8318-cd2465808b97 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:22.771678 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6aa40060-fa12-41d3-8318-cd2465808b97 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:22.778407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6aa40060-fa12-41d3-8318-cd2465808b97 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:22.778859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6aa40060-fa12-41d3-8318-cd2465808b97 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:22.779628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6aa40060-fa12-41d3-8318-cd2465808b97 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:22.780107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6aa40060-fa12-41d3-8318-cd2465808b97 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:22.808616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6aa40060-fa12-41d3-8318-cd2465808b97 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043664 Aug 01 15:44:22.809181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 807/1534] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:22 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:22.886046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bc5b8e6b-2758-4105-af58-18189922f5ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:22.886665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bc5b8e6b-2758-4105-af58-18189922f5ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:22.893244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc5b8e6b-2758-4105-af58-18189922f5ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:22.893688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc5b8e6b-2758-4105-af58-18189922f5ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:22.894476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc5b8e6b-2758-4105-af58-18189922f5ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:22.894909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc5b8e6b-2758-4105-af58-18189922f5ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:22.902872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-08327786-aefa-4656-8262-a9b90c6c47f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:22.905061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-08327786-aefa-4656-8262-a9b90c6c47f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:22.911647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08327786-aefa-4656-8262-a9b90c6c47f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:22.912110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08327786-aefa-4656-8262-a9b90c6c47f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:22.912947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08327786-aefa-4656-8262-a9b90c6c47f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:22.913406 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08327786-aefa-4656-8262-a9b90c6c47f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:22.944978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-08327786-aefa-4656-8262-a9b90c6c47f7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046008 Aug 01 15:44:22.945560 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 808/1535] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:22 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:44:23.028065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bc5b8e6b-2758-4105-af58-18189922f5ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:23.035732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bc5b8e6b-2758-4105-af58-18189922f5ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153624 Aug 01 15:44:23.036304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 728/1536] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:22 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:23.821758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-820f8d5c-43d1-4a59-bf5e-99666fba8576 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:23.824048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-820f8d5c-43d1-4a59-bf5e-99666fba8576 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:23.831312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-820f8d5c-43d1-4a59-bf5e-99666fba8576 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:23.831763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-820f8d5c-43d1-4a59-bf5e-99666fba8576 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:23.832534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-820f8d5c-43d1-4a59-bf5e-99666fba8576 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:23.833011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-820f8d5c-43d1-4a59-bf5e-99666fba8576 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:23.862835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-820f8d5c-43d1-4a59-bf5e-99666fba8576 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045941 Aug 01 15:44:23.863391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 809/1537] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:23.957398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7c765d07-6c89-4d75-98f8-71060cbe10d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:23.959586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7c765d07-6c89-4d75-98f8-71060cbe10d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:23.961960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=84 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:23.967289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c765d07-6c89-4d75-98f8-71060cbe10d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:23.967742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c765d07-6c89-4d75-98f8-71060cbe10d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:23.968768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c765d07-6c89-4d75-98f8-71060cbe10d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:23.969207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c765d07-6c89-4d75-98f8-71060cbe10d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:23.998260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7c765d07-6c89-4d75-98f8-71060cbe10d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Aug 01 15:44:23.999293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 729/1538] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:23 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:24.056738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0b0208f7-2b6b-4dbc-adf6-dda02aed2786 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:24.057351 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0b0208f7-2b6b-4dbc-adf6-dda02aed2786 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:24.064014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b0208f7-2b6b-4dbc-adf6-dda02aed2786 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:24.064464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b0208f7-2b6b-4dbc-adf6-dda02aed2786 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:24.065224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b0208f7-2b6b-4dbc-adf6-dda02aed2786 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:24.065663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b0208f7-2b6b-4dbc-adf6-dda02aed2786 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:24.194722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0b0208f7-2b6b-4dbc-adf6-dda02aed2786 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:24.202792 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0b0208f7-2b6b-4dbc-adf6-dda02aed2786 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.149287 Aug 01 15:44:24.203355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 810/1539] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:24 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:24.875315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7aa40722-8c01-4f0a-941e-b9e9053a57fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:24.877459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7aa40722-8c01-4f0a-941e-b9e9053a57fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:24.883694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aa40722-8c01-4f0a-941e-b9e9053a57fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:24.884140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aa40722-8c01-4f0a-941e-b9e9053a57fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:24.884905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aa40722-8c01-4f0a-941e-b9e9053a57fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:24.885340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aa40722-8c01-4f0a-941e-b9e9053a57fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:24.915340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7aa40722-8c01-4f0a-941e-b9e9053a57fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044027 Aug 01 15:44:24.915894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 730/1540] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:25.011172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5960f3ea-ed6e-4ed5-bb9e-5e00a4f727b6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:25.013344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5960f3ea-ed6e-4ed5-bb9e-5e00a4f727b6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:25.020008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5960f3ea-ed6e-4ed5-bb9e-5e00a4f727b6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:25.020462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5960f3ea-ed6e-4ed5-bb9e-5e00a4f727b6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:25.021231 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5960f3ea-ed6e-4ed5-bb9e-5e00a4f727b6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:25.021672 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5960f3ea-ed6e-4ed5-bb9e-5e00a4f727b6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:25.051582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5960f3ea-ed6e-4ed5-bb9e-5e00a4f727b6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Aug 01 15:44:25.052145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 811/1541] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:25 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:25.224690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4588ad3a-bbab-4c3a-8c19-13773e4d16f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:25.225231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4588ad3a-bbab-4c3a-8c19-13773e4d16f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:25.231779 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4588ad3a-bbab-4c3a-8c19-13773e4d16f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:25.232228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4588ad3a-bbab-4c3a-8c19-13773e4d16f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:25.232989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4588ad3a-bbab-4c3a-8c19-13773e4d16f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:25.233434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4588ad3a-bbab-4c3a-8c19-13773e4d16f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:25.366683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4588ad3a-bbab-4c3a-8c19-13773e4d16f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:25.374158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4588ad3a-bbab-4c3a-8c19-13773e4d16f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153364 Aug 01 15:44:25.374718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 731/1542] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:25 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:25.928082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6f2450f8-9293-4e53-bba2-3e45f77229a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:25.930368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6f2450f8-9293-4e53-bba2-3e45f77229a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:25.937148 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f2450f8-9293-4e53-bba2-3e45f77229a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:25.937598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f2450f8-9293-4e53-bba2-3e45f77229a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:25.938405 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f2450f8-9293-4e53-bba2-3e45f77229a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:25.938847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f2450f8-9293-4e53-bba2-3e45f77229a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:25.968314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6f2450f8-9293-4e53-bba2-3e45f77229a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044275 Aug 01 15:44:25.969141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 812/1543] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:25 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:26.065400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ecd0eaa6-8884-44cf-bad8-119f9f0c9198 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:26.067619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ecd0eaa6-8884-44cf-bad8-119f9f0c9198 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:26.073928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecd0eaa6-8884-44cf-bad8-119f9f0c9198 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:26.074380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecd0eaa6-8884-44cf-bad8-119f9f0c9198 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:26.075146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecd0eaa6-8884-44cf-bad8-119f9f0c9198 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:26.075580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecd0eaa6-8884-44cf-bad8-119f9f0c9198 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:26.104338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ecd0eaa6-8884-44cf-bad8-119f9f0c9198 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Aug 01 15:44:26.104899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 732/1544] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:26 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:26.395194 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-13746ac5-0b48-40ce-bc79-d69ef5680af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:26.395805 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-13746ac5-0b48-40ce-bc79-d69ef5680af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:26.402394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13746ac5-0b48-40ce-bc79-d69ef5680af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:26.402829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13746ac5-0b48-40ce-bc79-d69ef5680af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:26.403615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13746ac5-0b48-40ce-bc79-d69ef5680af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:26.404042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-13746ac5-0b48-40ce-bc79-d69ef5680af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:26.536073 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-13746ac5-0b48-40ce-bc79-d69ef5680af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:26.543857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-13746ac5-0b48-40ce-bc79-d69ef5680af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152530 Aug 01 15:44:26.544410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 813/1545] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:26 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:26.981275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-29d63037-70de-472f-aa8d-be923c84e14c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:26.983496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-29d63037-70de-472f-aa8d-be923c84e14c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:26.990418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29d63037-70de-472f-aa8d-be923c84e14c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:26.990874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29d63037-70de-472f-aa8d-be923c84e14c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:26.991665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29d63037-70de-472f-aa8d-be923c84e14c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:26.992123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29d63037-70de-472f-aa8d-be923c84e14c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:27.022382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-29d63037-70de-472f-aa8d-be923c84e14c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045038 Aug 01 15:44:27.022951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 733/1546] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:27.117254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-646d10dd-ca26-4c50-a096-8916e8ec3c39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:27.119453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-646d10dd-ca26-4c50-a096-8916e8ec3c39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:27.126194 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-646d10dd-ca26-4c50-a096-8916e8ec3c39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:27.126644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-646d10dd-ca26-4c50-a096-8916e8ec3c39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:27.127409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-646d10dd-ca26-4c50-a096-8916e8ec3c39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:27.127850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-646d10dd-ca26-4c50-a096-8916e8ec3c39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:27.131553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:27.157752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-646d10dd-ca26-4c50-a096-8916e8ec3c39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Aug 01 15:44:27.158338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 814/1547] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:27 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:27.569141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fba194e1-c223-4c5e-bd12-d7db234c89d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:27.569762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fba194e1-c223-4c5e-bd12-d7db234c89d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:27.575971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fba194e1-c223-4c5e-bd12-d7db234c89d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:27.576418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fba194e1-c223-4c5e-bd12-d7db234c89d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:27.577212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fba194e1-c223-4c5e-bd12-d7db234c89d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:27.577643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fba194e1-c223-4c5e-bd12-d7db234c89d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:27.719291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fba194e1-c223-4c5e-bd12-d7db234c89d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:27.732439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fba194e1-c223-4c5e-bd12-d7db234c89d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.167095 Aug 01 15:44:27.733046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 734/1548] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:27 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:28.035188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2bd20973-c43c-417e-be71-3e235de219c3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:28.037394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2bd20973-c43c-417e-be71-3e235de219c3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:28.044014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2bd20973-c43c-417e-be71-3e235de219c3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:28.044468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2bd20973-c43c-417e-be71-3e235de219c3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:28.045245 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2bd20973-c43c-417e-be71-3e235de219c3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:28.046399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2bd20973-c43c-417e-be71-3e235de219c3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:28.075725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2bd20973-c43c-417e-be71-3e235de219c3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044461 Aug 01 15:44:28.076284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 815/1549] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:28.170231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fb9241ed-4026-4a6f-b567-7301466f081c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:28.172475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fb9241ed-4026-4a6f-b567-7301466f081c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:28.178996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb9241ed-4026-4a6f-b567-7301466f081c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:28.179437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb9241ed-4026-4a6f-b567-7301466f081c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:28.180201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb9241ed-4026-4a6f-b567-7301466f081c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:28.180635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb9241ed-4026-4a6f-b567-7301466f081c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:28.209309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fb9241ed-4026-4a6f-b567-7301466f081c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043206 Aug 01 15:44:28.209858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 735/1550] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:28 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:28.755696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-800bcc3f-9288-4ac1-b8bb-3327c5025606 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:28.756345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-800bcc3f-9288-4ac1-b8bb-3327c5025606 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:28.762684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-800bcc3f-9288-4ac1-b8bb-3327c5025606 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:28.763161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-800bcc3f-9288-4ac1-b8bb-3327c5025606 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:28.763922 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-800bcc3f-9288-4ac1-b8bb-3327c5025606 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:28.765030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-800bcc3f-9288-4ac1-b8bb-3327c5025606 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:28.895475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-800bcc3f-9288-4ac1-b8bb-3327c5025606 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:28.903179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-800bcc3f-9288-4ac1-b8bb-3327c5025606 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151290 Aug 01 15:44:28.903762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 816/1551] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:28 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:29.088602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-070705aa-78b2-45f9-b4e7-cce4922b69ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:29.090838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-070705aa-78b2-45f9-b4e7-cce4922b69ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:29.097327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-070705aa-78b2-45f9-b4e7-cce4922b69ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:29.097781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-070705aa-78b2-45f9-b4e7-cce4922b69ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:29.098585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-070705aa-78b2-45f9-b4e7-cce4922b69ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:29.099026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-070705aa-78b2-45f9-b4e7-cce4922b69ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:29.129120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-070705aa-78b2-45f9-b4e7-cce4922b69ba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044450 Aug 01 15:44:29.129685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 736/1552] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:29.222251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-faa85af1-4d40-4d32-947b-a656b5c1b028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:29.224428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-faa85af1-4d40-4d32-947b-a656b5c1b028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:29.231033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-faa85af1-4d40-4d32-947b-a656b5c1b028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:29.231482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-faa85af1-4d40-4d32-947b-a656b5c1b028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:29.232251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-faa85af1-4d40-4d32-947b-a656b5c1b028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:29.232684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-faa85af1-4d40-4d32-947b-a656b5c1b028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:29.262378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-faa85af1-4d40-4d32-947b-a656b5c1b028 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 Aug 01 15:44:29.262926 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 817/1553] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:29 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:29.924822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e2377661-9331-484d-8599-a49e54b3df73 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:29.925448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e2377661-9331-484d-8599-a49e54b3df73 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:29.932145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e2377661-9331-484d-8599-a49e54b3df73 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:29.932598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e2377661-9331-484d-8599-a49e54b3df73 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:29.933371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e2377661-9331-484d-8599-a49e54b3df73 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:29.933812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e2377661-9331-484d-8599-a49e54b3df73 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:30.074125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e2377661-9331-484d-8599-a49e54b3df73 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:30.082339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e2377661-9331-484d-8599-a49e54b3df73 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.161434 Aug 01 15:44:30.082908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 737/1554] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:29 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:30.142672 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3ba19683-0b6f-4518-9db8-8e3c37cf6326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:30.144835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3ba19683-0b6f-4518-9db8-8e3c37cf6326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:30.150919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3ba19683-0b6f-4518-9db8-8e3c37cf6326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:30.151365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3ba19683-0b6f-4518-9db8-8e3c37cf6326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:30.152126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3ba19683-0b6f-4518-9db8-8e3c37cf6326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:30.152562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3ba19683-0b6f-4518-9db8-8e3c37cf6326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:30.182705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3ba19683-0b6f-4518-9db8-8e3c37cf6326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044567 Aug 01 15:44:30.183189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 818/1555] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:30.275180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-85e168d1-121b-4eab-baee-db2dab4bf719 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:30.277361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-85e168d1-121b-4eab-baee-db2dab4bf719 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:30.283436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85e168d1-121b-4eab-baee-db2dab4bf719 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:30.283888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85e168d1-121b-4eab-baee-db2dab4bf719 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:30.284655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85e168d1-121b-4eab-baee-db2dab4bf719 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:30.285092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85e168d1-121b-4eab-baee-db2dab4bf719 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:30.314145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-85e168d1-121b-4eab-baee-db2dab4bf719 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043271 Aug 01 15:44:30.314682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 738/1556] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:31.103498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ba4c6d11-6894-4f9a-9842-599234adaceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:31.104163 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ba4c6d11-6894-4f9a-9842-599234adaceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:31.111464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba4c6d11-6894-4f9a-9842-599234adaceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:31.111862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba4c6d11-6894-4f9a-9842-599234adaceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:31.112627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba4c6d11-6894-4f9a-9842-599234adaceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:31.113066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba4c6d11-6894-4f9a-9842-599234adaceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:31.195472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-68429c58-f578-47b5-bdca-364d13c90f1e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:31.197771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-68429c58-f578-47b5-bdca-364d13c90f1e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:31.204566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68429c58-f578-47b5-bdca-364d13c90f1e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:31.205017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68429c58-f578-47b5-bdca-364d13c90f1e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:31.205785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68429c58-f578-47b5-bdca-364d13c90f1e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:31.206246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68429c58-f578-47b5-bdca-364d13c90f1e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:31.236474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-68429c58-f578-47b5-bdca-364d13c90f1e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044896 Aug 01 15:44:31.237047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 739/1557] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:44:31.247308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ba4c6d11-6894-4f9a-9842-599234adaceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:31.255583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ba4c6d11-6894-4f9a-9842-599234adaceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156064 Aug 01 15:44:31.256144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 819/1558] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:31 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:31.326673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-09f37099-847b-4c13-840d-cea419ede79d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:31.328818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-09f37099-847b-4c13-840d-cea419ede79d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:31.335406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09f37099-847b-4c13-840d-cea419ede79d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:31.335853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09f37099-847b-4c13-840d-cea419ede79d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:31.336847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09f37099-847b-4c13-840d-cea419ede79d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:31.337076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09f37099-847b-4c13-840d-cea419ede79d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:31.351821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:31.368275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-09f37099-847b-4c13-840d-cea419ede79d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045632 Aug 01 15:44:31.368845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 740/1559] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:31 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:32.249013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c945e455-97a3-4ea4-85d0-6b11dd38cda8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:32.251247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c945e455-97a3-4ea4-85d0-6b11dd38cda8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:32.257841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c945e455-97a3-4ea4-85d0-6b11dd38cda8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:32.258267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c945e455-97a3-4ea4-85d0-6b11dd38cda8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:32.259035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c945e455-97a3-4ea4-85d0-6b11dd38cda8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:32.259473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c945e455-97a3-4ea4-85d0-6b11dd38cda8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:32.276724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-42c4c7d1-f6a9-4da2-a911-44f2f1264dc5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:32.277329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-42c4c7d1-f6a9-4da2-a911-44f2f1264dc5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:32.284686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42c4c7d1-f6a9-4da2-a911-44f2f1264dc5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:32.285211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42c4c7d1-f6a9-4da2-a911-44f2f1264dc5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:32.286015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42c4c7d1-f6a9-4da2-a911-44f2f1264dc5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:32.286447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42c4c7d1-f6a9-4da2-a911-44f2f1264dc5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:32.293401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c945e455-97a3-4ea4-85d0-6b11dd38cda8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046704 Aug 01 15:44:32.294043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 820/1560] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:32.380890 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-91764b58-ef0f-491a-a17c-7cd142ef662d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:32.383210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-91764b58-ef0f-491a-a17c-7cd142ef662d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:32.389572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91764b58-ef0f-491a-a17c-7cd142ef662d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:32.390062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91764b58-ef0f-491a-a17c-7cd142ef662d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:32.390837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91764b58-ef0f-491a-a17c-7cd142ef662d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:32.391278 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91764b58-ef0f-491a-a17c-7cd142ef662d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:32.424245 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-91764b58-ef0f-491a-a17c-7cd142ef662d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047277 Aug 01 15:44:32.424827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 821/1561] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:32 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:44:32.428517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-42c4c7d1-f6a9-4da2-a911-44f2f1264dc5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:32.436123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-42c4c7d1-f6a9-4da2-a911-44f2f1264dc5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.163254 Aug 01 15:44:32.436683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 741/1562] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:32 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:44:33.307569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5e50810a-5e3b-4f85-bf17-2a6d3edd0ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:33.309676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5e50810a-5e3b-4f85-bf17-2a6d3edd0ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:33.312075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=84 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:33.317527 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e50810a-5e3b-4f85-bf17-2a6d3edd0ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:33.318006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e50810a-5e3b-4f85-bf17-2a6d3edd0ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:33.318980 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e50810a-5e3b-4f85-bf17-2a6d3edd0ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:33.319426 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e50810a-5e3b-4f85-bf17-2a6d3edd0ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:33.349589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5e50810a-5e3b-4f85-bf17-2a6d3edd0ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046155 Aug 01 15:44:33.350175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 822/1563] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:33.436864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-92f1e6d4-9c36-4021-9477-8d3c063002a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:33.439081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-92f1e6d4-9c36-4021-9477-8d3c063002a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:33.445625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92f1e6d4-9c36-4021-9477-8d3c063002a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:33.446116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92f1e6d4-9c36-4021-9477-8d3c063002a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:33.446888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92f1e6d4-9c36-4021-9477-8d3c063002a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:33.447328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92f1e6d4-9c36-4021-9477-8d3c063002a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:33.457016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1be01af3-8700-4fb3-8503-56f14207a0bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:33.457630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1be01af3-8700-4fb3-8503-56f14207a0bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:33.463816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1be01af3-8700-4fb3-8503-56f14207a0bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:33.464268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1be01af3-8700-4fb3-8503-56f14207a0bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:33.465046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1be01af3-8700-4fb3-8503-56f14207a0bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:33.465486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1be01af3-8700-4fb3-8503-56f14207a0bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:33.477913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-92f1e6d4-9c36-4021-9477-8d3c063002a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044969 Aug 01 15:44:33.478497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 742/1564] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:33 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:33.600713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1be01af3-8700-4fb3-8503-56f14207a0bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:33.608290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1be01af3-8700-4fb3-8503-56f14207a0bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155106 Aug 01 15:44:33.608859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 823/1565] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:33 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:44:34.362163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1db1fce1-1226-4398-bab2-afd17caa47d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:34.364266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1db1fce1-1226-4398-bab2-afd17caa47d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:34.370521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1db1fce1-1226-4398-bab2-afd17caa47d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:34.370968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1db1fce1-1226-4398-bab2-afd17caa47d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:34.371739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1db1fce1-1226-4398-bab2-afd17caa47d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:34.372170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1db1fce1-1226-4398-bab2-afd17caa47d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:34.401091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1db1fce1-1226-4398-bab2-afd17caa47d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043583 Aug 01 15:44:34.401694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 743/1566] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:34.490359 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9e4b0105-ee00-49fe-910d-56b1f42850b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:34.492523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9e4b0105-ee00-49fe-910d-56b1f42850b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:34.499264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e4b0105-ee00-49fe-910d-56b1f42850b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:34.499710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e4b0105-ee00-49fe-910d-56b1f42850b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:34.500509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e4b0105-ee00-49fe-910d-56b1f42850b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:34.500943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e4b0105-ee00-49fe-910d-56b1f42850b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:34.531702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9e4b0105-ee00-49fe-910d-56b1f42850b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045353 Aug 01 15:44:34.532263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 824/1567] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:34 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:34.628822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eb7e31a1-185b-4b43-924a-495fb9ad982f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:34.629444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eb7e31a1-185b-4b43-924a-495fb9ad982f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:34.636062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb7e31a1-185b-4b43-924a-495fb9ad982f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:34.636514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb7e31a1-185b-4b43-924a-495fb9ad982f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:34.637279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb7e31a1-185b-4b43-924a-495fb9ad982f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:34.637739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb7e31a1-185b-4b43-924a-495fb9ad982f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:34.768318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eb7e31a1-185b-4b43-924a-495fb9ad982f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:34.775801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eb7e31a1-185b-4b43-924a-495fb9ad982f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.150850 Aug 01 15:44:34.776367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 744/1568] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:34 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:35.413137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6a37e3ba-0a2a-42cc-81b0-b1913660648a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:35.415313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6a37e3ba-0a2a-42cc-81b0-b1913660648a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:35.421399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a37e3ba-0a2a-42cc-81b0-b1913660648a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:35.421853 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a37e3ba-0a2a-42cc-81b0-b1913660648a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:35.422650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a37e3ba-0a2a-42cc-81b0-b1913660648a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:35.423089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a37e3ba-0a2a-42cc-81b0-b1913660648a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:35.453041 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6a37e3ba-0a2a-42cc-81b0-b1913660648a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043883 Aug 01 15:44:35.453593 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 825/1569] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:35.544324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bcface5e-cb63-4f52-ba3f-73b2b99a468f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:35.546600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bcface5e-cb63-4f52-ba3f-73b2b99a468f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:35.553024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bcface5e-cb63-4f52-ba3f-73b2b99a468f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:35.553544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bcface5e-cb63-4f52-ba3f-73b2b99a468f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:35.554418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bcface5e-cb63-4f52-ba3f-73b2b99a468f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:35.554918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bcface5e-cb63-4f52-ba3f-73b2b99a468f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:35.584837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bcface5e-cb63-4f52-ba3f-73b2b99a468f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044385 Aug 01 15:44:35.585399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 745/1570] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:35 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:35.798284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-edd9adf4-a53a-4c01-b99f-95200a421a7b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:35.798812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-edd9adf4-a53a-4c01-b99f-95200a421a7b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:35.805438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-edd9adf4-a53a-4c01-b99f-95200a421a7b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:35.805909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-edd9adf4-a53a-4c01-b99f-95200a421a7b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:35.806682 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-edd9adf4-a53a-4c01-b99f-95200a421a7b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:35.807122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-edd9adf4-a53a-4c01-b99f-95200a421a7b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:35.942231 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-edd9adf4-a53a-4c01-b99f-95200a421a7b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:35.950282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-edd9adf4-a53a-4c01-b99f-95200a421a7b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156679 Aug 01 15:44:35.950846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 826/1571] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:35 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:36.464942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-db656fab-3a85-4c48-877e-710a12d778e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:36.467879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-db656fab-3a85-4c48-877e-710a12d778e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:36.474861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db656fab-3a85-4c48-877e-710a12d778e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:36.475314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db656fab-3a85-4c48-877e-710a12d778e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:36.476079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db656fab-3a85-4c48-877e-710a12d778e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:36.476517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db656fab-3a85-4c48-877e-710a12d778e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:36.505818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-db656fab-3a85-4c48-877e-710a12d778e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044796 Aug 01 15:44:36.506411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 746/1572] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:36.597945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ed688ae9-dc86-41c2-a33c-0df40f884cf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:36.600200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ed688ae9-dc86-41c2-a33c-0df40f884cf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:36.606271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed688ae9-dc86-41c2-a33c-0df40f884cf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:36.606728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed688ae9-dc86-41c2-a33c-0df40f884cf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:36.607486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed688ae9-dc86-41c2-a33c-0df40f884cf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:36.607927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed688ae9-dc86-41c2-a33c-0df40f884cf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:36.636237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ed688ae9-dc86-41c2-a33c-0df40f884cf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042454 Aug 01 15:44:36.636715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 827/1573] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:36 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:36.971887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fa352068-e6ab-499b-b4c6-90f88ba02465 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:36.972426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fa352068-e6ab-499b-b4c6-90f88ba02465 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:36.979036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fa352068-e6ab-499b-b4c6-90f88ba02465 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:36.979857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fa352068-e6ab-499b-b4c6-90f88ba02465 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:36.981183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fa352068-e6ab-499b-b4c6-90f88ba02465 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:36.981624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fa352068-e6ab-499b-b4c6-90f88ba02465 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:37.114304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fa352068-e6ab-499b-b4c6-90f88ba02465 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:37.121980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fa352068-e6ab-499b-b4c6-90f88ba02465 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154359 Aug 01 15:44:37.122546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 747/1574] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:36 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:37.518334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c446882d-1737-4ed7-95a7-34a5698a00d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:37.520473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c446882d-1737-4ed7-95a7-34a5698a00d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:37.527144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c446882d-1737-4ed7-95a7-34a5698a00d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:37.527653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c446882d-1737-4ed7-95a7-34a5698a00d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:37.528355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c446882d-1737-4ed7-95a7-34a5698a00d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:37.528791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c446882d-1737-4ed7-95a7-34a5698a00d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:37.559080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c446882d-1737-4ed7-95a7-34a5698a00d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044692 Aug 01 15:44:37.559687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 828/1575] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:37.649374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-049c04cb-3bf0-4e60-bfd6-e2ec353378d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:37.651836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-049c04cb-3bf0-4e60-bfd6-e2ec353378d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:37.658860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-049c04cb-3bf0-4e60-bfd6-e2ec353378d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:37.659308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-049c04cb-3bf0-4e60-bfd6-e2ec353378d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:37.660152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-049c04cb-3bf0-4e60-bfd6-e2ec353378d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:37.660592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-049c04cb-3bf0-4e60-bfd6-e2ec353378d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:37.692553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-049c04cb-3bf0-4e60-bfd6-e2ec353378d1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047655 Aug 01 15:44:37.693129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 748/1576] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:37 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:38.144960 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-98189671-8076-4ac1-b181-40fdb3469f41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:38.145579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-98189671-8076-4ac1-b181-40fdb3469f41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:38.151758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-98189671-8076-4ac1-b181-40fdb3469f41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:38.152212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-98189671-8076-4ac1-b181-40fdb3469f41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:38.152974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-98189671-8076-4ac1-b181-40fdb3469f41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:38.153412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-98189671-8076-4ac1-b181-40fdb3469f41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:38.285565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-98189671-8076-4ac1-b181-40fdb3469f41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:38.294353 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-98189671-8076-4ac1-b181-40fdb3469f41 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153163 Aug 01 15:44:38.294919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 829/1577] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:38 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:38.571353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4f6fa2ef-698f-4087-a485-c18c939999f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:38.573393 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4f6fa2ef-698f-4087-a485-c18c939999f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:38.580098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f6fa2ef-698f-4087-a485-c18c939999f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:38.580540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f6fa2ef-698f-4087-a485-c18c939999f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:38.581290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f6fa2ef-698f-4087-a485-c18c939999f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:38.581717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f6fa2ef-698f-4087-a485-c18c939999f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:38.611786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4f6fa2ef-698f-4087-a485-c18c939999f8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044489 Aug 01 15:44:38.612337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 749/1578] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:38.704782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-992be74d-c6b9-4c5d-bb36-e52b6b6d8718 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:38.706986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-992be74d-c6b9-4c5d-bb36-e52b6b6d8718 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:38.713457 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-992be74d-c6b9-4c5d-bb36-e52b6b6d8718 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:38.713940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-992be74d-c6b9-4c5d-bb36-e52b6b6d8718 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:38.714711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-992be74d-c6b9-4c5d-bb36-e52b6b6d8718 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:38.715148 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-992be74d-c6b9-4c5d-bb36-e52b6b6d8718 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:38.741053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:38.746476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-992be74d-c6b9-4c5d-bb36-e52b6b6d8718 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045687 Aug 01 15:44:38.747035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 830/1579] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:38 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:39.316206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d8fe26c2-61d9-4bf7-944e-ee9d4f5eaae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:39.316766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d8fe26c2-61d9-4bf7-944e-ee9d4f5eaae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:39.323287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d8fe26c2-61d9-4bf7-944e-ee9d4f5eaae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:39.323737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d8fe26c2-61d9-4bf7-944e-ee9d4f5eaae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:39.324499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d8fe26c2-61d9-4bf7-944e-ee9d4f5eaae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:39.324939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d8fe26c2-61d9-4bf7-944e-ee9d4f5eaae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:39.456284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d8fe26c2-61d9-4bf7-944e-ee9d4f5eaae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:39.463789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d8fe26c2-61d9-4bf7-944e-ee9d4f5eaae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151635 Aug 01 15:44:39.464350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 750/1580] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:39 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:39.624070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ae90a081-ce66-4a0d-b8cc-c57a28aff902 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:39.626247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ae90a081-ce66-4a0d-b8cc-c57a28aff902 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:39.632516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ae90a081-ce66-4a0d-b8cc-c57a28aff902 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:39.632964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ae90a081-ce66-4a0d-b8cc-c57a28aff902 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:39.633722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ae90a081-ce66-4a0d-b8cc-c57a28aff902 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:39.634186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ae90a081-ce66-4a0d-b8cc-c57a28aff902 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:39.663475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ae90a081-ce66-4a0d-b8cc-c57a28aff902 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043390 Aug 01 15:44:39.664122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 831/1581] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:39.759456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c5884c64-f286-45f2-a01f-f2cd2294d55d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:39.761646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c5884c64-f286-45f2-a01f-f2cd2294d55d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:39.768407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5884c64-f286-45f2-a01f-f2cd2294d55d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:39.768854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5884c64-f286-45f2-a01f-f2cd2294d55d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:39.769651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5884c64-f286-45f2-a01f-f2cd2294d55d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:39.770122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5884c64-f286-45f2-a01f-f2cd2294d55d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:39.798700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c5884c64-f286-45f2-a01f-f2cd2294d55d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043238 Aug 01 15:44:39.799257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 751/1582] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:39 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:40.486706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8b986b91-9821-4c5a-a889-24c27296f15f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:40.487418 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8b986b91-9821-4c5a-a889-24c27296f15f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:40.493977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b986b91-9821-4c5a-a889-24c27296f15f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:40.494422 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b986b91-9821-4c5a-a889-24c27296f15f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:40.495172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b986b91-9821-4c5a-a889-24c27296f15f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:40.495602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b986b91-9821-4c5a-a889-24c27296f15f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:40.627096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8b986b91-9821-4c5a-a889-24c27296f15f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:40.634757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8b986b91-9821-4c5a-a889-24c27296f15f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152497 Aug 01 15:44:40.635324 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 832/1583] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:40 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:40.676480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2840ab36-eada-415e-9519-4f4fe3821d3c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:40.678638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2840ab36-eada-415e-9519-4f4fe3821d3c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:40.685134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2840ab36-eada-415e-9519-4f4fe3821d3c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:40.685574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2840ab36-eada-415e-9519-4f4fe3821d3c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:40.686394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2840ab36-eada-415e-9519-4f4fe3821d3c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:40.686825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2840ab36-eada-415e-9519-4f4fe3821d3c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:40.717513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2840ab36-eada-415e-9519-4f4fe3821d3c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044557 Aug 01 15:44:40.718133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 752/1584] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:44:40.811054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bd4dfef1-7d8d-43f4-8a98-aaad0d6a8a2a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:40.813132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bd4dfef1-7d8d-43f4-8a98-aaad0d6a8a2a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:40.820941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd4dfef1-7d8d-43f4-8a98-aaad0d6a8a2a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:40.821399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd4dfef1-7d8d-43f4-8a98-aaad0d6a8a2a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:40.822211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd4dfef1-7d8d-43f4-8a98-aaad0d6a8a2a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:40.822654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd4dfef1-7d8d-43f4-8a98-aaad0d6a8a2a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:40.853941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bd4dfef1-7d8d-43f4-8a98-aaad0d6a8a2a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046935 Aug 01 15:44:40.854599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 833/1585] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:40 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:40.921596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:44:40.921837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:44:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:44:41.656192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4a18f70b-5750-42b8-aaf4-13f09ec0cb0a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:41.656810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4a18f70b-5750-42b8-aaf4-13f09ec0cb0a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:41.663036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a18f70b-5750-42b8-aaf4-13f09ec0cb0a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:41.663494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a18f70b-5750-42b8-aaf4-13f09ec0cb0a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:41.664255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a18f70b-5750-42b8-aaf4-13f09ec0cb0a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:41.664692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a18f70b-5750-42b8-aaf4-13f09ec0cb0a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:41.731566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-30866e52-8303-4d26-b846-0be2581d24c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:41.734221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-30866e52-8303-4d26-b846-0be2581d24c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:41.741162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30866e52-8303-4d26-b846-0be2581d24c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:41.741607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30866e52-8303-4d26-b846-0be2581d24c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:41.742400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30866e52-8303-4d26-b846-0be2581d24c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:41.742842 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30866e52-8303-4d26-b846-0be2581d24c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:41.773165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-30866e52-8303-4d26-b846-0be2581d24c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045923 Aug 01 15:44:41.773960 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 834/1586] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:41.866389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5428b044-c9bc-4682-b8be-bc248e2c2048 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:41.868622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5428b044-c9bc-4682-b8be-bc248e2c2048 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:41.875905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5428b044-c9bc-4682-b8be-bc248e2c2048 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:41.876358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5428b044-c9bc-4682-b8be-bc248e2c2048 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:41.877142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5428b044-c9bc-4682-b8be-bc248e2c2048 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:41.877580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5428b044-c9bc-4682-b8be-bc248e2c2048 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:41.909794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5428b044-c9bc-4682-b8be-bc248e2c2048 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047336 Aug 01 15:44:41.910326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 835/1587] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:44:42.043065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4a18f70b-5750-42b8-aaf4-13f09ec0cb0a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:42.051459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4a18f70b-5750-42b8-aaf4-13f09ec0cb0a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.399113 Aug 01 15:44:42.052020 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 753/1588] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:41 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:42.785559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c29dca85-c391-4fdb-b1de-6fdb681f9e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:42.787707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c29dca85-c391-4fdb-b1de-6fdb681f9e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:42.796080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c29dca85-c391-4fdb-b1de-6fdb681f9e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:42.796522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c29dca85-c391-4fdb-b1de-6fdb681f9e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:42.797295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c29dca85-c391-4fdb-b1de-6fdb681f9e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:42.797720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c29dca85-c391-4fdb-b1de-6fdb681f9e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:42.828737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c29dca85-c391-4fdb-b1de-6fdb681f9e33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047181 Aug 01 15:44:42.829216 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 836/1589] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:42 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:42.923099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ed451a28-b77b-4ecf-b5d6-478d877c9951 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:42.925255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ed451a28-b77b-4ecf-b5d6-478d877c9951 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:42.931828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed451a28-b77b-4ecf-b5d6-478d877c9951 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:42.932279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed451a28-b77b-4ecf-b5d6-478d877c9951 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:42.933058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed451a28-b77b-4ecf-b5d6-478d877c9951 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:42.933531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed451a28-b77b-4ecf-b5d6-478d877c9951 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:42.962170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ed451a28-b77b-4ecf-b5d6-478d877c9951 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043825 Aug 01 15:44:42.962729 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 754/1590] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:42 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:43.073942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c2a24fb0-ad5a-48b8-ad0e-04802c8b5c0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:43.074558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c2a24fb0-ad5a-48b8-ad0e-04802c8b5c0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:43.081177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2a24fb0-ad5a-48b8-ad0e-04802c8b5c0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:43.081571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2a24fb0-ad5a-48b8-ad0e-04802c8b5c0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:43.082371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2a24fb0-ad5a-48b8-ad0e-04802c8b5c0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:43.082813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2a24fb0-ad5a-48b8-ad0e-04802c8b5c0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:43.222319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c2a24fb0-ad5a-48b8-ad0e-04802c8b5c0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:43.230044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c2a24fb0-ad5a-48b8-ad0e-04802c8b5c0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.160039 Aug 01 15:44:43.230609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 837/1591] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:43 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:43.840920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2f6a7b98-3de6-4fea-acd3-0f5588ef9a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:43.843101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2f6a7b98-3de6-4fea-acd3-0f5588ef9a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:43.849386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f6a7b98-3de6-4fea-acd3-0f5588ef9a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:43.849834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f6a7b98-3de6-4fea-acd3-0f5588ef9a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:43.850624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f6a7b98-3de6-4fea-acd3-0f5588ef9a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:43.851091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f6a7b98-3de6-4fea-acd3-0f5588ef9a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:43.881287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2f6a7b98-3de6-4fea-acd3-0f5588ef9a10 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044408 Aug 01 15:44:43.881849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 755/1592] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:43.974753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8de63691-0439-4042-a8c8-6e10197b3548 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:43.976892 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8de63691-0439-4042-a8c8-6e10197b3548 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:43.983975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8de63691-0439-4042-a8c8-6e10197b3548 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:43.984418 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8de63691-0439-4042-a8c8-6e10197b3548 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:43.985169 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8de63691-0439-4042-a8c8-6e10197b3548 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:43.985600 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8de63691-0439-4042-a8c8-6e10197b3548 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:44.015072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8de63691-0439-4042-a8c8-6e10197b3548 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Aug 01 15:44:44.015628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 838/1593] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:43 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:44.251398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a5c1b744-9514-4bab-b089-e35c33a0ae66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:44.252024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a5c1b744-9514-4bab-b089-e35c33a0ae66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:44.258724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a5c1b744-9514-4bab-b089-e35c33a0ae66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:44.259174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a5c1b744-9514-4bab-b089-e35c33a0ae66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:44.259931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a5c1b744-9514-4bab-b089-e35c33a0ae66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:44.260359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a5c1b744-9514-4bab-b089-e35c33a0ae66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:44.392595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a5c1b744-9514-4bab-b089-e35c33a0ae66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:44.400076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a5c1b744-9514-4bab-b089-e35c33a0ae66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152520 Aug 01 15:44:44.400635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 756/1594] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:44 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:44.894401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0e3f8486-07a5-4e20-a7e3-4889f461c88b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:44.896570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0e3f8486-07a5-4e20-a7e3-4889f461c88b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:44.903172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e3f8486-07a5-4e20-a7e3-4889f461c88b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:44.903619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e3f8486-07a5-4e20-a7e3-4889f461c88b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:44.905087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e3f8486-07a5-4e20-a7e3-4889f461c88b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:44.905575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e3f8486-07a5-4e20-a7e3-4889f461c88b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:44.934687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0e3f8486-07a5-4e20-a7e3-4889f461c88b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044239 Aug 01 15:44:44.935239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 839/1595] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:44:45.027409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2eb4c62b-7b46-4f2a-87f8-5701ec8c35a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:45.029556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2eb4c62b-7b46-4f2a-87f8-5701ec8c35a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:45.035666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2eb4c62b-7b46-4f2a-87f8-5701ec8c35a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:45.036119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2eb4c62b-7b46-4f2a-87f8-5701ec8c35a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:45.036883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2eb4c62b-7b46-4f2a-87f8-5701ec8c35a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:45.037317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2eb4c62b-7b46-4f2a-87f8-5701ec8c35a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:45.039714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:45.068353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2eb4c62b-7b46-4f2a-87f8-5701ec8c35a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Aug 01 15:44:45.068917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 757/1596] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:45 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:45.422116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ef59f2c2-4d6e-46ca-b2ad-f468198fac95 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:45.422735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ef59f2c2-4d6e-46ca-b2ad-f468198fac95 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:45.429230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef59f2c2-4d6e-46ca-b2ad-f468198fac95 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:45.429728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef59f2c2-4d6e-46ca-b2ad-f468198fac95 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:45.430607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef59f2c2-4d6e-46ca-b2ad-f468198fac95 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:45.431052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ef59f2c2-4d6e-46ca-b2ad-f468198fac95 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:45.562918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ef59f2c2-4d6e-46ca-b2ad-f468198fac95 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:45.570435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ef59f2c2-4d6e-46ca-b2ad-f468198fac95 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152649 Aug 01 15:44:45.570994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 840/1597] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:45 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:45.947599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-434a0007-e881-461c-809a-fcf8a1762322 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:45.949752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-434a0007-e881-461c-809a-fcf8a1762322 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:45.956206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-434a0007-e881-461c-809a-fcf8a1762322 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:45.956647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-434a0007-e881-461c-809a-fcf8a1762322 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:45.957399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-434a0007-e881-461c-809a-fcf8a1762322 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:45.957827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-434a0007-e881-461c-809a-fcf8a1762322 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:45.989295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-434a0007-e881-461c-809a-fcf8a1762322 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045740 Aug 01 15:44:45.989855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 758/1598] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:46.081281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-613ed7b1-8a65-412d-9617-432e0468758b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:46.083512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-613ed7b1-8a65-412d-9617-432e0468758b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:46.089636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-613ed7b1-8a65-412d-9617-432e0468758b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:46.090112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-613ed7b1-8a65-412d-9617-432e0468758b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:46.090874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-613ed7b1-8a65-412d-9617-432e0468758b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:46.091306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-613ed7b1-8a65-412d-9617-432e0468758b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:46.123554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-613ed7b1-8a65-412d-9617-432e0468758b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046201 Aug 01 15:44:46.124108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 841/1599] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:46 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:46.591777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5fb66bfa-61ca-4c39-a91b-452b757d168c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:46.592403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5fb66bfa-61ca-4c39-a91b-452b757d168c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:46.598780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5fb66bfa-61ca-4c39-a91b-452b757d168c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:46.599234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5fb66bfa-61ca-4c39-a91b-452b757d168c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:46.599996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5fb66bfa-61ca-4c39-a91b-452b757d168c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:46.600435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5fb66bfa-61ca-4c39-a91b-452b757d168c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:46.729058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5fb66bfa-61ca-4c39-a91b-452b757d168c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:46.736562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5fb66bfa-61ca-4c39-a91b-452b757d168c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.148779 Aug 01 15:44:46.737141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 759/1600] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:46 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:47.003009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-21184763-0b05-4022-b110-36cc902daae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:47.005611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-21184763-0b05-4022-b110-36cc902daae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:47.012850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21184763-0b05-4022-b110-36cc902daae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:47.013304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21184763-0b05-4022-b110-36cc902daae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:47.014118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21184763-0b05-4022-b110-36cc902daae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:47.014562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21184763-0b05-4022-b110-36cc902daae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:47.043215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-21184763-0b05-4022-b110-36cc902daae9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045306 Aug 01 15:44:47.043773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 842/1601] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:47.135945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3325b9bd-2faa-4faa-91c0-82dfdb6ab6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:47.138200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3325b9bd-2faa-4faa-91c0-82dfdb6ab6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:47.147233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3325b9bd-2faa-4faa-91c0-82dfdb6ab6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:47.147687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3325b9bd-2faa-4faa-91c0-82dfdb6ab6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:47.148660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3325b9bd-2faa-4faa-91c0-82dfdb6ab6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:47.149118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3325b9bd-2faa-4faa-91c0-82dfdb6ab6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:47.180254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3325b9bd-2faa-4faa-91c0-82dfdb6ab6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048395 Aug 01 15:44:47.180816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 760/1602] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:47 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:47.758971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ca9c4eef-8919-4cf5-88be-29434e5ebf3c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:47.759579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ca9c4eef-8919-4cf5-88be-29434e5ebf3c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:47.765820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca9c4eef-8919-4cf5-88be-29434e5ebf3c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:47.766294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca9c4eef-8919-4cf5-88be-29434e5ebf3c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:47.767142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca9c4eef-8919-4cf5-88be-29434e5ebf3c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:47.767579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca9c4eef-8919-4cf5-88be-29434e5ebf3c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:47.902145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ca9c4eef-8919-4cf5-88be-29434e5ebf3c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:47.909866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ca9c4eef-8919-4cf5-88be-29434e5ebf3c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154726 Aug 01 15:44:47.910451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 843/1603] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:47 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:48.056119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d963c615-b49f-4986-8b49-630f2b56fad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:48.058341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d963c615-b49f-4986-8b49-630f2b56fad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:48.064538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d963c615-b49f-4986-8b49-630f2b56fad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:48.064987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d963c615-b49f-4986-8b49-630f2b56fad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:48.065759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d963c615-b49f-4986-8b49-630f2b56fad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:48.066232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d963c615-b49f-4986-8b49-630f2b56fad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:48.095465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d963c615-b49f-4986-8b49-630f2b56fad4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043338 Aug 01 15:44:48.096040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 761/1604] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:48.192556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e63411dd-23d5-49f2-abf3-6c463124f3a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:48.194697 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e63411dd-23d5-49f2-abf3-6c463124f3a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:48.201188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e63411dd-23d5-49f2-abf3-6c463124f3a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:48.201640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e63411dd-23d5-49f2-abf3-6c463124f3a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:48.202432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e63411dd-23d5-49f2-abf3-6c463124f3a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:48.202864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e63411dd-23d5-49f2-abf3-6c463124f3a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:48.232108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e63411dd-23d5-49f2-abf3-6c463124f3a6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043586 Aug 01 15:44:48.232912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 844/1605] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:48 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:48.932406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-30b21210-94d0-405f-9c54-7a9d13baed48 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:48.933178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-30b21210-94d0-405f-9c54-7a9d13baed48 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:48.939915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30b21210-94d0-405f-9c54-7a9d13baed48 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:48.940365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30b21210-94d0-405f-9c54-7a9d13baed48 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:48.941132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30b21210-94d0-405f-9c54-7a9d13baed48 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:48.941572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30b21210-94d0-405f-9c54-7a9d13baed48 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:49.071648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-30b21210-94d0-405f-9c54-7a9d13baed48 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:49.080130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-30b21210-94d0-405f-9c54-7a9d13baed48 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151787 Aug 01 15:44:49.080697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 762/1606] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:48 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:49.108338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-62b2454c-d063-4b22-ac5a-2b7a47f2e400 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:49.110563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-62b2454c-d063-4b22-ac5a-2b7a47f2e400 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:49.116534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62b2454c-d063-4b22-ac5a-2b7a47f2e400 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:49.116975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62b2454c-d063-4b22-ac5a-2b7a47f2e400 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:49.117727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62b2454c-d063-4b22-ac5a-2b7a47f2e400 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:49.118214 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62b2454c-d063-4b22-ac5a-2b7a47f2e400 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:49.147986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-62b2454c-d063-4b22-ac5a-2b7a47f2e400 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044101 Aug 01 15:44:49.148543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 845/1607] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:49.244499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0955b323-54e5-4ebf-b7e9-9787959bab5c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:49.246628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0955b323-54e5-4ebf-b7e9-9787959bab5c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:49.253242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0955b323-54e5-4ebf-b7e9-9787959bab5c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:49.253696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0955b323-54e5-4ebf-b7e9-9787959bab5c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:49.254501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0955b323-54e5-4ebf-b7e9-9787959bab5c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:49.254942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0955b323-54e5-4ebf-b7e9-9787959bab5c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:49.283551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0955b323-54e5-4ebf-b7e9-9787959bab5c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043092 Aug 01 15:44:49.284111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 763/1608] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:50.101655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-08445cad-ddc8-4148-8809-76374de7bb78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:50.102343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-08445cad-ddc8-4148-8809-76374de7bb78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:50.109262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08445cad-ddc8-4148-8809-76374de7bb78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:50.109704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08445cad-ddc8-4148-8809-76374de7bb78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:50.110481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08445cad-ddc8-4148-8809-76374de7bb78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:50.110913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08445cad-ddc8-4148-8809-76374de7bb78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:50.159896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-79e8a365-5dcb-4e65-9ccc-be436a9b50f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:50.162224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-79e8a365-5dcb-4e65-9ccc-be436a9b50f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:50.168956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-79e8a365-5dcb-4e65-9ccc-be436a9b50f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:50.169480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-79e8a365-5dcb-4e65-9ccc-be436a9b50f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:50.170853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-79e8a365-5dcb-4e65-9ccc-be436a9b50f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:50.171364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-79e8a365-5dcb-4e65-9ccc-be436a9b50f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:50.202360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-79e8a365-5dcb-4e65-9ccc-be436a9b50f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046360 Aug 01 15:44:50.202930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 764/1609] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:44:50.248225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-08445cad-ddc8-4148-8809-76374de7bb78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:50.255885 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-08445cad-ddc8-4148-8809-76374de7bb78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158129 Aug 01 15:44:50.256448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 846/1610] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:50 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:50.296788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dbb26d61-875f-484c-99c3-33b165f3a6bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:50.298983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dbb26d61-875f-484c-99c3-33b165f3a6bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:50.305014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dbb26d61-875f-484c-99c3-33b165f3a6bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:50.305464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dbb26d61-875f-484c-99c3-33b165f3a6bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:50.306271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dbb26d61-875f-484c-99c3-33b165f3a6bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:50.306706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dbb26d61-875f-484c-99c3-33b165f3a6bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:50.335130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dbb26d61-875f-484c-99c3-33b165f3a6bd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042960 Aug 01 15:44:50.335700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 765/1611] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:50 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:51.214599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9c73f56e-6f57-4afb-bad5-b3a6059967e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:51.217231 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9c73f56e-6f57-4afb-bad5-b3a6059967e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:51.224058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c73f56e-6f57-4afb-bad5-b3a6059967e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:51.224514 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c73f56e-6f57-4afb-bad5-b3a6059967e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:51.225310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c73f56e-6f57-4afb-bad5-b3a6059967e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:51.225752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c73f56e-6f57-4afb-bad5-b3a6059967e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:51.242853 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:51.256010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9c73f56e-6f57-4afb-bad5-b3a6059967e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045450 Aug 01 15:44:51.256568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 847/1612] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:51.276570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c35011bd-1392-41fa-8c0e-fb572a6d19d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:51.277184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c35011bd-1392-41fa-8c0e-fb572a6d19d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:51.284273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c35011bd-1392-41fa-8c0e-fb572a6d19d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:51.284722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c35011bd-1392-41fa-8c0e-fb572a6d19d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:51.285488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c35011bd-1392-41fa-8c0e-fb572a6d19d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:51.285979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c35011bd-1392-41fa-8c0e-fb572a6d19d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:51.348295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-700fc908-f31b-4c75-918d-f9a69564c670 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:51.350545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-700fc908-f31b-4c75-918d-f9a69564c670 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:51.356797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-700fc908-f31b-4c75-918d-f9a69564c670 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:51.357327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-700fc908-f31b-4c75-918d-f9a69564c670 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:51.358200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-700fc908-f31b-4c75-918d-f9a69564c670 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:51.358703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-700fc908-f31b-4c75-918d-f9a69564c670 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:51.388128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-700fc908-f31b-4c75-918d-f9a69564c670 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043822 Aug 01 15:44:51.389319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 848/1613] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:51 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:44:51.417368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c35011bd-1392-41fa-8c0e-fb572a6d19d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:51.424904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c35011bd-1392-41fa-8c0e-fb572a6d19d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152263 Aug 01 15:44:51.425461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 766/1614] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:51 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:52.268473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1bb4262f-daaf-49d7-afe1-d1b9f96d7a6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:52.270706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1bb4262f-daaf-49d7-afe1-d1b9f96d7a6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:52.277554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1bb4262f-daaf-49d7-afe1-d1b9f96d7a6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:52.278039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1bb4262f-daaf-49d7-afe1-d1b9f96d7a6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:52.278814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1bb4262f-daaf-49d7-afe1-d1b9f96d7a6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:52.279825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1bb4262f-daaf-49d7-afe1-d1b9f96d7a6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:52.309634 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1bb4262f-daaf-49d7-afe1-d1b9f96d7a6c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045728 Aug 01 15:44:52.310233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 849/1615] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:52.400977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bd97a863-f6d0-446d-8f7a-5e9fee814651 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:52.403163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bd97a863-f6d0-446d-8f7a-5e9fee814651 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:52.410432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd97a863-f6d0-446d-8f7a-5e9fee814651 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:52.410879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd97a863-f6d0-446d-8f7a-5e9fee814651 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:52.411638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd97a863-f6d0-446d-8f7a-5e9fee814651 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:52.412066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd97a863-f6d0-446d-8f7a-5e9fee814651 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:52.440767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bd97a863-f6d0-446d-8f7a-5e9fee814651 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043795 Aug 01 15:44:52.441323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 767/1616] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:52 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:52.446098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ed4f616b-49b0-46de-8955-960aa7dc5bd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:52.446721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ed4f616b-49b0-46de-8955-960aa7dc5bd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:52.453503 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed4f616b-49b0-46de-8955-960aa7dc5bd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:52.453983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed4f616b-49b0-46de-8955-960aa7dc5bd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:52.454754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed4f616b-49b0-46de-8955-960aa7dc5bd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:52.455192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed4f616b-49b0-46de-8955-960aa7dc5bd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:52.616908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ed4f616b-49b0-46de-8955-960aa7dc5bd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:52.625187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ed4f616b-49b0-46de-8955-960aa7dc5bd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.182967 Aug 01 15:44:52.625743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 850/1617] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:52 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:44:53.322437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ef5f4faf-51ab-472c-8b4c-70d17569a94d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:53.324493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ef5f4faf-51ab-472c-8b4c-70d17569a94d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:53.330581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef5f4faf-51ab-472c-8b4c-70d17569a94d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:53.331030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef5f4faf-51ab-472c-8b4c-70d17569a94d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:53.331800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef5f4faf-51ab-472c-8b4c-70d17569a94d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:53.332237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef5f4faf-51ab-472c-8b4c-70d17569a94d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:53.362104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ef5f4faf-51ab-472c-8b4c-70d17569a94d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043666 Aug 01 15:44:53.362739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 768/1618] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:53.453287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d2217635-9a65-4101-9d6a-1c2390bd1916 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:53.455472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d2217635-9a65-4101-9d6a-1c2390bd1916 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:53.462327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d2217635-9a65-4101-9d6a-1c2390bd1916 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:53.462783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d2217635-9a65-4101-9d6a-1c2390bd1916 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:53.463532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d2217635-9a65-4101-9d6a-1c2390bd1916 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:53.463966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d2217635-9a65-4101-9d6a-1c2390bd1916 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:53.494106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d2217635-9a65-4101-9d6a-1c2390bd1916 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045008 Aug 01 15:44:53.494654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 851/1619] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:53 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:53.648533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4caca6ce-d03a-40a3-9907-f177478a6b9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:53.649144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4caca6ce-d03a-40a3-9907-f177478a6b9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:53.655730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4caca6ce-d03a-40a3-9907-f177478a6b9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:53.656423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4caca6ce-d03a-40a3-9907-f177478a6b9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:53.656998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4caca6ce-d03a-40a3-9907-f177478a6b9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:53.657563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4caca6ce-d03a-40a3-9907-f177478a6b9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:53.793602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4caca6ce-d03a-40a3-9907-f177478a6b9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:53.801339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4caca6ce-d03a-40a3-9907-f177478a6b9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.157350 Aug 01 15:44:53.801926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 769/1620] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:53 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:54.375465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ea85a368-7493-46e0-a4af-05361c02b711 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:54.377655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ea85a368-7493-46e0-a4af-05361c02b711 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:54.383870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ea85a368-7493-46e0-a4af-05361c02b711 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:54.384319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ea85a368-7493-46e0-a4af-05361c02b711 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:54.385084 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ea85a368-7493-46e0-a4af-05361c02b711 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:54.385527 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ea85a368-7493-46e0-a4af-05361c02b711 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:54.413986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ea85a368-7493-46e0-a4af-05361c02b711 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043065 Aug 01 15:44:54.414548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 852/1621] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:54.506916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3bda352e-83d2-4908-9d99-04bac7bf6d66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:54.509074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3bda352e-83d2-4908-9d99-04bac7bf6d66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:54.511059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=82 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:54.517452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3bda352e-83d2-4908-9d99-04bac7bf6d66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:54.518090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3bda352e-83d2-4908-9d99-04bac7bf6d66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:54.519016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3bda352e-83d2-4908-9d99-04bac7bf6d66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:54.519546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3bda352e-83d2-4908-9d99-04bac7bf6d66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:54.551224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3bda352e-83d2-4908-9d99-04bac7bf6d66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048187 Aug 01 15:44:54.551801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 770/1622] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:54 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:44:54.822252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1dc12ef0-a526-4379-a323-3a4b74ecfb4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:54.822798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1dc12ef0-a526-4379-a323-3a4b74ecfb4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:54.829912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1dc12ef0-a526-4379-a323-3a4b74ecfb4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:54.830358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1dc12ef0-a526-4379-a323-3a4b74ecfb4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:54.831110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1dc12ef0-a526-4379-a323-3a4b74ecfb4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:54.831543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1dc12ef0-a526-4379-a323-3a4b74ecfb4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:54.961979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1dc12ef0-a526-4379-a323-3a4b74ecfb4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:54.969790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1dc12ef0-a526-4379-a323-3a4b74ecfb4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151537 Aug 01 15:44:54.970390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 853/1623] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:54 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:55.426913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d3305e57-2fc6-4a9e-9e98-f8bc5d2c4686 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:55.429072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d3305e57-2fc6-4a9e-9e98-f8bc5d2c4686 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:55.436505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3305e57-2fc6-4a9e-9e98-f8bc5d2c4686 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:55.436945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3305e57-2fc6-4a9e-9e98-f8bc5d2c4686 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:55.437702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3305e57-2fc6-4a9e-9e98-f8bc5d2c4686 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:55.438163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3305e57-2fc6-4a9e-9e98-f8bc5d2c4686 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:55.467511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d3305e57-2fc6-4a9e-9e98-f8bc5d2c4686 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044547 Aug 01 15:44:55.468073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 771/1624] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:55.564171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a1454e46-3795-4a3d-bfa9-7e7a539bff4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:55.566417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a1454e46-3795-4a3d-bfa9-7e7a539bff4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:55.572456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a1454e46-3795-4a3d-bfa9-7e7a539bff4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:55.572901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a1454e46-3795-4a3d-bfa9-7e7a539bff4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:55.573662 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a1454e46-3795-4a3d-bfa9-7e7a539bff4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:55.574128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a1454e46-3795-4a3d-bfa9-7e7a539bff4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:55.603539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a1454e46-3795-4a3d-bfa9-7e7a539bff4b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Aug 01 15:44:55.604335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 854/1625] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:55 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:55.991215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a175710b-eba0-4e2d-a3c0-b039185b9782 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:55.991832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a175710b-eba0-4e2d-a3c0-b039185b9782 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:55.997912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a175710b-eba0-4e2d-a3c0-b039185b9782 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:55.998952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a175710b-eba0-4e2d-a3c0-b039185b9782 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:55.999724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a175710b-eba0-4e2d-a3c0-b039185b9782 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:56.000161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a175710b-eba0-4e2d-a3c0-b039185b9782 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:56.137824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a175710b-eba0-4e2d-a3c0-b039185b9782 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:56.145581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a175710b-eba0-4e2d-a3c0-b039185b9782 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158214 Aug 01 15:44:56.146191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 772/1626] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:55 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:56.480397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-be9fdfc5-3f95-4aa1-b6d0-51ee3d08cbe2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:56.483164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-be9fdfc5-3f95-4aa1-b6d0-51ee3d08cbe2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:56.489666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-be9fdfc5-3f95-4aa1-b6d0-51ee3d08cbe2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:56.490143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-be9fdfc5-3f95-4aa1-b6d0-51ee3d08cbe2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:56.490905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-be9fdfc5-3f95-4aa1-b6d0-51ee3d08cbe2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:56.491341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-be9fdfc5-3f95-4aa1-b6d0-51ee3d08cbe2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:56.520883 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-be9fdfc5-3f95-4aa1-b6d0-51ee3d08cbe2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044462 Aug 01 15:44:56.521435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 855/1627] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:56.615234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d93171d0-746f-4c06-b40b-f3104187032a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:56.617388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d93171d0-746f-4c06-b40b-f3104187032a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:56.624001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d93171d0-746f-4c06-b40b-f3104187032a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:56.624479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d93171d0-746f-4c06-b40b-f3104187032a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:56.625236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d93171d0-746f-4c06-b40b-f3104187032a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:56.625673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d93171d0-746f-4c06-b40b-f3104187032a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:56.650525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:44:56.656522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d93171d0-746f-4c06-b40b-f3104187032a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045252 Aug 01 15:44:56.657097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 773/1628] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:56 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:57.167655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-575adca8-4826-49b2-b576-a5d26b17d9ad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:57.168286 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-575adca8-4826-49b2-b576-a5d26b17d9ad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:57.174993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-575adca8-4826-49b2-b576-a5d26b17d9ad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:57.175430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-575adca8-4826-49b2-b576-a5d26b17d9ad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:57.176182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-575adca8-4826-49b2-b576-a5d26b17d9ad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:57.176614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-575adca8-4826-49b2-b576-a5d26b17d9ad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:57.305878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-575adca8-4826-49b2-b576-a5d26b17d9ad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:57.313510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-575adca8-4826-49b2-b576-a5d26b17d9ad tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.150026 Aug 01 15:44:57.314115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 856/1629] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:57 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:57.534075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7541e871-aa5a-4a00-abcf-3dabb5dce630 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:57.536167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7541e871-aa5a-4a00-abcf-3dabb5dce630 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:57.542293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7541e871-aa5a-4a00-abcf-3dabb5dce630 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:57.542744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7541e871-aa5a-4a00-abcf-3dabb5dce630 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:57.543512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7541e871-aa5a-4a00-abcf-3dabb5dce630 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:57.543948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7541e871-aa5a-4a00-abcf-3dabb5dce630 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:57.571957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7541e871-aa5a-4a00-abcf-3dabb5dce630 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042636 Aug 01 15:44:57.572565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 774/1630] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:57.668843 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-39c6919f-489b-49f1-b2c7-810626cd8171 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:57.671102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-39c6919f-489b-49f1-b2c7-810626cd8171 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:57.677710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39c6919f-489b-49f1-b2c7-810626cd8171 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:57.678188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39c6919f-489b-49f1-b2c7-810626cd8171 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:57.678952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39c6919f-489b-49f1-b2c7-810626cd8171 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:57.679381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39c6919f-489b-49f1-b2c7-810626cd8171 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:57.709846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-39c6919f-489b-49f1-b2c7-810626cd8171 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Aug 01 15:44:57.710427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 857/1631] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:57 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:58.334860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6303e7f4-3a63-4523-baf4-37b041c12e78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:58.335476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6303e7f4-3a63-4523-baf4-37b041c12e78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:58.342132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6303e7f4-3a63-4523-baf4-37b041c12e78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:58.342589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6303e7f4-3a63-4523-baf4-37b041c12e78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:58.343386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6303e7f4-3a63-4523-baf4-37b041c12e78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:58.344070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6303e7f4-3a63-4523-baf4-37b041c12e78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:58.486642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6303e7f4-3a63-4523-baf4-37b041c12e78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:58.494297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6303e7f4-3a63-4523-baf4-37b041c12e78 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.163247 Aug 01 15:44:58.494946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 775/1632] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:58 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:44:58.532338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b2cb9b78-c33c-4dc3-b328-ae077d10c16a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:58.532838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b2cb9b78-c33c-4dc3-b328-ae077d10c16a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:58.539239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b2cb9b78-c33c-4dc3-b328-ae077d10c16a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:58.539591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b2cb9b78-c33c-4dc3-b328-ae077d10c16a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:58.540365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b2cb9b78-c33c-4dc3-b328-ae077d10c16a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:58.540809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b2cb9b78-c33c-4dc3-b328-ae077d10c16a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:58.584720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fe99090d-fca9-4299-b8c8-4dff3e88fcde tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:58.586940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fe99090d-fca9-4299-b8c8-4dff3e88fcde tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:58.593831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe99090d-fca9-4299-b8c8-4dff3e88fcde tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:58.594306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe99090d-fca9-4299-b8c8-4dff3e88fcde tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:58.595075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe99090d-fca9-4299-b8c8-4dff3e88fcde tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:58.595506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe99090d-fca9-4299-b8c8-4dff3e88fcde tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:58.626989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fe99090d-fca9-4299-b8c8-4dff3e88fcde tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046293 Aug 01 15:44:58.627543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 776/1633] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:58.722250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c3542d29-769a-4cd0-a449-af1a7e3be6cb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:58.724555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c3542d29-769a-4cd0-a449-af1a7e3be6cb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:58.730835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3542d29-769a-4cd0-a449-af1a7e3be6cb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:58.731694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3542d29-769a-4cd0-a449-af1a7e3be6cb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:58.732845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3542d29-769a-4cd0-a449-af1a7e3be6cb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:58.733079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3542d29-769a-4cd0-a449-af1a7e3be6cb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:58.762318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c3542d29-769a-4cd0-a449-af1a7e3be6cb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Aug 01 15:44:58.762875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 777/1634] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:58 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:44:59.516433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-73c18490-d948-443d-9bd0-1943ea70e09f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:59.517088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-73c18490-d948-443d-9bd0-1943ea70e09f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:59.523746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73c18490-d948-443d-9bd0-1943ea70e09f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:59.524274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73c18490-d948-443d-9bd0-1943ea70e09f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:59.524978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73c18490-d948-443d-9bd0-1943ea70e09f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:59.525420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73c18490-d948-443d-9bd0-1943ea70e09f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:59.659473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-73c18490-d948-443d-9bd0-1943ea70e09f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:44:59.667258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-73c18490-d948-443d-9bd0-1943ea70e09f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155262 Aug 01 15:44:59.667831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 778/1635] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:59 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:44:59.672714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-01593371-1e92-4e7f-9fa8-b2f7eb5bfd8a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:59.673207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-01593371-1e92-4e7f-9fa8-b2f7eb5bfd8a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:59.678978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-01593371-1e92-4e7f-9fa8-b2f7eb5bfd8a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:59.679431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-01593371-1e92-4e7f-9fa8-b2f7eb5bfd8a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:59.680308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-01593371-1e92-4e7f-9fa8-b2f7eb5bfd8a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:59.680755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-01593371-1e92-4e7f-9fa8-b2f7eb5bfd8a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:59.705863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-01593371-1e92-4e7f-9fa8-b2f7eb5bfd8a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:44:59.783697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-01593371-1e92-4e7f-9fa8-b2f7eb5bfd8a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "DELETE /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 204 len: 0 microversion: 2.1 time: 0.114380 Aug 01 15:44:59.784228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 779/1636] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 15:44:59 2022] DELETE /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:44:59.789956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-207ed12d-b9b7-4c36-8d38-4d3805a29554 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:59.792215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-207ed12d-b9b7-4c36-8d38-4d3805a29554 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:59.798838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-207ed12d-b9b7-4c36-8d38-4d3805a29554 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:59.799283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-207ed12d-b9b7-4c36-8d38-4d3805a29554 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:59.800057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-207ed12d-b9b7-4c36-8d38-4d3805a29554 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:59.800494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-207ed12d-b9b7-4c36-8d38-4d3805a29554 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:59.829636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-207ed12d-b9b7-4c36-8d38-4d3805a29554 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044238 Aug 01 15:44:59.830228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 780/1637] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:44:59 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:44:59.834653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d4f471ea-b00b-4896-aca5-4ba996e3c132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:59.836819 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d4f471ea-b00b-4896-aca5-4ba996e3c132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:59.842569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d4f471ea-b00b-4896-aca5-4ba996e3c132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:59.843013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d4f471ea-b00b-4896-aca5-4ba996e3c132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:59.844031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d4f471ea-b00b-4896-aca5-4ba996e3c132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:59.844464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d4f471ea-b00b-4896-aca5-4ba996e3c132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:59.873770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d4f471ea-b00b-4896-aca5-4ba996e3c132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042539 Aug 01 15:44:59.874367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 781/1638] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:44:59 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:44:59.878652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d7cedc3d-e260-4a0c-934f-1f715447ae1e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:44:59.879257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d7cedc3d-e260-4a0c-934f-1f715447ae1e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:44:59.884853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7cedc3d-e260-4a0c-934f-1f715447ae1e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:59.885297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7cedc3d-e260-4a0c-934f-1f715447ae1e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:44:59.886096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7cedc3d-e260-4a0c-934f-1f715447ae1e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:44:59.886532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7cedc3d-e260-4a0c-934f-1f715447ae1e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:00.019865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d7cedc3d-e260-4a0c-934f-1f715447ae1e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:00.027890 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d7cedc3d-e260-4a0c-934f-1f715447ae1e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.152590 Aug 01 15:45:00.028453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 782/1639] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:44:59 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:45:00.689833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7d2d7a41-2382-4be1-b6a1-42dcf6b7f652 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:00.690559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7d2d7a41-2382-4be1-b6a1-42dcf6b7f652 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:00.697027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d2d7a41-2382-4be1-b6a1-42dcf6b7f652 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:00.697508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d2d7a41-2382-4be1-b6a1-42dcf6b7f652 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:00.698319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d2d7a41-2382-4be1-b6a1-42dcf6b7f652 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:00.698765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d2d7a41-2382-4be1-b6a1-42dcf6b7f652 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:00.833226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7d2d7a41-2382-4be1-b6a1-42dcf6b7f652 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:00.840850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7d2d7a41-2382-4be1-b6a1-42dcf6b7f652 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155640 Aug 01 15:45:00.841940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 783/1640] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:00 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:00.846739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8e6889d7-cb69-407b-9147-e29da71eef94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:00.848941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8e6889d7-cb69-407b-9147-e29da71eef94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:00.854976 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e6889d7-cb69-407b-9147-e29da71eef94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:00.855423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e6889d7-cb69-407b-9147-e29da71eef94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:00.856203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e6889d7-cb69-407b-9147-e29da71eef94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:00.856670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e6889d7-cb69-407b-9147-e29da71eef94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:00.887725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8e6889d7-cb69-407b-9147-e29da71eef94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044748 Aug 01 15:45:00.888320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 784/1641] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:00.892819 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a6e51807-63a4-43b8-8703-656341173cca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:00.894966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a6e51807-63a4-43b8-8703-656341173cca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:00.901140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a6e51807-63a4-43b8-8703-656341173cca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:00.901618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a6e51807-63a4-43b8-8703-656341173cca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:00.902448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a6e51807-63a4-43b8-8703-656341173cca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:00.902891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a6e51807-63a4-43b8-8703-656341173cca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:00.934191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a6e51807-63a4-43b8-8703-656341173cca tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Aug 01 15:45:00.934756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 785/1642] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:00 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:01.049179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2e19a1f4-3d65-474f-b54c-6133f4670796 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:01.049732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2e19a1f4-3d65-474f-b54c-6133f4670796 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:01.055872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e19a1f4-3d65-474f-b54c-6133f4670796 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:01.056318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e19a1f4-3d65-474f-b54c-6133f4670796 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:01.057091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e19a1f4-3d65-474f-b54c-6133f4670796 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:01.057524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e19a1f4-3d65-474f-b54c-6133f4670796 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:01.186561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2e19a1f4-3d65-474f-b54c-6133f4670796 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:01.194407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2e19a1f4-3d65-474f-b54c-6133f4670796 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.149795 Aug 01 15:45:01.195108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 786/1643] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:01 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:01.863891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2c1c88eb-02aa-4555-899a-c23dd272dbee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:01.864542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2c1c88eb-02aa-4555-899a-c23dd272dbee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:01.871354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2c1c88eb-02aa-4555-899a-c23dd272dbee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:01.871803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2c1c88eb-02aa-4555-899a-c23dd272dbee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:01.873218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2c1c88eb-02aa-4555-899a-c23dd272dbee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:01.873660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2c1c88eb-02aa-4555-899a-c23dd272dbee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:02.014878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2c1c88eb-02aa-4555-899a-c23dd272dbee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:02.022704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2c1c88eb-02aa-4555-899a-c23dd272dbee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.162728 Aug 01 15:45:02.023270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 787/1644] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:01 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:02.027855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-40356563-2bcd-48ae-983b-0353dc8dbe53 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:02.030020 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-40356563-2bcd-48ae-983b-0353dc8dbe53 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:02.035886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-40356563-2bcd-48ae-983b-0353dc8dbe53 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:02.036342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-40356563-2bcd-48ae-983b-0353dc8dbe53 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:02.037114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-40356563-2bcd-48ae-983b-0353dc8dbe53 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:02.037557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-40356563-2bcd-48ae-983b-0353dc8dbe53 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:02.063928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:02.069619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-40356563-2bcd-48ae-983b-0353dc8dbe53 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045332 Aug 01 15:45:02.070224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 788/1645] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:02.074734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-adf388f9-433e-40e3-a1c0-d4e78859600f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:45:02.076923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-adf388f9-433e-40e3-a1c0-d4e78859600f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:02.084727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-adf388f9-433e-40e3-a1c0-d4e78859600f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:02.085174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-adf388f9-433e-40e3-a1c0-d4e78859600f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:02.085970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-adf388f9-433e-40e3-a1c0-d4e78859600f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:02.086410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-adf388f9-433e-40e3-a1c0-d4e78859600f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:02.190654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-adf388f9-433e-40e3-a1c0-d4e78859600f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "POST /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/action" status: 200 len: 41332 microversion: 2.1 time: 0.119140 Aug 01 15:45:02.191315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 789/1646] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 1 15:45:02 2022] POST /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961/action => generated 41332 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:02.215459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-14ce18c2-ed31-4b10-a366-0ec721990d33 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:02.216652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-14ce18c2-ed31-4b10-a366-0ec721990d33 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:02.224140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14ce18c2-ed31-4b10-a366-0ec721990d33 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:02.224587 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14ce18c2-ed31-4b10-a366-0ec721990d33 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:02.225366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14ce18c2-ed31-4b10-a366-0ec721990d33 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:02.225799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14ce18c2-ed31-4b10-a366-0ec721990d33 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:02.360389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-14ce18c2-ed31-4b10-a366-0ec721990d33 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:02.368873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-14ce18c2-ed31-4b10-a366-0ec721990d33 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.157633 Aug 01 15:45:02.369439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 790/1647] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:02 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:45:03.044201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-39cb8481-5764-4c98-9ae4-10e5321eee79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:03.045568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-39cb8481-5764-4c98-9ae4-10e5321eee79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:03.052405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39cb8481-5764-4c98-9ae4-10e5321eee79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:03.052857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39cb8481-5764-4c98-9ae4-10e5321eee79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:03.053649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39cb8481-5764-4c98-9ae4-10e5321eee79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:03.054115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39cb8481-5764-4c98-9ae4-10e5321eee79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:03.185399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-39cb8481-5764-4c98-9ae4-10e5321eee79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:03.192966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-39cb8481-5764-4c98-9ae4-10e5321eee79 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152728 Aug 01 15:45:03.193530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 791/1648] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:03 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:03.198251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-77662717-91ce-4003-84c4-073cb9d9e6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:03.200368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-77662717-91ce-4003-84c4-073cb9d9e6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:03.206087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77662717-91ce-4003-84c4-073cb9d9e6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:03.206530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77662717-91ce-4003-84c4-073cb9d9e6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:03.207291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77662717-91ce-4003-84c4-073cb9d9e6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:03.207724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77662717-91ce-4003-84c4-073cb9d9e6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:03.237857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-77662717-91ce-4003-84c4-073cb9d9e6b4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043276 Aug 01 15:45:03.238434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 792/1649] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:03.391266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fbb3fd41-1e2c-403b-8d7d-363cb697de31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:03.391885 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fbb3fd41-1e2c-403b-8d7d-363cb697de31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:03.398425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fbb3fd41-1e2c-403b-8d7d-363cb697de31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:03.398887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fbb3fd41-1e2c-403b-8d7d-363cb697de31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:03.399654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fbb3fd41-1e2c-403b-8d7d-363cb697de31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:03.400094 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fbb3fd41-1e2c-403b-8d7d-363cb697de31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:03.533779 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fbb3fd41-1e2c-403b-8d7d-363cb697de31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:03.541826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fbb3fd41-1e2c-403b-8d7d-363cb697de31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.154942 Aug 01 15:45:03.542432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 793/1650] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:03 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:04.213975 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4ae88a56-070a-48cc-a597-a62a2b23b0ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:04.214660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4ae88a56-070a-48cc-a597-a62a2b23b0ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:04.222051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ae88a56-070a-48cc-a597-a62a2b23b0ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:04.222498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ae88a56-070a-48cc-a597-a62a2b23b0ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:04.223262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ae88a56-070a-48cc-a597-a62a2b23b0ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:04.223695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ae88a56-070a-48cc-a597-a62a2b23b0ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:04.353376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4ae88a56-070a-48cc-a597-a62a2b23b0ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:04.360928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4ae88a56-070a-48cc-a597-a62a2b23b0ae tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.150839 Aug 01 15:45:04.361489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 794/1651] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:04 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:04.366035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e59b7956-db5c-434f-aa88-71870724cd5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:04.368287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e59b7956-db5c-434f-aa88-71870724cd5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:04.374070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e59b7956-db5c-434f-aa88-71870724cd5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:04.374517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e59b7956-db5c-434f-aa88-71870724cd5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:04.375282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e59b7956-db5c-434f-aa88-71870724cd5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:04.375716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e59b7956-db5c-434f-aa88-71870724cd5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:04.407371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e59b7956-db5c-434f-aa88-71870724cd5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044827 Aug 01 15:45:04.407935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 795/1652] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:04 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:04.563137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a1bf5b56-8f5f-44d8-997b-bee5f2d1a198 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:04.563665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a1bf5b56-8f5f-44d8-997b-bee5f2d1a198 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:04.569842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a1bf5b56-8f5f-44d8-997b-bee5f2d1a198 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:04.570329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a1bf5b56-8f5f-44d8-997b-bee5f2d1a198 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:04.571101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a1bf5b56-8f5f-44d8-997b-bee5f2d1a198 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:04.571545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a1bf5b56-8f5f-44d8-997b-bee5f2d1a198 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:04.706904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a1bf5b56-8f5f-44d8-997b-bee5f2d1a198 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:04.714909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a1bf5b56-8f5f-44d8-997b-bee5f2d1a198 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.155767 Aug 01 15:45:04.715482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 796/1653] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:04 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:05.382362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d59502dc-46b3-489c-bd7b-d7153b3f69ca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:05.383052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d59502dc-46b3-489c-bd7b-d7153b3f69ca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:05.390189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d59502dc-46b3-489c-bd7b-d7153b3f69ca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:05.390646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d59502dc-46b3-489c-bd7b-d7153b3f69ca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:05.391413 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d59502dc-46b3-489c-bd7b-d7153b3f69ca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:05.391850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d59502dc-46b3-489c-bd7b-d7153b3f69ca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:05.523214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d59502dc-46b3-489c-bd7b-d7153b3f69ca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:05.531300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d59502dc-46b3-489c-bd7b-d7153b3f69ca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152824 Aug 01 15:45:05.531859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 797/1654] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:05 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:05.538542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-85348001-88ef-4789-beb3-07893a57d0ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:05.538829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-85348001-88ef-4789-beb3-07893a57d0ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:05.545635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85348001-88ef-4789-beb3-07893a57d0ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:05.546145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85348001-88ef-4789-beb3-07893a57d0ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:05.547006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85348001-88ef-4789-beb3-07893a57d0ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:05.547486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85348001-88ef-4789-beb3-07893a57d0ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:05.577361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-85348001-88ef-4789-beb3-07893a57d0ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044429 Aug 01 15:45:05.577922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 798/1655] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:05.736585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a85bcfdf-8490-48dd-a138-6c363e1482ca tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:05.737105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a85bcfdf-8490-48dd-a138-6c363e1482ca tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:05.743176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a85bcfdf-8490-48dd-a138-6c363e1482ca tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:05.743645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a85bcfdf-8490-48dd-a138-6c363e1482ca tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:05.744397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a85bcfdf-8490-48dd-a138-6c363e1482ca tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:05.744824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a85bcfdf-8490-48dd-a138-6c363e1482ca tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:05.878264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a85bcfdf-8490-48dd-a138-6c363e1482ca tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:05.886518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a85bcfdf-8490-48dd-a138-6c363e1482ca tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153617 Aug 01 15:45:05.887316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 799/1656] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:05 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:06.552833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b727797f-57fc-4dba-98d8-e3b47cbe861c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:06.553481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b727797f-57fc-4dba-98d8-e3b47cbe861c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:06.560291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b727797f-57fc-4dba-98d8-e3b47cbe861c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:06.560742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b727797f-57fc-4dba-98d8-e3b47cbe861c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:06.561534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b727797f-57fc-4dba-98d8-e3b47cbe861c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:06.561991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b727797f-57fc-4dba-98d8-e3b47cbe861c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:06.695964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b727797f-57fc-4dba-98d8-e3b47cbe861c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:06.704073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b727797f-57fc-4dba-98d8-e3b47cbe861c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155127 Aug 01 15:45:06.704638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 800/1657] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:06 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:06.709117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-18ae7909-001d-451f-9358-20829be84fdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:06.711252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-18ae7909-001d-451f-9358-20829be84fdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:06.716946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-18ae7909-001d-451f-9358-20829be84fdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:06.717392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-18ae7909-001d-451f-9358-20829be84fdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:06.718197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-18ae7909-001d-451f-9358-20829be84fdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:06.718879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-18ae7909-001d-451f-9358-20829be84fdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:06.746862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-18ae7909-001d-451f-9358-20829be84fdc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041223 Aug 01 15:45:06.747942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 801/1658] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:06.910525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a6a8d467-0517-4057-a431-111ee49ffc63 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:06.911136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a6a8d467-0517-4057-a431-111ee49ffc63 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:06.917202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a6a8d467-0517-4057-a431-111ee49ffc63 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:06.917643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a6a8d467-0517-4057-a431-111ee49ffc63 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:06.918446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a6a8d467-0517-4057-a431-111ee49ffc63 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:06.918876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a6a8d467-0517-4057-a431-111ee49ffc63 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:07.045846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a6a8d467-0517-4057-a431-111ee49ffc63 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:07.053845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a6a8d467-0517-4057-a431-111ee49ffc63 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.147088 Aug 01 15:45:07.054462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 802/1659] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:06 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:07.725363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b219f7e1-29a9-4006-8e24-28a16499e0b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:07.726081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b219f7e1-29a9-4006-8e24-28a16499e0b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:07.732602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b219f7e1-29a9-4006-8e24-28a16499e0b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:07.733046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b219f7e1-29a9-4006-8e24-28a16499e0b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:07.733840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b219f7e1-29a9-4006-8e24-28a16499e0b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:07.734313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b219f7e1-29a9-4006-8e24-28a16499e0b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:07.875525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b219f7e1-29a9-4006-8e24-28a16499e0b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:07.883288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b219f7e1-29a9-4006-8e24-28a16499e0b1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.161805 Aug 01 15:45:07.883861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 803/1660] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:07 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:07.888390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-71c8793c-c3ba-4419-9d36-c4ddc78e5d3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:07.890521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-71c8793c-c3ba-4419-9d36-c4ddc78e5d3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:07.896575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-71c8793c-c3ba-4419-9d36-c4ddc78e5d3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:07.897100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-71c8793c-c3ba-4419-9d36-c4ddc78e5d3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:07.897750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-71c8793c-c3ba-4419-9d36-c4ddc78e5d3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:07.898429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-71c8793c-c3ba-4419-9d36-c4ddc78e5d3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:07.929148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-71c8793c-c3ba-4419-9d36-c4ddc78e5d3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044251 Aug 01 15:45:07.929699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 804/1661] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:07 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:08.075803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a8ef5827-8e34-410b-90cf-258e173913c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:08.076343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a8ef5827-8e34-410b-90cf-258e173913c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:08.082575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8ef5827-8e34-410b-90cf-258e173913c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:08.083023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8ef5827-8e34-410b-90cf-258e173913c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:08.083792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8ef5827-8e34-410b-90cf-258e173913c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:08.084233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8ef5827-8e34-410b-90cf-258e173913c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:08.212103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a8ef5827-8e34-410b-90cf-258e173913c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:08.214464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:08.222202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a8ef5827-8e34-410b-90cf-258e173913c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.150597 Aug 01 15:45:08.222767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 805/1662] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:08 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:08.537047 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=73 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:08.559653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=66 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:08.905357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c777fba7-ba13-4062-b413-a8d1692a864a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:08.906139 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c777fba7-ba13-4062-b413-a8d1692a864a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:08.912626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c777fba7-ba13-4062-b413-a8d1692a864a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:08.913071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c777fba7-ba13-4062-b413-a8d1692a864a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:08.913847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c777fba7-ba13-4062-b413-a8d1692a864a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:08.914307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c777fba7-ba13-4062-b413-a8d1692a864a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:09.049537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c777fba7-ba13-4062-b413-a8d1692a864a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:09.057439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c777fba7-ba13-4062-b413-a8d1692a864a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156544 Aug 01 15:45:09.058059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 806/1663] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:08 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:09.063258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-612d2851-3ef6-43b8-9599-21e39edc8131 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:09.065405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-612d2851-3ef6-43b8-9599-21e39edc8131 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:09.071664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-612d2851-3ef6-43b8-9599-21e39edc8131 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:09.072113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-612d2851-3ef6-43b8-9599-21e39edc8131 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:09.072894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-612d2851-3ef6-43b8-9599-21e39edc8131 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:09.073382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-612d2851-3ef6-43b8-9599-21e39edc8131 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:09.105287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-612d2851-3ef6-43b8-9599-21e39edc8131 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046161 Aug 01 15:45:09.105852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 807/1664] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:09.244209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-88810059-070d-4b97-a31b-dfdad70c69eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:09.244851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-88810059-070d-4b97-a31b-dfdad70c69eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:09.251539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-88810059-070d-4b97-a31b-dfdad70c69eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:09.251986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-88810059-070d-4b97-a31b-dfdad70c69eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:09.252751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-88810059-070d-4b97-a31b-dfdad70c69eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:09.253186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-88810059-070d-4b97-a31b-dfdad70c69eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:09.383420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-88810059-070d-4b97-a31b-dfdad70c69eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:09.391444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-88810059-070d-4b97-a31b-dfdad70c69eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.151210 Aug 01 15:45:09.392013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 808/1665] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:09 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:10.080005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3702b5b2-df7a-41d0-a144-e58bac5a19fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:10.080633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3702b5b2-df7a-41d0-a144-e58bac5a19fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:10.087364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3702b5b2-df7a-41d0-a144-e58bac5a19fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:10.087750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3702b5b2-df7a-41d0-a144-e58bac5a19fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:10.088622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3702b5b2-df7a-41d0-a144-e58bac5a19fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:10.089059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3702b5b2-df7a-41d0-a144-e58bac5a19fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:10.221071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3702b5b2-df7a-41d0-a144-e58bac5a19fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:10.228660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3702b5b2-df7a-41d0-a144-e58bac5a19fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152952 Aug 01 15:45:10.229222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 809/1666] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:10 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:10.233861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-df980c61-4067-408f-9151-2f6bad7626c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:10.236074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-df980c61-4067-408f-9151-2f6bad7626c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:10.242224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df980c61-4067-408f-9151-2f6bad7626c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:10.242734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df980c61-4067-408f-9151-2f6bad7626c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:10.243442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df980c61-4067-408f-9151-2f6bad7626c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:10.243876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df980c61-4067-408f-9151-2f6bad7626c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:10.273719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-df980c61-4067-408f-9151-2f6bad7626c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043475 Aug 01 15:45:10.274299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 810/1667] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:10 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:10.414018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ccff2731-5e0e-45ee-a9ea-e2c6ed7939d6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:10.414635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ccff2731-5e0e-45ee-a9ea-e2c6ed7939d6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:10.420724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ccff2731-5e0e-45ee-a9ea-e2c6ed7939d6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:10.421165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ccff2731-5e0e-45ee-a9ea-e2c6ed7939d6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:10.421940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ccff2731-5e0e-45ee-a9ea-e2c6ed7939d6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:10.422374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ccff2731-5e0e-45ee-a9ea-e2c6ed7939d6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:10.555875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ccff2731-5e0e-45ee-a9ea-e2c6ed7939d6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:10.564337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ccff2731-5e0e-45ee-a9ea-e2c6ed7939d6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.155348 Aug 01 15:45:10.564900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 811/1668] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:10 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:11.250551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-259b45f8-3a8a-483a-b203-0a00c8ddce85 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:11.251351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-259b45f8-3a8a-483a-b203-0a00c8ddce85 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:11.257815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-259b45f8-3a8a-483a-b203-0a00c8ddce85 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:11.258304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-259b45f8-3a8a-483a-b203-0a00c8ddce85 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:11.259063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-259b45f8-3a8a-483a-b203-0a00c8ddce85 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:11.259504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-259b45f8-3a8a-483a-b203-0a00c8ddce85 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:11.391659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-259b45f8-3a8a-483a-b203-0a00c8ddce85 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:11.399227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-259b45f8-3a8a-483a-b203-0a00c8ddce85 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153082 Aug 01 15:45:11.399787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 812/1669] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:11 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:11.404545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e4529c2a-faa4-4cae-84fc-b2c8bd8c8acc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:11.406678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e4529c2a-faa4-4cae-84fc-b2c8bd8c8acc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:11.412702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e4529c2a-faa4-4cae-84fc-b2c8bd8c8acc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:11.413149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e4529c2a-faa4-4cae-84fc-b2c8bd8c8acc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:11.413949 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e4529c2a-faa4-4cae-84fc-b2c8bd8c8acc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:11.414395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e4529c2a-faa4-4cae-84fc-b2c8bd8c8acc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:11.443575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e4529c2a-faa4-4cae-84fc-b2c8bd8c8acc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042688 Aug 01 15:45:11.444129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 813/1670] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:11 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:11.585451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3b741e52-dbe8-449a-9ee6-06a4767fca8e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:11.586009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3b741e52-dbe8-449a-9ee6-06a4767fca8e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:11.592067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3b741e52-dbe8-449a-9ee6-06a4767fca8e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:11.592520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3b741e52-dbe8-449a-9ee6-06a4767fca8e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:11.593279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3b741e52-dbe8-449a-9ee6-06a4767fca8e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:11.593999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3b741e52-dbe8-449a-9ee6-06a4767fca8e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:11.730683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3b741e52-dbe8-449a-9ee6-06a4767fca8e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:11.739285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3b741e52-dbe8-449a-9ee6-06a4767fca8e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.157710 Aug 01 15:45:11.739874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 814/1671] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:11 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:12.423069 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-748d9d3f-29e8-4d40-bc00-919b004763b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:12.423851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-748d9d3f-29e8-4d40-bc00-919b004763b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:12.431610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-748d9d3f-29e8-4d40-bc00-919b004763b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:12.432063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-748d9d3f-29e8-4d40-bc00-919b004763b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:12.432835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-748d9d3f-29e8-4d40-bc00-919b004763b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:12.433274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-748d9d3f-29e8-4d40-bc00-919b004763b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:12.578092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-748d9d3f-29e8-4d40-bc00-919b004763b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:12.585723 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-748d9d3f-29e8-4d40-bc00-919b004763b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.169034 Aug 01 15:45:12.586393 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 815/1672] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:12 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:12.590947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-31a4a6d2-4f64-438a-9524-0faf0f8fb54f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:12.593972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-31a4a6d2-4f64-438a-9524-0faf0f8fb54f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:12.599968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31a4a6d2-4f64-438a-9524-0faf0f8fb54f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:12.600409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31a4a6d2-4f64-438a-9524-0faf0f8fb54f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:12.601170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31a4a6d2-4f64-438a-9524-0faf0f8fb54f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:12.601592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31a4a6d2-4f64-438a-9524-0faf0f8fb54f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:12.631273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-31a4a6d2-4f64-438a-9524-0faf0f8fb54f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043849 Aug 01 15:45:12.631829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 816/1673] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:12.761664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a2b6508d-3067-4cfd-8e8e-4331fd3d669e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:12.762257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a2b6508d-3067-4cfd-8e8e-4331fd3d669e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:12.764700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:12.770540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2b6508d-3067-4cfd-8e8e-4331fd3d669e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:12.771000 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2b6508d-3067-4cfd-8e8e-4331fd3d669e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:12.771781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2b6508d-3067-4cfd-8e8e-4331fd3d669e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:12.772227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2b6508d-3067-4cfd-8e8e-4331fd3d669e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:12.905750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a2b6508d-3067-4cfd-8e8e-4331fd3d669e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:12.913956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a2b6508d-3067-4cfd-8e8e-4331fd3d669e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.156173 Aug 01 15:45:12.914527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 817/1674] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:12 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:13.608903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-661cbbea-2feb-4965-bb08-644dfefc73de tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:13.609579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-661cbbea-2feb-4965-bb08-644dfefc73de tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:13.616172 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-661cbbea-2feb-4965-bb08-644dfefc73de tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:13.616625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-661cbbea-2feb-4965-bb08-644dfefc73de tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:13.617398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-661cbbea-2feb-4965-bb08-644dfefc73de tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:13.617834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-661cbbea-2feb-4965-bb08-644dfefc73de tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:13.750403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-661cbbea-2feb-4965-bb08-644dfefc73de tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:13.758085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-661cbbea-2feb-4965-bb08-644dfefc73de tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153614 Aug 01 15:45:13.758650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 818/1675] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:13 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:13.763218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-48302fb8-5993-440c-9b49-33432495de80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:13.765334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-48302fb8-5993-440c-9b49-33432495de80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:13.771093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48302fb8-5993-440c-9b49-33432495de80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:13.771553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48302fb8-5993-440c-9b49-33432495de80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:13.772358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48302fb8-5993-440c-9b49-33432495de80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:13.772792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48302fb8-5993-440c-9b49-33432495de80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:13.802698 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-48302fb8-5993-440c-9b49-33432495de80 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043022 Aug 01 15:45:13.803273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 819/1676] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:13.935281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b474ef94-9458-4625-a6c2-eaae2b34d583 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:13.935892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b474ef94-9458-4625-a6c2-eaae2b34d583 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:13.942187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b474ef94-9458-4625-a6c2-eaae2b34d583 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:13.942641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b474ef94-9458-4625-a6c2-eaae2b34d583 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:13.943408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b474ef94-9458-4625-a6c2-eaae2b34d583 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:13.943847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b474ef94-9458-4625-a6c2-eaae2b34d583 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:14.072445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b474ef94-9458-4625-a6c2-eaae2b34d583 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:14.081242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b474ef94-9458-4625-a6c2-eaae2b34d583 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.149787 Aug 01 15:45:14.081815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 820/1677] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:13 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:14.779135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-28ad223e-faa7-4106-aa12-74aea56938e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:14.779822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-28ad223e-faa7-4106-aa12-74aea56938e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:14.786420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28ad223e-faa7-4106-aa12-74aea56938e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:14.786864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28ad223e-faa7-4106-aa12-74aea56938e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:14.787620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28ad223e-faa7-4106-aa12-74aea56938e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:14.788049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28ad223e-faa7-4106-aa12-74aea56938e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:14.924557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-28ad223e-faa7-4106-aa12-74aea56938e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:14.932179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-28ad223e-faa7-4106-aa12-74aea56938e6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156894 Aug 01 15:45:14.932747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 821/1678] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:14 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:14.938120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1fd9acc8-745a-49d1-97c2-0d3f1ddb1bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:14.940280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1fd9acc8-745a-49d1-97c2-0d3f1ddb1bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:14.946359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fd9acc8-745a-49d1-97c2-0d3f1ddb1bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:14.946813 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fd9acc8-745a-49d1-97c2-0d3f1ddb1bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:14.947726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fd9acc8-745a-49d1-97c2-0d3f1ddb1bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:14.948174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fd9acc8-745a-49d1-97c2-0d3f1ddb1bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:14.962321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:14.979225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1fd9acc8-745a-49d1-97c2-0d3f1ddb1bd6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045472 Aug 01 15:45:14.979787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 822/1679] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:15.103357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4b789fed-98f9-47b0-acf8-f60e306aafa4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:15.103982 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4b789fed-98f9-47b0-acf8-f60e306aafa4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:15.110835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b789fed-98f9-47b0-acf8-f60e306aafa4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:15.111288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b789fed-98f9-47b0-acf8-f60e306aafa4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:15.112058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b789fed-98f9-47b0-acf8-f60e306aafa4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:15.112497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b789fed-98f9-47b0-acf8-f60e306aafa4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:15.240991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4b789fed-98f9-47b0-acf8-f60e306aafa4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:15.249211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4b789fed-98f9-47b0-acf8-f60e306aafa4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.149682 Aug 01 15:45:15.249788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 823/1680] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:15 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:15.954562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2215edda-1ea2-4acb-8204-f921cf3bbebb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:15.955244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2215edda-1ea2-4acb-8204-f921cf3bbebb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:15.962354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2215edda-1ea2-4acb-8204-f921cf3bbebb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:15.962795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2215edda-1ea2-4acb-8204-f921cf3bbebb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:15.963557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2215edda-1ea2-4acb-8204-f921cf3bbebb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:15.963990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2215edda-1ea2-4acb-8204-f921cf3bbebb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:16.100720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2215edda-1ea2-4acb-8204-f921cf3bbebb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:16.108875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2215edda-1ea2-4acb-8204-f921cf3bbebb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158953 Aug 01 15:45:16.109453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 824/1681] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:15 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:16.114060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9ee34701-818f-4798-8543-364baa7cc232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:16.116173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9ee34701-818f-4798-8543-364baa7cc232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:16.122664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ee34701-818f-4798-8543-364baa7cc232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:16.123121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ee34701-818f-4798-8543-364baa7cc232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:16.123885 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ee34701-818f-4798-8543-364baa7cc232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:16.124318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ee34701-818f-4798-8543-364baa7cc232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:16.152940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9ee34701-818f-4798-8543-364baa7cc232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042434 Aug 01 15:45:16.153510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 825/1682] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:16 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:16.270773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3543081e-a26c-4c1b-a469-30f4c2c18218 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:16.271295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3543081e-a26c-4c1b-a469-30f4c2c18218 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:16.277270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3543081e-a26c-4c1b-a469-30f4c2c18218 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:16.277712 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3543081e-a26c-4c1b-a469-30f4c2c18218 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:16.278508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3543081e-a26c-4c1b-a469-30f4c2c18218 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:16.278934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3543081e-a26c-4c1b-a469-30f4c2c18218 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:16.411838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3543081e-a26c-4c1b-a469-30f4c2c18218 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:16.420914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3543081e-a26c-4c1b-a469-30f4c2c18218 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153945 Aug 01 15:45:16.421487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 826/1683] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:16 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:17.131128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b420f660-7d6b-4825-80a9-75f4fe47218c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:17.131806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b420f660-7d6b-4825-80a9-75f4fe47218c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:17.138493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b420f660-7d6b-4825-80a9-75f4fe47218c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:17.138947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b420f660-7d6b-4825-80a9-75f4fe47218c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:17.139723 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b420f660-7d6b-4825-80a9-75f4fe47218c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:17.140164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b420f660-7d6b-4825-80a9-75f4fe47218c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:17.272859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b420f660-7d6b-4825-80a9-75f4fe47218c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:17.280928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b420f660-7d6b-4825-80a9-75f4fe47218c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153709 Aug 01 15:45:17.281499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 827/1684] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:17 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:17.286185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6b277ae6-164d-455f-bcc8-720b37fa110b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:17.288297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6b277ae6-164d-455f-bcc8-720b37fa110b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:17.294614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b277ae6-164d-455f-bcc8-720b37fa110b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:17.295072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b277ae6-164d-455f-bcc8-720b37fa110b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:17.295838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b277ae6-164d-455f-bcc8-720b37fa110b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:17.296278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b277ae6-164d-455f-bcc8-720b37fa110b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:17.324790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6b277ae6-164d-455f-bcc8-720b37fa110b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042243 Aug 01 15:45:17.325344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 828/1685] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:17.443171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3e9a82fa-9bff-4555-b32a-5e82cab56f1c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:17.443683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3e9a82fa-9bff-4555-b32a-5e82cab56f1c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:17.449679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e9a82fa-9bff-4555-b32a-5e82cab56f1c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:17.450155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e9a82fa-9bff-4555-b32a-5e82cab56f1c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:17.450905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e9a82fa-9bff-4555-b32a-5e82cab56f1c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:17.451332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e9a82fa-9bff-4555-b32a-5e82cab56f1c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:17.583141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3e9a82fa-9bff-4555-b32a-5e82cab56f1c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:17.592278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3e9a82fa-9bff-4555-b32a-5e82cab56f1c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.152901 Aug 01 15:45:17.592856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 829/1686] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:17 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:18.303028 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-de52a59b-27a3-4dc8-9a92-c0695e4c12f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:18.303678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-de52a59b-27a3-4dc8-9a92-c0695e4c12f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:18.310678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-de52a59b-27a3-4dc8-9a92-c0695e4c12f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:18.311129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-de52a59b-27a3-4dc8-9a92-c0695e4c12f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:18.311897 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-de52a59b-27a3-4dc8-9a92-c0695e4c12f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:18.312339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-de52a59b-27a3-4dc8-9a92-c0695e4c12f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:18.443239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-de52a59b-27a3-4dc8-9a92-c0695e4c12f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:18.450875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-de52a59b-27a3-4dc8-9a92-c0695e4c12f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151791 Aug 01 15:45:18.451437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 830/1687] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:18 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:18.455974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cf022069-bd25-410d-84e5-56c25a6532e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:18.458340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cf022069-bd25-410d-84e5-56c25a6532e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:18.464117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf022069-bd25-410d-84e5-56c25a6532e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:18.464572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf022069-bd25-410d-84e5-56c25a6532e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:18.465340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf022069-bd25-410d-84e5-56c25a6532e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:18.465783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf022069-bd25-410d-84e5-56c25a6532e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:18.495118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cf022069-bd25-410d-84e5-56c25a6532e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042656 Aug 01 15:45:18.495677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 831/1688] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:18.613777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b633b82f-70be-491e-9414-c99099b4095c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:18.614335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b633b82f-70be-491e-9414-c99099b4095c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:18.620404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b633b82f-70be-491e-9414-c99099b4095c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:18.620855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b633b82f-70be-491e-9414-c99099b4095c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:18.621624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b633b82f-70be-491e-9414-c99099b4095c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:18.622725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b633b82f-70be-491e-9414-c99099b4095c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:18.753718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b633b82f-70be-491e-9414-c99099b4095c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:18.761910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b633b82f-70be-491e-9414-c99099b4095c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.152066 Aug 01 15:45:18.762481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 832/1689] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:18 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:18.971032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-05771ee0-34f7-4625-aefe-02bf261c886c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:18.973251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-05771ee0-34f7-4625-aefe-02bf261c886c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:18.979235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05771ee0-34f7-4625-aefe-02bf261c886c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:18.980231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05771ee0-34f7-4625-aefe-02bf261c886c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:18.980539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05771ee0-34f7-4625-aefe-02bf261c886c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:18.980974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05771ee0-34f7-4625-aefe-02bf261c886c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:19.003928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-b2cb9b78-c33c-4dc3-b328-ae077d10c16a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lazy-loading 'services' on Instance uuid 93144385-4cac-4970-9814-564a351af373 {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:45:19.011528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-05771ee0-34f7-4625-aefe-02bf261c886c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044620 Aug 01 15:45:19.012105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 833/1690] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:18 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:19.472527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dcc235dc-95ef-4189-8318-03134f635bee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:19.473199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dcc235dc-95ef-4189-8318-03134f635bee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:19.479702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcc235dc-95ef-4189-8318-03134f635bee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:19.480151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcc235dc-95ef-4189-8318-03134f635bee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:19.480907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcc235dc-95ef-4189-8318-03134f635bee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:19.481395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcc235dc-95ef-4189-8318-03134f635bee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:19.612157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dcc235dc-95ef-4189-8318-03134f635bee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:19.619632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dcc235dc-95ef-4189-8318-03134f635bee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151286 Aug 01 15:45:19.620201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 834/1691] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:19 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:19.625373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-54d24024-801f-42c3-afa8-6b9cb5d72377 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:19.627532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-54d24024-801f-42c3-afa8-6b9cb5d72377 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:19.633448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54d24024-801f-42c3-afa8-6b9cb5d72377 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:19.633918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54d24024-801f-42c3-afa8-6b9cb5d72377 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:19.634688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54d24024-801f-42c3-afa8-6b9cb5d72377 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:19.635159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54d24024-801f-42c3-afa8-6b9cb5d72377 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:19.665489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-54d24024-801f-42c3-afa8-6b9cb5d72377 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044255 Aug 01 15:45:19.666068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 835/1692] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:19.783283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-495d39c4-723f-4ea2-b1a5-17c224342149 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:19.783810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-495d39c4-723f-4ea2-b1a5-17c224342149 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:19.790212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-495d39c4-723f-4ea2-b1a5-17c224342149 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:19.790670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-495d39c4-723f-4ea2-b1a5-17c224342149 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:19.791445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-495d39c4-723f-4ea2-b1a5-17c224342149 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:19.791878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-495d39c4-723f-4ea2-b1a5-17c224342149 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:19.926824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-495d39c4-723f-4ea2-b1a5-17c224342149 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:19.935394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-495d39c4-723f-4ea2-b1a5-17c224342149 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.155503 Aug 01 15:45:19.935963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 836/1693] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:19 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:20.024157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0368feda-ea17-4c05-8ce6-54ac82093df9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:20.026386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0368feda-ea17-4c05-8ce6-54ac82093df9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:20.032384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0368feda-ea17-4c05-8ce6-54ac82093df9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:20.032828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0368feda-ea17-4c05-8ce6-54ac82093df9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:20.033645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0368feda-ea17-4c05-8ce6-54ac82093df9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:20.034046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0368feda-ea17-4c05-8ce6-54ac82093df9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:20.064409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0368feda-ea17-4c05-8ce6-54ac82093df9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Aug 01 15:45:20.064974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 837/1694] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:20 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:45:20.641933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-060a7e4f-98f7-40c0-825e-b745d0973e31 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:20.642706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-060a7e4f-98f7-40c0-825e-b745d0973e31 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:20.649287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-060a7e4f-98f7-40c0-825e-b745d0973e31 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:20.649736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-060a7e4f-98f7-40c0-825e-b745d0973e31 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:20.650554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-060a7e4f-98f7-40c0-825e-b745d0973e31 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:20.650986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-060a7e4f-98f7-40c0-825e-b745d0973e31 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:20.786898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-060a7e4f-98f7-40c0-825e-b745d0973e31 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:20.796298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-060a7e4f-98f7-40c0-825e-b745d0973e31 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.158201 Aug 01 15:45:20.796895 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 838/1695] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:20 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:20.801999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4d5d9cad-254b-45c6-afb8-09f69ce5fdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:20.804239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4d5d9cad-254b-45c6-afb8-09f69ce5fdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:20.811561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d5d9cad-254b-45c6-afb8-09f69ce5fdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:20.812012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d5d9cad-254b-45c6-afb8-09f69ce5fdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:20.812800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d5d9cad-254b-45c6-afb8-09f69ce5fdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:20.813233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d5d9cad-254b-45c6-afb8-09f69ce5fdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:20.816015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:20.849341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4d5d9cad-254b-45c6-afb8-09f69ce5fdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051304 Aug 01 15:45:20.849952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 839/1696] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:20.956994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6eb77551-7ea7-4c0e-868c-72a124f8b02d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:20.957511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6eb77551-7ea7-4c0e-868c-72a124f8b02d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:20.963641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6eb77551-7ea7-4c0e-868c-72a124f8b02d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:20.964084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6eb77551-7ea7-4c0e-868c-72a124f8b02d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:20.964841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6eb77551-7ea7-4c0e-868c-72a124f8b02d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:20.965268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6eb77551-7ea7-4c0e-868c-72a124f8b02d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:21.097381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6eb77551-7ea7-4c0e-868c-72a124f8b02d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:21.105306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6eb77551-7ea7-4c0e-868c-72a124f8b02d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.152278 Aug 01 15:45:21.105863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 840/1697] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:20 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:21.111200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a2cc958b-0328-468a-bdce-fb2692a223b2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:21.113325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a2cc958b-0328-468a-bdce-fb2692a223b2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:21.119104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2cc958b-0328-468a-bdce-fb2692a223b2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:21.119545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2cc958b-0328-468a-bdce-fb2692a223b2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:21.120299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2cc958b-0328-468a-bdce-fb2692a223b2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:21.120728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2cc958b-0328-468a-bdce-fb2692a223b2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:21.149296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a2cc958b-0328-468a-bdce-fb2692a223b2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041722 Aug 01 15:45:21.149845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 841/1698] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:21 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:21.819125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2ee2a753-eca2-40f1-aa13-65943a348e96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:21.819804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2ee2a753-eca2-40f1-aa13-65943a348e96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:21.827350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ee2a753-eca2-40f1-aa13-65943a348e96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:21.827873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ee2a753-eca2-40f1-aa13-65943a348e96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:21.829880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ee2a753-eca2-40f1-aa13-65943a348e96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:21.830359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ee2a753-eca2-40f1-aa13-65943a348e96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:21.984771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2ee2a753-eca2-40f1-aa13-65943a348e96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:21.994797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2ee2a753-eca2-40f1-aa13-65943a348e96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.179562 Aug 01 15:45:21.995385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 842/1699] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:21 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:22.000923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2f301d2f-cb29-45ac-ac7c-22c73a90a2d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:22.003310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2f301d2f-cb29-45ac-ac7c-22c73a90a2d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:22.009527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f301d2f-cb29-45ac-ac7c-22c73a90a2d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:22.010007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f301d2f-cb29-45ac-ac7c-22c73a90a2d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:22.010822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f301d2f-cb29-45ac-ac7c-22c73a90a2d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:22.011386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f301d2f-cb29-45ac-ac7c-22c73a90a2d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:22.043563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2f301d2f-cb29-45ac-ac7c-22c73a90a2d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047100 Aug 01 15:45:22.044496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 843/1700] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:22.127857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9b0b0319-ae1d-4a3b-83ca-656878445d57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:22.128469 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9b0b0319-ae1d-4a3b-83ca-656878445d57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:22.134605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b0b0319-ae1d-4a3b-83ca-656878445d57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:22.135052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b0b0319-ae1d-4a3b-83ca-656878445d57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:22.135815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b0b0319-ae1d-4a3b-83ca-656878445d57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:22.136252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b0b0319-ae1d-4a3b-83ca-656878445d57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:22.264897 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9b0b0319-ae1d-4a3b-83ca-656878445d57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:22.272721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9b0b0319-ae1d-4a3b-83ca-656878445d57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.148730 Aug 01 15:45:22.273376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 844/1701] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:22 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:22.277859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a7baa6a2-9328-45ce-9b7b-16b47f158d3e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:22.279995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a7baa6a2-9328-45ce-9b7b-16b47f158d3e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:22.285641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a7baa6a2-9328-45ce-9b7b-16b47f158d3e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:22.286123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a7baa6a2-9328-45ce-9b7b-16b47f158d3e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:22.286882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a7baa6a2-9328-45ce-9b7b-16b47f158d3e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:22.287307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a7baa6a2-9328-45ce-9b7b-16b47f158d3e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:22.316611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a7baa6a2-9328-45ce-9b7b-16b47f158d3e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042232 Aug 01 15:45:22.317157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 845/1702] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:22 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:23.017346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9ec71d5c-a682-4edb-89bb-85d6e83735ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:23.018087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9ec71d5c-a682-4edb-89bb-85d6e83735ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:23.024720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ec71d5c-a682-4edb-89bb-85d6e83735ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:23.025162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ec71d5c-a682-4edb-89bb-85d6e83735ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:23.025942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ec71d5c-a682-4edb-89bb-85d6e83735ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:23.026374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ec71d5c-a682-4edb-89bb-85d6e83735ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:23.161214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9ec71d5c-a682-4edb-89bb-85d6e83735ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:23.168857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9ec71d5c-a682-4edb-89bb-85d6e83735ea tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155516 Aug 01 15:45:23.169416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 846/1703] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:23 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:23.173943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6ed658a7-a5aa-4d1a-ab94-78cf92f4d5be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:23.176058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6ed658a7-a5aa-4d1a-ab94-78cf92f4d5be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:23.181725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ed658a7-a5aa-4d1a-ab94-78cf92f4d5be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:23.182219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ed658a7-a5aa-4d1a-ab94-78cf92f4d5be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:23.182981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ed658a7-a5aa-4d1a-ab94-78cf92f4d5be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:23.183421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ed658a7-a5aa-4d1a-ab94-78cf92f4d5be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:23.213133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6ed658a7-a5aa-4d1a-ab94-78cf92f4d5be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042666 Aug 01 15:45:23.213688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 847/1704] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:23.294046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9458b15c-84b2-4f43-b211-267fee2b7692 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:23.294598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9458b15c-84b2-4f43-b211-267fee2b7692 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:23.300712 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9458b15c-84b2-4f43-b211-267fee2b7692 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:23.301156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9458b15c-84b2-4f43-b211-267fee2b7692 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:23.301936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9458b15c-84b2-4f43-b211-267fee2b7692 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:23.302379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9458b15c-84b2-4f43-b211-267fee2b7692 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:23.429415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9458b15c-84b2-4f43-b211-267fee2b7692 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:23.437860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9458b15c-84b2-4f43-b211-267fee2b7692 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.147784 Aug 01 15:45:23.438472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 848/1705] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:23 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:23.443103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-adc62942-1b18-498d-9b68-db23bb53ed39 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:23.445213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-adc62942-1b18-498d-9b68-db23bb53ed39 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:23.451733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-adc62942-1b18-498d-9b68-db23bb53ed39 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:23.452184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-adc62942-1b18-498d-9b68-db23bb53ed39 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:23.452942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-adc62942-1b18-498d-9b68-db23bb53ed39 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:23.453378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-adc62942-1b18-498d-9b68-db23bb53ed39 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:23.482964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-adc62942-1b18-498d-9b68-db23bb53ed39 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043489 Aug 01 15:45:23.483512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 849/1706] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:23 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:24.190049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-49843168-0f9f-4649-b9f8-6a20771929fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:24.190726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-49843168-0f9f-4649-b9f8-6a20771929fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:24.197332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49843168-0f9f-4649-b9f8-6a20771929fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:24.197785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49843168-0f9f-4649-b9f8-6a20771929fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:24.198579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49843168-0f9f-4649-b9f8-6a20771929fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:24.199015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49843168-0f9f-4649-b9f8-6a20771929fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:24.333782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-49843168-0f9f-4649-b9f8-6a20771929fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:24.342159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-49843168-0f9f-4649-b9f8-6a20771929fb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155937 Aug 01 15:45:24.342734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 850/1707] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:24 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:24.347650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5af910da-98dd-4e68-9802-3286bbb25c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:24.349763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5af910da-98dd-4e68-9802-3286bbb25c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:24.355620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5af910da-98dd-4e68-9802-3286bbb25c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:24.356064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5af910da-98dd-4e68-9802-3286bbb25c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:24.357310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5af910da-98dd-4e68-9802-3286bbb25c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:24.357750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5af910da-98dd-4e68-9802-3286bbb25c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:24.386650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5af910da-98dd-4e68-9802-3286bbb25c9e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042845 Aug 01 15:45:24.387197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 851/1708] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:24.458836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9568bfc7-1e33-4741-9843-01b54d17920f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:24.459438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9568bfc7-1e33-4741-9843-01b54d17920f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:24.465332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9568bfc7-1e33-4741-9843-01b54d17920f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:24.465772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9568bfc7-1e33-4741-9843-01b54d17920f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:24.466561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9568bfc7-1e33-4741-9843-01b54d17920f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:24.466989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9568bfc7-1e33-4741-9843-01b54d17920f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:24.612941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9568bfc7-1e33-4741-9843-01b54d17920f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:24.621669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9568bfc7-1e33-4741-9843-01b54d17920f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.166477 Aug 01 15:45:24.622977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 852/1709] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:24 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:24.627679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-98fff7ee-07d5-41ac-b347-4bbf9d19ff95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:24.629799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-98fff7ee-07d5-41ac-b347-4bbf9d19ff95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:24.635686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98fff7ee-07d5-41ac-b347-4bbf9d19ff95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:24.636129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98fff7ee-07d5-41ac-b347-4bbf9d19ff95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:24.636887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98fff7ee-07d5-41ac-b347-4bbf9d19ff95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:24.637324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98fff7ee-07d5-41ac-b347-4bbf9d19ff95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:24.665683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-98fff7ee-07d5-41ac-b347-4bbf9d19ff95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041612 Aug 01 15:45:24.666253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 853/1710] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:24 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:25.364671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1cdcdcef-a3b2-4852-93ab-4c97c274f40d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:25.365310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1cdcdcef-a3b2-4852-93ab-4c97c274f40d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:25.372569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cdcdcef-a3b2-4852-93ab-4c97c274f40d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:25.373010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cdcdcef-a3b2-4852-93ab-4c97c274f40d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:25.373764 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cdcdcef-a3b2-4852-93ab-4c97c274f40d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:25.374236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cdcdcef-a3b2-4852-93ab-4c97c274f40d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:25.504502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1cdcdcef-a3b2-4852-93ab-4c97c274f40d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:25.511892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1cdcdcef-a3b2-4852-93ab-4c97c274f40d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151160 Aug 01 15:45:25.512451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 854/1711] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:25 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:25.517001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ad85e4c4-52f0-4d51-ad8c-00717f409193 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:25.519201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ad85e4c4-52f0-4d51-ad8c-00717f409193 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:25.524825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad85e4c4-52f0-4d51-ad8c-00717f409193 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:25.525298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad85e4c4-52f0-4d51-ad8c-00717f409193 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:25.526083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad85e4c4-52f0-4d51-ad8c-00717f409193 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:25.526514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad85e4c4-52f0-4d51-ad8c-00717f409193 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:25.552203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:25.561025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ad85e4c4-52f0-4d51-ad8c-00717f409193 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047556 Aug 01 15:45:25.562431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 855/1712] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:25 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:25.644492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-328f2de2-853e-465e-95d8-72fef3c95934 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:25.645022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-328f2de2-853e-465e-95d8-72fef3c95934 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:25.651246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-328f2de2-853e-465e-95d8-72fef3c95934 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:25.651705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-328f2de2-853e-465e-95d8-72fef3c95934 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:25.652480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-328f2de2-853e-465e-95d8-72fef3c95934 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:25.653404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-328f2de2-853e-465e-95d8-72fef3c95934 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:25.785626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-328f2de2-853e-465e-95d8-72fef3c95934 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:25.794811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-328f2de2-853e-465e-95d8-72fef3c95934 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.154291 Aug 01 15:45:25.795488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 856/1713] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:25 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:25.800449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fc0967e0-b54a-4d8c-a567-23a9e04fb945 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:25.802641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fc0967e0-b54a-4d8c-a567-23a9e04fb945 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:25.808731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fc0967e0-b54a-4d8c-a567-23a9e04fb945 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:25.809176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fc0967e0-b54a-4d8c-a567-23a9e04fb945 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:25.809994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fc0967e0-b54a-4d8c-a567-23a9e04fb945 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:25.810431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fc0967e0-b54a-4d8c-a567-23a9e04fb945 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:25.840102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fc0967e0-b54a-4d8c-a567-23a9e04fb945 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 Aug 01 15:45:25.841329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 857/1714] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:25 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:26.533974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d717e82d-d401-4d68-8d9f-c2a050e89825 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:26.534640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d717e82d-d401-4d68-8d9f-c2a050e89825 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:26.541142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d717e82d-d401-4d68-8d9f-c2a050e89825 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:26.541596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d717e82d-d401-4d68-8d9f-c2a050e89825 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:26.542401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d717e82d-d401-4d68-8d9f-c2a050e89825 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:26.542837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d717e82d-d401-4d68-8d9f-c2a050e89825 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:26.676458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d717e82d-d401-4d68-8d9f-c2a050e89825 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:26.684013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d717e82d-d401-4d68-8d9f-c2a050e89825 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154123 Aug 01 15:45:26.684577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 858/1715] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:26 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:26.689074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3ad22b1d-1cec-4ac0-a9d0-275d344262d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:26.691219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3ad22b1d-1cec-4ac0-a9d0-275d344262d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:26.697317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3ad22b1d-1cec-4ac0-a9d0-275d344262d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:26.697769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3ad22b1d-1cec-4ac0-a9d0-275d344262d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:26.698566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3ad22b1d-1cec-4ac0-a9d0-275d344262d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:26.698997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3ad22b1d-1cec-4ac0-a9d0-275d344262d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:26.729770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3ad22b1d-1cec-4ac0-a9d0-275d344262d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044162 Aug 01 15:45:26.730368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 859/1716] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:26.816035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1359c901-3bf8-43e2-9111-f6fedc3606e1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:26.816668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1359c901-3bf8-43e2-9111-f6fedc3606e1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:26.822658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1359c901-3bf8-43e2-9111-f6fedc3606e1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:26.823131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1359c901-3bf8-43e2-9111-f6fedc3606e1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:26.823882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1359c901-3bf8-43e2-9111-f6fedc3606e1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:26.824314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1359c901-3bf8-43e2-9111-f6fedc3606e1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:26.957479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1359c901-3bf8-43e2-9111-f6fedc3606e1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:26.965380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1359c901-3bf8-43e2-9111-f6fedc3606e1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153054 Aug 01 15:45:26.965968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 860/1717] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:26 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:26.970661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7ce60151-6c40-44a5-8648-238e5e6ddc61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:26.972746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7ce60151-6c40-44a5-8648-238e5e6ddc61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:26.978445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ce60151-6c40-44a5-8648-238e5e6ddc61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:26.978884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ce60151-6c40-44a5-8648-238e5e6ddc61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:26.979633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ce60151-6c40-44a5-8648-238e5e6ddc61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:26.980061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ce60151-6c40-44a5-8648-238e5e6ddc61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:27.008690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7ce60151-6c40-44a5-8648-238e5e6ddc61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041720 Aug 01 15:45:27.009229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 861/1718] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:26 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:27.705720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eaa6f759-f55d-4b36-8022-5f900b9653c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:27.706384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eaa6f759-f55d-4b36-8022-5f900b9653c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:27.713136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaa6f759-f55d-4b36-8022-5f900b9653c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:27.713582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaa6f759-f55d-4b36-8022-5f900b9653c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:27.714507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaa6f759-f55d-4b36-8022-5f900b9653c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:27.714944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaa6f759-f55d-4b36-8022-5f900b9653c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:27.848735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eaa6f759-f55d-4b36-8022-5f900b9653c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:27.856426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eaa6f759-f55d-4b36-8022-5f900b9653c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154547 Aug 01 15:45:27.856987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 862/1719] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:27 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:27.861659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b69c1f94-1d41-455d-a63d-4583ccf689c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:27.863939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b69c1f94-1d41-455d-a63d-4583ccf689c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:27.870589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b69c1f94-1d41-455d-a63d-4583ccf689c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:27.871063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b69c1f94-1d41-455d-a63d-4583ccf689c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:27.872351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b69c1f94-1d41-455d-a63d-4583ccf689c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:27.872782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b69c1f94-1d41-455d-a63d-4583ccf689c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:27.902750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b69c1f94-1d41-455d-a63d-4583ccf689c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044610 Aug 01 15:45:27.903244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 863/1720] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:27.986827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9674c4f0-3e0e-430b-96e8-3b70cb7171c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:27.987611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9674c4f0-3e0e-430b-96e8-3b70cb7171c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:27.993736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9674c4f0-3e0e-430b-96e8-3b70cb7171c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:27.994221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9674c4f0-3e0e-430b-96e8-3b70cb7171c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:27.994987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9674c4f0-3e0e-430b-96e8-3b70cb7171c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:27.995434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9674c4f0-3e0e-430b-96e8-3b70cb7171c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:28.128464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9674c4f0-3e0e-430b-96e8-3b70cb7171c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:28.136409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9674c4f0-3e0e-430b-96e8-3b70cb7171c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153519 Aug 01 15:45:28.136978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 864/1721] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:27 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:28.142078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-da774704-d8ff-44b6-a0ae-bec575e1d37d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:28.144226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-da774704-d8ff-44b6-a0ae-bec575e1d37d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:28.150289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da774704-d8ff-44b6-a0ae-bec575e1d37d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:28.150738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da774704-d8ff-44b6-a0ae-bec575e1d37d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:28.151535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da774704-d8ff-44b6-a0ae-bec575e1d37d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:28.151998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da774704-d8ff-44b6-a0ae-bec575e1d37d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:28.181284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-da774704-d8ff-44b6-a0ae-bec575e1d37d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043210 Aug 01 15:45:28.181759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 865/1722] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:28 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:28.880793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9095dd63-bd87-4566-bb94-508f53bca9ee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:28.881494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9095dd63-bd87-4566-bb94-508f53bca9ee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:28.888690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9095dd63-bd87-4566-bb94-508f53bca9ee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:28.889138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9095dd63-bd87-4566-bb94-508f53bca9ee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:28.889936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9095dd63-bd87-4566-bb94-508f53bca9ee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:28.890376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9095dd63-bd87-4566-bb94-508f53bca9ee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:29.016323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=4 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:29.044091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9095dd63-bd87-4566-bb94-508f53bca9ee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:29.051774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9095dd63-bd87-4566-bb94-508f53bca9ee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.174872 Aug 01 15:45:29.052344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 866/1723] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:28 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:29.056928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-06475a0c-6b45-4052-8671-16d39db34dbf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:29.059077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-06475a0c-6b45-4052-8671-16d39db34dbf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:29.060883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:29.066588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06475a0c-6b45-4052-8671-16d39db34dbf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:29.067033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06475a0c-6b45-4052-8671-16d39db34dbf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:29.067797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06475a0c-6b45-4052-8671-16d39db34dbf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:29.068223 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06475a0c-6b45-4052-8671-16d39db34dbf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:29.098213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-06475a0c-6b45-4052-8671-16d39db34dbf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044749 Aug 01 15:45:29.098767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 867/1724] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:29.158735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eac04db5-3492-441f-8539-9f1a8c4febea tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:29.159346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eac04db5-3492-441f-8539-9f1a8c4febea tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:29.165404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eac04db5-3492-441f-8539-9f1a8c4febea tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:29.165857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eac04db5-3492-441f-8539-9f1a8c4febea tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:29.166656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eac04db5-3492-441f-8539-9f1a8c4febea tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:29.167092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eac04db5-3492-441f-8539-9f1a8c4febea tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:29.302095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eac04db5-3492-441f-8539-9f1a8c4febea tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:29.309572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eac04db5-3492-441f-8539-9f1a8c4febea tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.154326 Aug 01 15:45:29.310197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 868/1725] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:29 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:29.314828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-74c26315-020c-470d-b568-75b015e2a57c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:29.316968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-74c26315-020c-470d-b568-75b015e2a57c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:29.323347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-74c26315-020c-470d-b568-75b015e2a57c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:29.323804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-74c26315-020c-470d-b568-75b015e2a57c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:29.324608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-74c26315-020c-470d-b568-75b015e2a57c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:29.325593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-74c26315-020c-470d-b568-75b015e2a57c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:29.366131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-74c26315-020c-470d-b568-75b015e2a57c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054828 Aug 01 15:45:29.366701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 869/1726] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:29 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:30.072565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-58c83ab2-edf5-406f-86a8-b16da76f8dca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:30.073210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-58c83ab2-edf5-406f-86a8-b16da76f8dca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:30.079921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58c83ab2-edf5-406f-86a8-b16da76f8dca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:30.080372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58c83ab2-edf5-406f-86a8-b16da76f8dca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:30.081145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58c83ab2-edf5-406f-86a8-b16da76f8dca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:30.081580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58c83ab2-edf5-406f-86a8-b16da76f8dca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:30.216498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-58c83ab2-edf5-406f-86a8-b16da76f8dca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:30.224702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-58c83ab2-edf5-406f-86a8-b16da76f8dca tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155969 Aug 01 15:45:30.225478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 870/1727] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:30 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:30.230610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6073e0ac-e5b6-40d7-b399-e556440fd216 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:30.233257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6073e0ac-e5b6-40d7-b399-e556440fd216 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:30.239298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6073e0ac-e5b6-40d7-b399-e556440fd216 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:30.239742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6073e0ac-e5b6-40d7-b399-e556440fd216 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:30.240508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6073e0ac-e5b6-40d7-b399-e556440fd216 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:30.240973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6073e0ac-e5b6-40d7-b399-e556440fd216 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:30.270561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6073e0ac-e5b6-40d7-b399-e556440fd216 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043714 Aug 01 15:45:30.271112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 871/1728] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:30.330735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-439c8caa-01f3-4e2c-aee2-34ae4e2c5673 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:30.331299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-439c8caa-01f3-4e2c-aee2-34ae4e2c5673 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:30.337429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-439c8caa-01f3-4e2c-aee2-34ae4e2c5673 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:30.337917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-439c8caa-01f3-4e2c-aee2-34ae4e2c5673 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:30.338683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-439c8caa-01f3-4e2c-aee2-34ae4e2c5673 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:30.339124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-439c8caa-01f3-4e2c-aee2-34ae4e2c5673 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:30.354758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:30.467075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-439c8caa-01f3-4e2c-aee2-34ae4e2c5673 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:30.475325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-439c8caa-01f3-4e2c-aee2-34ae4e2c5673 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.148499 Aug 01 15:45:30.475893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 872/1729] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:30 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:30.480563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-42506ceb-e2f8-425c-bd62-7a241cf29841 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:30.482715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-42506ceb-e2f8-425c-bd62-7a241cf29841 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:30.488841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42506ceb-e2f8-425c-bd62-7a241cf29841 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:30.489323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42506ceb-e2f8-425c-bd62-7a241cf29841 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:30.490142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42506ceb-e2f8-425c-bd62-7a241cf29841 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:30.490586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42506ceb-e2f8-425c-bd62-7a241cf29841 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:30.520849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-42506ceb-e2f8-425c-bd62-7a241cf29841 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Aug 01 15:45:30.521419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 873/1730] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:30 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:31.247467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-033ac3fa-707d-421f-9a4d-f35e46d60944 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:31.248162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-033ac3fa-707d-421f-9a4d-f35e46d60944 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:31.254856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-033ac3fa-707d-421f-9a4d-f35e46d60944 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:31.255304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-033ac3fa-707d-421f-9a4d-f35e46d60944 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:31.256071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-033ac3fa-707d-421f-9a4d-f35e46d60944 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:31.256503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-033ac3fa-707d-421f-9a4d-f35e46d60944 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:31.386990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-033ac3fa-707d-421f-9a4d-f35e46d60944 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:31.394810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-033ac3fa-707d-421f-9a4d-f35e46d60944 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151820 Aug 01 15:45:31.395372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 874/1731] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:31 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:31.399898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e9f3284b-27e0-4b77-a9ce-660e600fc540 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:31.402200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e9f3284b-27e0-4b77-a9ce-660e600fc540 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:31.407966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e9f3284b-27e0-4b77-a9ce-660e600fc540 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:31.408404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e9f3284b-27e0-4b77-a9ce-660e600fc540 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:31.409162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e9f3284b-27e0-4b77-a9ce-660e600fc540 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:31.409591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e9f3284b-27e0-4b77-a9ce-660e600fc540 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:31.439240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e9f3284b-27e0-4b77-a9ce-660e600fc540 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042812 Aug 01 15:45:31.439731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 875/1732] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:31.496226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-99ffacb9-3b90-4b91-a238-8af420ec4768 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:31.496822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-99ffacb9-3b90-4b91-a238-8af420ec4768 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:31.502638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99ffacb9-3b90-4b91-a238-8af420ec4768 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:31.503085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99ffacb9-3b90-4b91-a238-8af420ec4768 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:31.503834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99ffacb9-3b90-4b91-a238-8af420ec4768 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:31.504266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99ffacb9-3b90-4b91-a238-8af420ec4768 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:31.635038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-99ffacb9-3b90-4b91-a238-8af420ec4768 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:31.642965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-99ffacb9-3b90-4b91-a238-8af420ec4768 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.150362 Aug 01 15:45:31.643535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 876/1733] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:31 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:31.648166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-68e37476-94cf-4a58-beae-c0a2f5ea30d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:31.650337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-68e37476-94cf-4a58-beae-c0a2f5ea30d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:31.657695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68e37476-94cf-4a58-beae-c0a2f5ea30d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:31.658189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68e37476-94cf-4a58-beae-c0a2f5ea30d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:31.658974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68e37476-94cf-4a58-beae-c0a2f5ea30d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:31.659405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-68e37476-94cf-4a58-beae-c0a2f5ea30d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:31.688984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-68e37476-94cf-4a58-beae-c0a2f5ea30d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044438 Aug 01 15:45:31.689544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 877/1734] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:31 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:32.415806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7ba57048-8c87-4159-86a9-798949dfc6b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:32.416455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7ba57048-8c87-4159-86a9-798949dfc6b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:32.423204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ba57048-8c87-4159-86a9-798949dfc6b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:32.423648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ba57048-8c87-4159-86a9-798949dfc6b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:32.424406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ba57048-8c87-4159-86a9-798949dfc6b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:32.424840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ba57048-8c87-4159-86a9-798949dfc6b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:32.556725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7ba57048-8c87-4159-86a9-798949dfc6b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:32.564688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7ba57048-8c87-4159-86a9-798949dfc6b9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.152784 Aug 01 15:45:32.565256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 878/1735] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:32 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:32.569772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c06422bd-0a80-41eb-98f5-4142953130cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:32.571904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c06422bd-0a80-41eb-98f5-4142953130cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:32.578173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c06422bd-0a80-41eb-98f5-4142953130cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:32.578611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c06422bd-0a80-41eb-98f5-4142953130cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:32.579369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c06422bd-0a80-41eb-98f5-4142953130cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:32.579797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c06422bd-0a80-41eb-98f5-4142953130cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:32.608968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c06422bd-0a80-41eb-98f5-4142953130cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042701 Aug 01 15:45:32.609516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 879/1736] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:32.664444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-788dad80-7ab3-42dd-89ba-bb3990277bb5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:32.665044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-788dad80-7ab3-42dd-89ba-bb3990277bb5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:32.671676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-788dad80-7ab3-42dd-89ba-bb3990277bb5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:32.672090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-788dad80-7ab3-42dd-89ba-bb3990277bb5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:32.672865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-788dad80-7ab3-42dd-89ba-bb3990277bb5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:32.673281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-788dad80-7ab3-42dd-89ba-bb3990277bb5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:32.803765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-788dad80-7ab3-42dd-89ba-bb3990277bb5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:32.812356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-788dad80-7ab3-42dd-89ba-bb3990277bb5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.151659 Aug 01 15:45:32.812949 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 880/1737] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:32 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:32.817562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-435377db-b34a-459d-a335-23906f309579 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:32.819798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-435377db-b34a-459d-a335-23906f309579 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:32.825699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-435377db-b34a-459d-a335-23906f309579 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:32.826196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-435377db-b34a-459d-a335-23906f309579 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:32.826967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-435377db-b34a-459d-a335-23906f309579 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:32.827399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-435377db-b34a-459d-a335-23906f309579 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:32.857013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-435377db-b34a-459d-a335-23906f309579 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043038 Aug 01 15:45:32.857565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 881/1738] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:32 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:33.588069 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aa29f095-a673-49a5-9a99-0bb602c47eb9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:33.588745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aa29f095-a673-49a5-9a99-0bb602c47eb9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:33.596425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa29f095-a673-49a5-9a99-0bb602c47eb9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:33.596984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa29f095-a673-49a5-9a99-0bb602c47eb9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:33.597762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa29f095-a673-49a5-9a99-0bb602c47eb9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:33.598228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa29f095-a673-49a5-9a99-0bb602c47eb9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:33.753105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aa29f095-a673-49a5-9a99-0bb602c47eb9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:33.761061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aa29f095-a673-49a5-9a99-0bb602c47eb9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.178178 Aug 01 15:45:33.761640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 882/1739] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:33 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:33.766372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9336964b-e27f-4859-a046-b0de4b08afc9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:33.768503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9336964b-e27f-4859-a046-b0de4b08afc9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:33.774548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9336964b-e27f-4859-a046-b0de4b08afc9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:33.774999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9336964b-e27f-4859-a046-b0de4b08afc9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:33.775767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9336964b-e27f-4859-a046-b0de4b08afc9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:33.776206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9336964b-e27f-4859-a046-b0de4b08afc9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:33.807947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9336964b-e27f-4859-a046-b0de4b08afc9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045226 Aug 01 15:45:33.808512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 883/1740] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:33.833766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9cf488c4-5b70-4b98-94c6-3fc51fd41b3f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:33.834427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9cf488c4-5b70-4b98-94c6-3fc51fd41b3f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:33.841251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9cf488c4-5b70-4b98-94c6-3fc51fd41b3f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:33.841852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9cf488c4-5b70-4b98-94c6-3fc51fd41b3f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:33.843194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9cf488c4-5b70-4b98-94c6-3fc51fd41b3f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:33.843903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9cf488c4-5b70-4b98-94c6-3fc51fd41b3f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:33.983393 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9cf488c4-5b70-4b98-94c6-3fc51fd41b3f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:33.991554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9cf488c4-5b70-4b98-94c6-3fc51fd41b3f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.161585 Aug 01 15:45:33.992148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 884/1741] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:33 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:33.996741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c4cf0557-a4fe-4405-a9e3-388e25562e84 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:33.998917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c4cf0557-a4fe-4405-a9e3-388e25562e84 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:34.005156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4cf0557-a4fe-4405-a9e3-388e25562e84 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:34.005612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4cf0557-a4fe-4405-a9e3-388e25562e84 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:34.006418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4cf0557-a4fe-4405-a9e3-388e25562e84 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:34.006857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4cf0557-a4fe-4405-a9e3-388e25562e84 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:34.036925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c4cf0557-a4fe-4405-a9e3-388e25562e84 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043726 Aug 01 15:45:34.037515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 885/1742] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:33 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:34.782798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1ccd3fc9-9d82-4b9a-bbee-5ae4d50badc9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:34.783494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1ccd3fc9-9d82-4b9a-bbee-5ae4d50badc9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:34.790014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ccd3fc9-9d82-4b9a-bbee-5ae4d50badc9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:34.790463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ccd3fc9-9d82-4b9a-bbee-5ae4d50badc9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:34.791225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ccd3fc9-9d82-4b9a-bbee-5ae4d50badc9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:34.791660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ccd3fc9-9d82-4b9a-bbee-5ae4d50badc9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:34.922790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1ccd3fc9-9d82-4b9a-bbee-5ae4d50badc9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:34.930374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1ccd3fc9-9d82-4b9a-bbee-5ae4d50badc9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151402 Aug 01 15:45:34.930947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 886/1743] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:34 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:34.936134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bd15e8be-6051-4897-9d2e-8bff354d98b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:34.938300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bd15e8be-6051-4897-9d2e-8bff354d98b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:34.944207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd15e8be-6051-4897-9d2e-8bff354d98b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:34.944660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd15e8be-6051-4897-9d2e-8bff354d98b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:34.945428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd15e8be-6051-4897-9d2e-8bff354d98b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:34.945860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd15e8be-6051-4897-9d2e-8bff354d98b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:34.974525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bd15e8be-6051-4897-9d2e-8bff354d98b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042550 Aug 01 15:45:34.975079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 887/1744] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:35.013754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d286c880-a16e-4f80-9743-89faa3071db9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:35.014384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d286c880-a16e-4f80-9743-89faa3071db9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:35.020562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d286c880-a16e-4f80-9743-89faa3071db9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:35.021016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d286c880-a16e-4f80-9743-89faa3071db9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:35.021782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d286c880-a16e-4f80-9743-89faa3071db9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:35.022256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d286c880-a16e-4f80-9743-89faa3071db9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:35.166018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d286c880-a16e-4f80-9743-89faa3071db9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:35.174554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d286c880-a16e-4f80-9743-89faa3071db9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.164479 Aug 01 15:45:35.175130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 888/1745] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:35 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:35.179779 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bb2dff72-ed26-40b5-82e4-3ada10e7afa8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:35.181928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bb2dff72-ed26-40b5-82e4-3ada10e7afa8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:35.188418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb2dff72-ed26-40b5-82e4-3ada10e7afa8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:35.188872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb2dff72-ed26-40b5-82e4-3ada10e7afa8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:35.189642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb2dff72-ed26-40b5-82e4-3ada10e7afa8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:35.190111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb2dff72-ed26-40b5-82e4-3ada10e7afa8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:35.193738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:35.220089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bb2dff72-ed26-40b5-82e4-3ada10e7afa8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043878 Aug 01 15:45:35.220685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 889/1746] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:35 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:35.953323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b39f1542-a528-4db1-8a31-8e966d88e793 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:35.954075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b39f1542-a528-4db1-8a31-8e966d88e793 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:35.961157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b39f1542-a528-4db1-8a31-8e966d88e793 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:35.961610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b39f1542-a528-4db1-8a31-8e966d88e793 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:35.962406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b39f1542-a528-4db1-8a31-8e966d88e793 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:35.962846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b39f1542-a528-4db1-8a31-8e966d88e793 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:36.098431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b39f1542-a528-4db1-8a31-8e966d88e793 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:36.106097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b39f1542-a528-4db1-8a31-8e966d88e793 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.157249 Aug 01 15:45:36.106665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 890/1747] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:35 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:36.111241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4e0397c7-05c0-412d-bb35-2a1076fb0d43 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:36.113376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4e0397c7-05c0-412d-bb35-2a1076fb0d43 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:36.119310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e0397c7-05c0-412d-bb35-2a1076fb0d43 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:36.119766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e0397c7-05c0-412d-bb35-2a1076fb0d43 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:36.120538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e0397c7-05c0-412d-bb35-2a1076fb0d43 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:36.120974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e0397c7-05c0-412d-bb35-2a1076fb0d43 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:36.150682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4e0397c7-05c0-412d-bb35-2a1076fb0d43 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042894 Aug 01 15:45:36.151138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 891/1748] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:36.196196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-14bcd922-c3b9-46ad-bb2b-5a89fa62421d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:36.196850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-14bcd922-c3b9-46ad-bb2b-5a89fa62421d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:36.203447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14bcd922-c3b9-46ad-bb2b-5a89fa62421d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:36.203899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14bcd922-c3b9-46ad-bb2b-5a89fa62421d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:36.204669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14bcd922-c3b9-46ad-bb2b-5a89fa62421d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:36.205114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14bcd922-c3b9-46ad-bb2b-5a89fa62421d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:36.332012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-14bcd922-c3b9-46ad-bb2b-5a89fa62421d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:36.340013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-14bcd922-c3b9-46ad-bb2b-5a89fa62421d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.147516 Aug 01 15:45:36.340606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 892/1749] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:36 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:36.345310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c0e1fc96-c542-4e5d-a13f-ab84cb949013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:36.347440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c0e1fc96-c542-4e5d-a13f-ab84cb949013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:36.356645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c0e1fc96-c542-4e5d-a13f-ab84cb949013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:36.356645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c0e1fc96-c542-4e5d-a13f-ab84cb949013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:36.356645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c0e1fc96-c542-4e5d-a13f-ab84cb949013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:36.356645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c0e1fc96-c542-4e5d-a13f-ab84cb949013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:36.385280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c0e1fc96-c542-4e5d-a13f-ab84cb949013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Aug 01 15:45:36.388820 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 893/1750] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:36 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:37.127458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5454b41b-ceee-4b01-94f0-bd8de6b02c04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:37.128129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5454b41b-ceee-4b01-94f0-bd8de6b02c04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:37.134846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5454b41b-ceee-4b01-94f0-bd8de6b02c04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:37.135291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5454b41b-ceee-4b01-94f0-bd8de6b02c04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:37.136065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5454b41b-ceee-4b01-94f0-bd8de6b02c04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:37.136504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5454b41b-ceee-4b01-94f0-bd8de6b02c04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:37.270569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5454b41b-ceee-4b01-94f0-bd8de6b02c04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:37.279657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5454b41b-ceee-4b01-94f0-bd8de6b02c04 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156085 Aug 01 15:45:37.280242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 894/1751] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:37 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:37.284990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ece9705d-ae6f-4ed9-8a41-97a6f3dca2e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:37.287152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ece9705d-ae6f-4ed9-8a41-97a6f3dca2e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:37.294050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ece9705d-ae6f-4ed9-8a41-97a6f3dca2e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:37.294661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ece9705d-ae6f-4ed9-8a41-97a6f3dca2e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:37.295686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ece9705d-ae6f-4ed9-8a41-97a6f3dca2e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:37.295875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ece9705d-ae6f-4ed9-8a41-97a6f3dca2e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:37.327088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ece9705d-ae6f-4ed9-8a41-97a6f3dca2e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045693 Aug 01 15:45:37.327560 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 895/1752] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:37.361389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c9e92f27-72ed-45a8-9021-a3089699e8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:37.362031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c9e92f27-72ed-45a8-9021-a3089699e8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:37.368112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9e92f27-72ed-45a8-9021-a3089699e8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:37.368646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9e92f27-72ed-45a8-9021-a3089699e8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:37.369418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9e92f27-72ed-45a8-9021-a3089699e8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:37.369849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9e92f27-72ed-45a8-9021-a3089699e8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:37.500954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c9e92f27-72ed-45a8-9021-a3089699e8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:37.511874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c9e92f27-72ed-45a8-9021-a3089699e8d8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.154395 Aug 01 15:45:37.513218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 896/1753] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:37 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:45:37.517914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6da7d678-9e8f-4581-bc97-ada53467f39c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:37.520072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6da7d678-9e8f-4581-bc97-ada53467f39c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:37.526042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6da7d678-9e8f-4581-bc97-ada53467f39c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:37.526501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6da7d678-9e8f-4581-bc97-ada53467f39c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:37.527273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6da7d678-9e8f-4581-bc97-ada53467f39c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:37.527708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6da7d678-9e8f-4581-bc97-ada53467f39c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:37.556581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6da7d678-9e8f-4581-bc97-ada53467f39c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042323 Aug 01 15:45:37.557133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 897/1754] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:37 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:38.301571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9551d7b1-ab22-481e-96d7-3f47105b7bfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:38.302294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9551d7b1-ab22-481e-96d7-3f47105b7bfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:38.310383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9551d7b1-ab22-481e-96d7-3f47105b7bfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:38.310839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9551d7b1-ab22-481e-96d7-3f47105b7bfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:38.311610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9551d7b1-ab22-481e-96d7-3f47105b7bfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:38.312047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9551d7b1-ab22-481e-96d7-3f47105b7bfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:38.440247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9551d7b1-ab22-481e-96d7-3f47105b7bfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:38.447824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9551d7b1-ab22-481e-96d7-3f47105b7bfc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.150242 Aug 01 15:45:38.448388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 898/1755] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:38 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:38.454747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-76cfea66-2982-4adb-b275-fb74c1f4cf81 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:38.457252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-76cfea66-2982-4adb-b275-fb74c1f4cf81 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:38.464550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76cfea66-2982-4adb-b275-fb74c1f4cf81 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:38.465481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76cfea66-2982-4adb-b275-fb74c1f4cf81 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:38.466354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76cfea66-2982-4adb-b275-fb74c1f4cf81 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:38.466796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76cfea66-2982-4adb-b275-fb74c1f4cf81 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:38.496086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-76cfea66-2982-4adb-b275-fb74c1f4cf81 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046693 Aug 01 15:45:38.496797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 899/1756] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:38.534507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9ae5cbd6-4639-4c6e-b183-3d9216ae6da2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:38.535133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9ae5cbd6-4639-4c6e-b183-3d9216ae6da2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:38.541024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ae5cbd6-4639-4c6e-b183-3d9216ae6da2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:38.541470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ae5cbd6-4639-4c6e-b183-3d9216ae6da2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:38.542261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ae5cbd6-4639-4c6e-b183-3d9216ae6da2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:38.542688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ae5cbd6-4639-4c6e-b183-3d9216ae6da2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:38.678015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9ae5cbd6-4639-4c6e-b183-3d9216ae6da2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:38.686026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9ae5cbd6-4639-4c6e-b183-3d9216ae6da2 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.155092 Aug 01 15:45:38.686591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 900/1757] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:38 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:38.691145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b3830444-beea-43ab-9545-1f17cb397839 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:38.693259 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b3830444-beea-43ab-9545-1f17cb397839 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:38.700028 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b3830444-beea-43ab-9545-1f17cb397839 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:38.700478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b3830444-beea-43ab-9545-1f17cb397839 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:38.701254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b3830444-beea-43ab-9545-1f17cb397839 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:38.701693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b3830444-beea-43ab-9545-1f17cb397839 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:38.731401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b3830444-beea-43ab-9545-1f17cb397839 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043793 Aug 01 15:45:38.731958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 901/1758] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:38 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:39.200091 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:45:39.200690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:45:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf (ip 10.222.0.83) !!! Aug 01 15:45:39.470002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6bfaa94e-486b-41c0-86b0-d465a75caceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:39.470662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6bfaa94e-486b-41c0-86b0-d465a75caceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:39.477195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6bfaa94e-486b-41c0-86b0-d465a75caceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:39.477640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6bfaa94e-486b-41c0-86b0-d465a75caceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:39.478440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6bfaa94e-486b-41c0-86b0-d465a75caceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:39.478878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6bfaa94e-486b-41c0-86b0-d465a75caceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:39.608808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6bfaa94e-486b-41c0-86b0-d465a75caceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:39.620746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6bfaa94e-486b-41c0-86b0-d465a75caceb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155197 Aug 01 15:45:39.621999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 902/1759] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:39 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:39.627088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-65ae8b1f-4248-41c8-9d78-e3c4c522f4a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:39.629234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-65ae8b1f-4248-41c8-9d78-e3c4c522f4a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:39.635248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65ae8b1f-4248-41c8-9d78-e3c4c522f4a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:39.635699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65ae8b1f-4248-41c8-9d78-e3c4c522f4a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:39.636466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65ae8b1f-4248-41c8-9d78-e3c4c522f4a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:39.636961 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65ae8b1f-4248-41c8-9d78-e3c4c522f4a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:39.665572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-65ae8b1f-4248-41c8-9d78-e3c4c522f4a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042506 Aug 01 15:45:39.666162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 903/1760] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:39.706484 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c265ec30-fedc-4686-b17c-51f4930d2d19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:39.707099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c265ec30-fedc-4686-b17c-51f4930d2d19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:39.713193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c265ec30-fedc-4686-b17c-51f4930d2d19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:39.713646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c265ec30-fedc-4686-b17c-51f4930d2d19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:39.714439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c265ec30-fedc-4686-b17c-51f4930d2d19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:39.715448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c265ec30-fedc-4686-b17c-51f4930d2d19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:39.858306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c265ec30-fedc-4686-b17c-51f4930d2d19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:39.866461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c265ec30-fedc-4686-b17c-51f4930d2d19 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.163671 Aug 01 15:45:39.867012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 904/1761] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:39 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:39.871566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-60aef222-33ef-49e0-90ea-b2b3d9246677 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:39.873665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-60aef222-33ef-49e0-90ea-b2b3d9246677 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:39.879413 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60aef222-33ef-49e0-90ea-b2b3d9246677 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:39.879854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60aef222-33ef-49e0-90ea-b2b3d9246677 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:39.880613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60aef222-33ef-49e0-90ea-b2b3d9246677 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:39.881040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60aef222-33ef-49e0-90ea-b2b3d9246677 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:39.905652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:39.912384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-60aef222-33ef-49e0-90ea-b2b3d9246677 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Aug 01 15:45:39.912947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 905/1762] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:39 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:40.643640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-65c3858b-a66a-45d9-8f42-25be095c5c94 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:40.644323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-65c3858b-a66a-45d9-8f42-25be095c5c94 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:40.652758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65c3858b-a66a-45d9-8f42-25be095c5c94 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:40.653212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65c3858b-a66a-45d9-8f42-25be095c5c94 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:40.654030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65c3858b-a66a-45d9-8f42-25be095c5c94 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:40.654472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65c3858b-a66a-45d9-8f42-25be095c5c94 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:40.784115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-65c3858b-a66a-45d9-8f42-25be095c5c94 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:40.791557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-65c3858b-a66a-45d9-8f42-25be095c5c94 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151830 Aug 01 15:45:40.792113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 906/1763] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:40 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:40.796740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b47fc6a1-3eeb-4277-967f-e5bf8f977d55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:40.798893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b47fc6a1-3eeb-4277-967f-e5bf8f977d55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:40.804570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b47fc6a1-3eeb-4277-967f-e5bf8f977d55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:40.805013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b47fc6a1-3eeb-4277-967f-e5bf8f977d55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:40.805762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b47fc6a1-3eeb-4277-967f-e5bf8f977d55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:40.806233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b47fc6a1-3eeb-4277-967f-e5bf8f977d55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:40.837155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b47fc6a1-3eeb-4277-967f-e5bf8f977d55 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043996 Aug 01 15:45:40.837728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 907/1764] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:40.887372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e2705849-bc68-4ce5-939e-b00b69775100 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:40.887981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e2705849-bc68-4ce5-939e-b00b69775100 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:40.894250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e2705849-bc68-4ce5-939e-b00b69775100 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:40.894640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e2705849-bc68-4ce5-939e-b00b69775100 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:40.895397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e2705849-bc68-4ce5-939e-b00b69775100 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:40.895833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e2705849-bc68-4ce5-939e-b00b69775100 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:41.029577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e2705849-bc68-4ce5-939e-b00b69775100 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:41.037513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e2705849-bc68-4ce5-939e-b00b69775100 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153892 Aug 01 15:45:41.038117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 908/1765] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:40 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:41.042700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8018aa77-ebcf-40d1-b528-d077e108b614 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:41.045321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8018aa77-ebcf-40d1-b528-d077e108b614 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:41.051658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8018aa77-ebcf-40d1-b528-d077e108b614 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:41.052098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8018aa77-ebcf-40d1-b528-d077e108b614 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:41.052870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8018aa77-ebcf-40d1-b528-d077e108b614 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:41.053301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8018aa77-ebcf-40d1-b528-d077e108b614 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:41.083617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8018aa77-ebcf-40d1-b528-d077e108b614 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Aug 01 15:45:41.084195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 909/1766] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:41 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:41.813479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ecd5c371-2844-4327-a484-3d828c4606c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:41.815633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ecd5c371-2844-4327-a484-3d828c4606c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:41.822341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecd5c371-2844-4327-a484-3d828c4606c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:41.822796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecd5c371-2844-4327-a484-3d828c4606c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:41.823569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecd5c371-2844-4327-a484-3d828c4606c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:41.824008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecd5c371-2844-4327-a484-3d828c4606c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:41.957597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ecd5c371-2844-4327-a484-3d828c4606c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:41.965205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ecd5c371-2844-4327-a484-3d828c4606c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156391 Aug 01 15:45:41.965767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 910/1767] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:41 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:45:41.970563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-32acb906-39c3-4b1c-9b1f-f6e74719d21a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:41.972683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-32acb906-39c3-4b1c-9b1f-f6e74719d21a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:41.979072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32acb906-39c3-4b1c-9b1f-f6e74719d21a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:41.979538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32acb906-39c3-4b1c-9b1f-f6e74719d21a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:41.980290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32acb906-39c3-4b1c-9b1f-f6e74719d21a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:41.980750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32acb906-39c3-4b1c-9b1f-f6e74719d21a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:42.010362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-32acb906-39c3-4b1c-9b1f-f6e74719d21a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043466 Aug 01 15:45:42.010910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 911/1768] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:42.060230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7812a9d0-4887-442d-98c7-d07ed9426167 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:42.060841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7812a9d0-4887-442d-98c7-d07ed9426167 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:42.067535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7812a9d0-4887-442d-98c7-d07ed9426167 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:42.067982 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7812a9d0-4887-442d-98c7-d07ed9426167 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:42.068755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7812a9d0-4887-442d-98c7-d07ed9426167 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:42.069188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7812a9d0-4887-442d-98c7-d07ed9426167 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:42.198252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7812a9d0-4887-442d-98c7-d07ed9426167 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:42.206957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7812a9d0-4887-442d-98c7-d07ed9426167 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.151328 Aug 01 15:45:42.207527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 912/1769] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:42 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:42.212042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8544095f-68d5-4f45-9777-1c3c7a27b66f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:42.214299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8544095f-68d5-4f45-9777-1c3c7a27b66f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:42.220728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8544095f-68d5-4f45-9777-1c3c7a27b66f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:42.221120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8544095f-68d5-4f45-9777-1c3c7a27b66f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:42.221909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8544095f-68d5-4f45-9777-1c3c7a27b66f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:42.222354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8544095f-68d5-4f45-9777-1c3c7a27b66f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:42.252364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8544095f-68d5-4f45-9777-1c3c7a27b66f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043759 Aug 01 15:45:42.252917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 913/1770] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:42 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:42.987577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bafdc126-2b20-481c-b2b7-5b7b802cf268 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:42.988261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bafdc126-2b20-481c-b2b7-5b7b802cf268 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:42.994951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bafdc126-2b20-481c-b2b7-5b7b802cf268 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:42.995403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bafdc126-2b20-481c-b2b7-5b7b802cf268 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:42.996178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bafdc126-2b20-481c-b2b7-5b7b802cf268 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:42.996627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bafdc126-2b20-481c-b2b7-5b7b802cf268 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:43.130278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bafdc126-2b20-481c-b2b7-5b7b802cf268 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:43.138407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bafdc126-2b20-481c-b2b7-5b7b802cf268 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154856 Aug 01 15:45:43.138977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 914/1771] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:42 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:45:43.143629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5ae5e579-853d-4320-9ce6-4fa5f4bba326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:43.145755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5ae5e579-853d-4320-9ce6-4fa5f4bba326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:43.151769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5ae5e579-853d-4320-9ce6-4fa5f4bba326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:43.152145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5ae5e579-853d-4320-9ce6-4fa5f4bba326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:43.155606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5ae5e579-853d-4320-9ce6-4fa5f4bba326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:43.156063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5ae5e579-853d-4320-9ce6-4fa5f4bba326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:43.187047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5ae5e579-853d-4320-9ce6-4fa5f4bba326 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047049 Aug 01 15:45:43.187616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 915/1772] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:43.228324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c3575e18-8855-4221-8bf3-379cff8e174a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:43.228874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c3575e18-8855-4221-8bf3-379cff8e174a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:43.234860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3575e18-8855-4221-8bf3-379cff8e174a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:43.235303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3575e18-8855-4221-8bf3-379cff8e174a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:43.236059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3575e18-8855-4221-8bf3-379cff8e174a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:43.236515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3575e18-8855-4221-8bf3-379cff8e174a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:43.363610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c3575e18-8855-4221-8bf3-379cff8e174a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:43.371644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c3575e18-8855-4221-8bf3-379cff8e174a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.147057 Aug 01 15:45:43.372270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 916/1773] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:43 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:43.377143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5cc49a06-7d2c-418f-8960-3477127486d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:43.379378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5cc49a06-7d2c-418f-8960-3477127486d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:43.381192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:43.387208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5cc49a06-7d2c-418f-8960-3477127486d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:43.387659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5cc49a06-7d2c-418f-8960-3477127486d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:43.388434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5cc49a06-7d2c-418f-8960-3477127486d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:43.388868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5cc49a06-7d2c-418f-8960-3477127486d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:43.419273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5cc49a06-7d2c-418f-8960-3477127486d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Aug 01 15:45:43.419830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 917/1774] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:43 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:44.160810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c529ea02-37d9-4ee6-b217-b9b4bf0a02a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:44.161453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c529ea02-37d9-4ee6-b217-b9b4bf0a02a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:44.168725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c529ea02-37d9-4ee6-b217-b9b4bf0a02a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:44.169175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c529ea02-37d9-4ee6-b217-b9b4bf0a02a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:44.169978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c529ea02-37d9-4ee6-b217-b9b4bf0a02a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:44.170420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c529ea02-37d9-4ee6-b217-b9b4bf0a02a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:44.304599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c529ea02-37d9-4ee6-b217-b9b4bf0a02a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:44.312086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c529ea02-37d9-4ee6-b217-b9b4bf0a02a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155135 Aug 01 15:45:44.312645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 918/1775] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:44 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:44.317153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c8e18182-d458-4f69-aac4-dd0b935871e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:44.319311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c8e18182-d458-4f69-aac4-dd0b935871e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:44.325029 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c8e18182-d458-4f69-aac4-dd0b935871e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:44.325478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c8e18182-d458-4f69-aac4-dd0b935871e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:44.326288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c8e18182-d458-4f69-aac4-dd0b935871e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:44.326722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c8e18182-d458-4f69-aac4-dd0b935871e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:44.356658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c8e18182-d458-4f69-aac4-dd0b935871e1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043000 Aug 01 15:45:44.357212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 919/1776] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 1 15:45:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:45:44.393423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-54c7a197-ee45-4c46-8ffd-b6d94ec21f0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:44.394099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-54c7a197-ee45-4c46-8ffd-b6d94ec21f0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:44.400270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54c7a197-ee45-4c46-8ffd-b6d94ec21f0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:44.400716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54c7a197-ee45-4c46-8ffd-b6d94ec21f0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:44.401489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54c7a197-ee45-4c46-8ffd-b6d94ec21f0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:44.401953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54c7a197-ee45-4c46-8ffd-b6d94ec21f0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:44.528797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-54c7a197-ee45-4c46-8ffd-b6d94ec21f0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:44.536754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-54c7a197-ee45-4c46-8ffd-b6d94ec21f0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.147121 Aug 01 15:45:44.537314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 920/1777] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:44 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:44.541999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4c291b2a-3a41-4e18-bd31-00fc815af92f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:44.544661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4c291b2a-3a41-4e18-bd31-00fc815af92f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:44.550646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c291b2a-3a41-4e18-bd31-00fc815af92f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:44.551098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c291b2a-3a41-4e18-bd31-00fc815af92f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:44.551875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c291b2a-3a41-4e18-bd31-00fc815af92f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:44.553034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c291b2a-3a41-4e18-bd31-00fc815af92f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:44.588783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4c291b2a-3a41-4e18-bd31-00fc815af92f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050042 Aug 01 15:45:44.589383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 921/1778] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:44 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:45.333222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d2ded698-cbc3-4391-b58d-cda9507b3f43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:45.333912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d2ded698-cbc3-4391-b58d-cda9507b3f43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:45.340350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2ded698-cbc3-4391-b58d-cda9507b3f43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:45.340799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2ded698-cbc3-4391-b58d-cda9507b3f43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:45.341565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2ded698-cbc3-4391-b58d-cda9507b3f43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:45.342034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2ded698-cbc3-4391-b58d-cda9507b3f43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:45.357511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:45.472995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d2ded698-cbc3-4391-b58d-cda9507b3f43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:45.481193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d2ded698-cbc3-4391-b58d-cda9507b3f43 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151332 Aug 01 15:45:45.481770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 922/1779] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:45 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:45.486364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-130eedf7-a823-4e8f-b1b8-b65ab57b55c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:45:45.488518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-130eedf7-a823-4e8f-b1b8-b65ab57b55c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:45.494311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-130eedf7-a823-4e8f-b1b8-b65ab57b55c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:45.494767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-130eedf7-a823-4e8f-b1b8-b65ab57b55c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:45.495532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-130eedf7-a823-4e8f-b1b8-b65ab57b55c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:45.495972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-130eedf7-a823-4e8f-b1b8-b65ab57b55c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:45.569464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-130eedf7-a823-4e8f-b1b8-b65ab57b55c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "POST /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/action" status: 200 len: 37752 microversion: 2.20 time: 0.086407 Aug 01 15:45:45.575956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 923/1780] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 1 15:45:45 2022] POST /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df/action => generated 37752 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:45:45.575956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-faf4d4f6-fe2c-437b-b807-824553d06d6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:45.576280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-faf4d4f6-fe2c-437b-b807-824553d06d6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:45.583574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-faf4d4f6-fe2c-437b-b807-824553d06d6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:45.583953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-faf4d4f6-fe2c-437b-b807-824553d06d6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:45.584723 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-faf4d4f6-fe2c-437b-b807-824553d06d6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:45.585158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-faf4d4f6-fe2c-437b-b807-824553d06d6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:45.730227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-faf4d4f6-fe2c-437b-b807-824553d06d6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:45.739097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-faf4d4f6-fe2c-437b-b807-824553d06d6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.167392 Aug 01 15:45:45.739656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 924/1781] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:45 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:45:45.744182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d2cc793d-7dab-4e51-a487-72fb6f560fe7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:45.746311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d2cc793d-7dab-4e51-a487-72fb6f560fe7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:45.752205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2cc793d-7dab-4e51-a487-72fb6f560fe7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:45.752760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2cc793d-7dab-4e51-a487-72fb6f560fe7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:45.753570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2cc793d-7dab-4e51-a487-72fb6f560fe7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:45.754073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2cc793d-7dab-4e51-a487-72fb6f560fe7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:45.783301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d2cc793d-7dab-4e51-a487-72fb6f560fe7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042614 Aug 01 15:45:45.783841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 925/1782] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:45 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:46.196152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:45:46.196396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:45:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:45:46.502748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a8edc10c-4281-4b57-8af8-5c854ba33371 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:46.503370 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a8edc10c-4281-4b57-8af8-5c854ba33371 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:46.510040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8edc10c-4281-4b57-8af8-5c854ba33371 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:46.510520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8edc10c-4281-4b57-8af8-5c854ba33371 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:46.511264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8edc10c-4281-4b57-8af8-5c854ba33371 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:46.512354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8edc10c-4281-4b57-8af8-5c854ba33371 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:46.640324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a8edc10c-4281-4b57-8af8-5c854ba33371 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:46.647842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a8edc10c-4281-4b57-8af8-5c854ba33371 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.148933 Aug 01 15:45:46.648411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 926/1783] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:46 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:46.760099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-148df1bb-a876-4711-aa41-eb3f977b2a4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:46.760627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-148df1bb-a876-4711-aa41-eb3f977b2a4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:46.767867 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-148df1bb-a876-4711-aa41-eb3f977b2a4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:46.768317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-148df1bb-a876-4711-aa41-eb3f977b2a4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:46.769080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-148df1bb-a876-4711-aa41-eb3f977b2a4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:46.769516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-148df1bb-a876-4711-aa41-eb3f977b2a4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:46.907486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-148df1bb-a876-4711-aa41-eb3f977b2a4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:46.917083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-148df1bb-a876-4711-aa41-eb3f977b2a4e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.160794 Aug 01 15:45:46.917652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 927/1784] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:46 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:46.922885 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a5b8153f-fe60-4349-bc90-a7a9d22976f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:46.924973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a5b8153f-fe60-4349-bc90-a7a9d22976f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:46.930886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a5b8153f-fe60-4349-bc90-a7a9d22976f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:46.931335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a5b8153f-fe60-4349-bc90-a7a9d22976f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:46.932090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a5b8153f-fe60-4349-bc90-a7a9d22976f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:46.932523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a5b8153f-fe60-4349-bc90-a7a9d22976f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:46.961866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a5b8153f-fe60-4349-bc90-a7a9d22976f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042475 Aug 01 15:45:46.962437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 928/1785] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:46 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:47.669043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bb8da534-952f-4c7f-8b4d-edc44740e3f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:47.669719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bb8da534-952f-4c7f-8b4d-edc44740e3f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:47.676515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb8da534-952f-4c7f-8b4d-edc44740e3f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:47.676964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb8da534-952f-4c7f-8b4d-edc44740e3f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:47.677736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb8da534-952f-4c7f-8b4d-edc44740e3f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:47.678204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb8da534-952f-4c7f-8b4d-edc44740e3f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:47.807748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bb8da534-952f-4c7f-8b4d-edc44740e3f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:47.822554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bb8da534-952f-4c7f-8b4d-edc44740e3f1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.157727 Aug 01 15:45:47.823201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 929/1786] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:47 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:47.940119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9d43e8b5-20f6-4402-baa5-241cced3b4fe tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:47.940732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9d43e8b5-20f6-4402-baa5-241cced3b4fe tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:47.946849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9d43e8b5-20f6-4402-baa5-241cced3b4fe tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:47.947301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9d43e8b5-20f6-4402-baa5-241cced3b4fe tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:47.948081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9d43e8b5-20f6-4402-baa5-241cced3b4fe tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:47.948518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9d43e8b5-20f6-4402-baa5-241cced3b4fe tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:48.082227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9d43e8b5-20f6-4402-baa5-241cced3b4fe tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:48.090886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9d43e8b5-20f6-4402-baa5-241cced3b4fe tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.154679 Aug 01 15:45:48.091454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 930/1787] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:47 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:45:48.096344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a061c93e-c802-4f9d-a39c-87c15bf02483 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:48.098460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a061c93e-c802-4f9d-a39c-87c15bf02483 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:48.104156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a061c93e-c802-4f9d-a39c-87c15bf02483 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:48.104607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a061c93e-c802-4f9d-a39c-87c15bf02483 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:48.106011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a061c93e-c802-4f9d-a39c-87c15bf02483 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:48.106451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a061c93e-c802-4f9d-a39c-87c15bf02483 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:48.135033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a061c93e-c802-4f9d-a39c-87c15bf02483 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042547 Aug 01 15:45:48.135595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 931/1788] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:48 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:48.844068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-93d721f7-c593-46b9-917a-a39cea5ef332 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:48.844754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-93d721f7-c593-46b9-917a-a39cea5ef332 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:48.851359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-93d721f7-c593-46b9-917a-a39cea5ef332 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:48.851805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-93d721f7-c593-46b9-917a-a39cea5ef332 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:48.852574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-93d721f7-c593-46b9-917a-a39cea5ef332 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:48.853010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-93d721f7-c593-46b9-917a-a39cea5ef332 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:48.988200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-93d721f7-c593-46b9-917a-a39cea5ef332 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:48.995767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-93d721f7-c593-46b9-917a-a39cea5ef332 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.155787 Aug 01 15:45:48.997216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 932/1789] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:48 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:49.112519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a2c7d3d7-0f09-4c4b-a44e-9cdfde344693 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:49.113052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a2c7d3d7-0f09-4c4b-a44e-9cdfde344693 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:49.119120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2c7d3d7-0f09-4c4b-a44e-9cdfde344693 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:49.119575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2c7d3d7-0f09-4c4b-a44e-9cdfde344693 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:49.120338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2c7d3d7-0f09-4c4b-a44e-9cdfde344693 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:49.120794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2c7d3d7-0f09-4c4b-a44e-9cdfde344693 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:49.247723 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a2c7d3d7-0f09-4c4b-a44e-9cdfde344693 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:49.258843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a2c7d3d7-0f09-4c4b-a44e-9cdfde344693 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.150211 Aug 01 15:45:49.259423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 933/1790] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:49 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:49.264087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-021c8d90-a7be-4724-93e8-6f40c06d3411 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:49.266198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-021c8d90-a7be-4724-93e8-6f40c06d3411 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:49.272068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-021c8d90-a7be-4724-93e8-6f40c06d3411 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:49.272537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-021c8d90-a7be-4724-93e8-6f40c06d3411 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:49.273206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-021c8d90-a7be-4724-93e8-6f40c06d3411 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:49.273649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-021c8d90-a7be-4724-93e8-6f40c06d3411 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:49.302393 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-021c8d90-a7be-4724-93e8-6f40c06d3411 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041880 Aug 01 15:45:49.302954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 934/1791] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:49 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:50.023324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-10bfc57e-2d95-45c5-9368-51e33f30ad6d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:50.023933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-10bfc57e-2d95-45c5-9368-51e33f30ad6d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:50.031279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10bfc57e-2d95-45c5-9368-51e33f30ad6d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:50.031737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10bfc57e-2d95-45c5-9368-51e33f30ad6d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:50.032544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10bfc57e-2d95-45c5-9368-51e33f30ad6d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:50.032981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10bfc57e-2d95-45c5-9368-51e33f30ad6d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:50.167883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-10bfc57e-2d95-45c5-9368-51e33f30ad6d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:50.175427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-10bfc57e-2d95-45c5-9368-51e33f30ad6d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.156012 Aug 01 15:45:50.175992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 935/1792] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:50 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:50.280378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3a63ea5b-be17-4f76-8056-8a368c7b469d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:50.280907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3a63ea5b-be17-4f76-8056-8a368c7b469d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:50.287001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3a63ea5b-be17-4f76-8056-8a368c7b469d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:50.287443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3a63ea5b-be17-4f76-8056-8a368c7b469d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:50.288203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3a63ea5b-be17-4f76-8056-8a368c7b469d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:50.288632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3a63ea5b-be17-4f76-8056-8a368c7b469d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:50.418272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3a63ea5b-be17-4f76-8056-8a368c7b469d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:50.426187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3a63ea5b-be17-4f76-8056-8a368c7b469d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.149694 Aug 01 15:45:50.426756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 936/1793] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:50 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:50.431221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a607ef97-6040-4cb0-b367-e82c21bab4a9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:50.433309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a607ef97-6040-4cb0-b367-e82c21bab4a9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:50.439587 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a607ef97-6040-4cb0-b367-e82c21bab4a9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:50.440035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a607ef97-6040-4cb0-b367-e82c21bab4a9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:50.440797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a607ef97-6040-4cb0-b367-e82c21bab4a9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:50.441230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a607ef97-6040-4cb0-b367-e82c21bab4a9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:50.470914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a607ef97-6040-4cb0-b367-e82c21bab4a9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043155 Aug 01 15:45:50.471456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 937/1794] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:50 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:51.197383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-29e586a7-bc33-486b-a1d5-0e3c0a06bbcb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:51.198080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-29e586a7-bc33-486b-a1d5-0e3c0a06bbcb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:51.204686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29e586a7-bc33-486b-a1d5-0e3c0a06bbcb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:51.205141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29e586a7-bc33-486b-a1d5-0e3c0a06bbcb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:51.205930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29e586a7-bc33-486b-a1d5-0e3c0a06bbcb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:51.206377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29e586a7-bc33-486b-a1d5-0e3c0a06bbcb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:51.339529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-29e586a7-bc33-486b-a1d5-0e3c0a06bbcb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:51.347859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-29e586a7-bc33-486b-a1d5-0e3c0a06bbcb tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.154356 Aug 01 15:45:51.348418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 938/1795] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:51 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:51.447974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-21819179-8355-47b8-b1c2-8943352f09e3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:51.448582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-21819179-8355-47b8-b1c2-8943352f09e3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:51.455062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-21819179-8355-47b8-b1c2-8943352f09e3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:51.455504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-21819179-8355-47b8-b1c2-8943352f09e3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:51.456255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-21819179-8355-47b8-b1c2-8943352f09e3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:51.456686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-21819179-8355-47b8-b1c2-8943352f09e3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:51.472519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:51.585298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-21819179-8355-47b8-b1c2-8943352f09e3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:51.594321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-21819179-8355-47b8-b1c2-8943352f09e3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.150012 Aug 01 15:45:51.594829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 939/1796] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:51 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:51.599362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8fedd261-aa2c-414c-8d7f-135ed7d1fed8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:51.601486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8fedd261-aa2c-414c-8d7f-135ed7d1fed8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:51.607386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fedd261-aa2c-414c-8d7f-135ed7d1fed8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:51.607838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fedd261-aa2c-414c-8d7f-135ed7d1fed8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:51.608634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fedd261-aa2c-414c-8d7f-135ed7d1fed8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:51.609073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fedd261-aa2c-414c-8d7f-135ed7d1fed8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:51.637573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8fedd261-aa2c-414c-8d7f-135ed7d1fed8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041732 Aug 01 15:45:51.638691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 940/1797] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:51 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:52.368799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2775dc12-9294-4464-b78e-f64e7ad06dee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:52.369430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2775dc12-9294-4464-b78e-f64e7ad06dee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:52.376584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2775dc12-9294-4464-b78e-f64e7ad06dee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:52.377034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2775dc12-9294-4464-b78e-f64e7ad06dee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:52.377804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2775dc12-9294-4464-b78e-f64e7ad06dee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:52.378264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2775dc12-9294-4464-b78e-f64e7ad06dee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:52.507343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2775dc12-9294-4464-b78e-f64e7ad06dee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:52.515014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2775dc12-9294-4464-b78e-f64e7ad06dee tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.150279 Aug 01 15:45:52.515832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 941/1798] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:52 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:52.615433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c1451deb-131f-4923-bec9-5a2461664082 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:52.616099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c1451deb-131f-4923-bec9-5a2461664082 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:52.622177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c1451deb-131f-4923-bec9-5a2461664082 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:52.622667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c1451deb-131f-4923-bec9-5a2461664082 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:52.623453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c1451deb-131f-4923-bec9-5a2461664082 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:52.623914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c1451deb-131f-4923-bec9-5a2461664082 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:52.760833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c1451deb-131f-4923-bec9-5a2461664082 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:52.769192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c1451deb-131f-4923-bec9-5a2461664082 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.157555 Aug 01 15:45:52.769778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 942/1799] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:52 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:52.774584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-72f0961a-1d0c-46fd-ab05-429f1f5bf11b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:52.776684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-72f0961a-1d0c-46fd-ab05-429f1f5bf11b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:52.783240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72f0961a-1d0c-46fd-ab05-429f1f5bf11b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:52.783701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72f0961a-1d0c-46fd-ab05-429f1f5bf11b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:52.784480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72f0961a-1d0c-46fd-ab05-429f1f5bf11b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:52.784919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72f0961a-1d0c-46fd-ab05-429f1f5bf11b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:52.815067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-72f0961a-1d0c-46fd-ab05-429f1f5bf11b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044145 Aug 01 15:45:52.815626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 943/1800] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:52 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:53.538597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-89eb7109-1502-4cf4-9fde-ff04d5329673 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:53.539270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-89eb7109-1502-4cf4-9fde-ff04d5329673 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:53.546342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89eb7109-1502-4cf4-9fde-ff04d5329673 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:53.546793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89eb7109-1502-4cf4-9fde-ff04d5329673 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:53.547558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89eb7109-1502-4cf4-9fde-ff04d5329673 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:53.547994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89eb7109-1502-4cf4-9fde-ff04d5329673 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:53.678245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-89eb7109-1502-4cf4-9fde-ff04d5329673 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:53.686609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-89eb7109-1502-4cf4-9fde-ff04d5329673 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151929 Aug 01 15:45:53.687200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 944/1801] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:53 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:53.791849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eaaed6d9-27c4-405c-accb-4e129fa7b2ba tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:53.792388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eaaed6d9-27c4-405c-accb-4e129fa7b2ba tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:53.798902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaaed6d9-27c4-405c-accb-4e129fa7b2ba tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:53.799353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaaed6d9-27c4-405c-accb-4e129fa7b2ba tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:53.800117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaaed6d9-27c4-405c-accb-4e129fa7b2ba tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:53.800549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaaed6d9-27c4-405c-accb-4e129fa7b2ba tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:53.932100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eaaed6d9-27c4-405c-accb-4e129fa7b2ba tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:53.940596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eaaed6d9-27c4-405c-accb-4e129fa7b2ba tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.152701 Aug 01 15:45:53.941684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 945/1802] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:53 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:53.946019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7f9a18dc-7199-4c83-bc7e-dadc48ef9507 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:53.948135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7f9a18dc-7199-4c83-bc7e-dadc48ef9507 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:53.954681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f9a18dc-7199-4c83-bc7e-dadc48ef9507 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:53.955133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f9a18dc-7199-4c83-bc7e-dadc48ef9507 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:53.955903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f9a18dc-7199-4c83-bc7e-dadc48ef9507 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:53.956338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f9a18dc-7199-4c83-bc7e-dadc48ef9507 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:53.985416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7f9a18dc-7199-4c83-bc7e-dadc48ef9507 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043156 Aug 01 15:45:53.985999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 946/1803] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:53 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:54.707897 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-02302a02-3be4-4afd-b904-ec004d9c6e9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:54.708599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-02302a02-3be4-4afd-b904-ec004d9c6e9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:54.715199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02302a02-3be4-4afd-b904-ec004d9c6e9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:54.715644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02302a02-3be4-4afd-b904-ec004d9c6e9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:54.716905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02302a02-3be4-4afd-b904-ec004d9c6e9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:54.717340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02302a02-3be4-4afd-b904-ec004d9c6e9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:54.845464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-02302a02-3be4-4afd-b904-ec004d9c6e9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:54.853012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-02302a02-3be4-4afd-b904-ec004d9c6e9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.148951 Aug 01 15:45:54.853575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 947/1804] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:54 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:54.962829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1c38c50c-bc05-4b24-8546-ae2bf650824b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:54.963419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1c38c50c-bc05-4b24-8546-ae2bf650824b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:54.970227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c38c50c-bc05-4b24-8546-ae2bf650824b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:54.970684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c38c50c-bc05-4b24-8546-ae2bf650824b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:54.971452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c38c50c-bc05-4b24-8546-ae2bf650824b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:54.971892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c38c50c-bc05-4b24-8546-ae2bf650824b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:55.108384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1c38c50c-bc05-4b24-8546-ae2bf650824b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:55.116222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1c38c50c-bc05-4b24-8546-ae2bf650824b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.157335 Aug 01 15:45:55.116784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 948/1805] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:54 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:55.121197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6ea9bb6b-1d87-43ab-a842-8886a13dae7d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:55.123325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6ea9bb6b-1d87-43ab-a842-8886a13dae7d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:55.128977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ea9bb6b-1d87-43ab-a842-8886a13dae7d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:55.129449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ea9bb6b-1d87-43ab-a842-8886a13dae7d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:55.130244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ea9bb6b-1d87-43ab-a842-8886a13dae7d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:55.130660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ea9bb6b-1d87-43ab-a842-8886a13dae7d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:55.160002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6ea9bb6b-1d87-43ab-a842-8886a13dae7d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042212 Aug 01 15:45:55.160558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 949/1806] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:55 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:55.876079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ae0d43f6-2746-48a0-9c63-6b8ffff6fe7d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:55.876692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ae0d43f6-2746-48a0-9c63-6b8ffff6fe7d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:55.882701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae0d43f6-2746-48a0-9c63-6b8ffff6fe7d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:55.883139 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae0d43f6-2746-48a0-9c63-6b8ffff6fe7d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:55.883897 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae0d43f6-2746-48a0-9c63-6b8ffff6fe7d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:55.884323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae0d43f6-2746-48a0-9c63-6b8ffff6fe7d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:56.077399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ae0d43f6-2746-48a0-9c63-6b8ffff6fe7d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:56.084884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ae0d43f6-2746-48a0-9c63-6b8ffff6fe7d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.214031 Aug 01 15:45:56.085450 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 950/1807] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:55 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:56.138212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c4411878-cf0f-4894-b738-95d0cfff3c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:56.138722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c4411878-cf0f-4894-b738-95d0cfff3c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:56.144808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4411878-cf0f-4894-b738-95d0cfff3c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:56.145249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4411878-cf0f-4894-b738-95d0cfff3c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:56.146045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4411878-cf0f-4894-b738-95d0cfff3c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:56.146475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4411878-cf0f-4894-b738-95d0cfff3c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:56.325351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c4411878-cf0f-4894-b738-95d0cfff3c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:56.332979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c4411878-cf0f-4894-b738-95d0cfff3c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.198823 Aug 01 15:45:56.333551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 951/1808] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:56 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:45:56.338238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0be74df0-fd70-4398-9e33-0b7d49cf229c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:56.340343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0be74df0-fd70-4398-9e33-0b7d49cf229c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:56.346908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0be74df0-fd70-4398-9e33-0b7d49cf229c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:56.347360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0be74df0-fd70-4398-9e33-0b7d49cf229c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:56.348131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0be74df0-fd70-4398-9e33-0b7d49cf229c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:56.348569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0be74df0-fd70-4398-9e33-0b7d49cf229c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:56.378209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0be74df0-fd70-4398-9e33-0b7d49cf229c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043555 Aug 01 15:45:56.378778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 952/1809] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:56 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:57.107069 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-585a218e-88f8-464b-98e6-bff15dc684fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:57.107690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-585a218e-88f8-464b-98e6-bff15dc684fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:57.114139 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-585a218e-88f8-464b-98e6-bff15dc684fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:57.114592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-585a218e-88f8-464b-98e6-bff15dc684fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:57.115359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-585a218e-88f8-464b-98e6-bff15dc684fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:57.115793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-585a218e-88f8-464b-98e6-bff15dc684fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:57.246328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-585a218e-88f8-464b-98e6-bff15dc684fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:57.254547 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-585a218e-88f8-464b-98e6-bff15dc684fa tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.151952 Aug 01 15:45:57.255115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 953/1810] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:57 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:57.355036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-882861e1-db6d-43e5-a723-c6b27587d660 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:57.355650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-882861e1-db6d-43e5-a723-c6b27587d660 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:57.362606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-882861e1-db6d-43e5-a723-c6b27587d660 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:57.363036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-882861e1-db6d-43e5-a723-c6b27587d660 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:57.364212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-882861e1-db6d-43e5-a723-c6b27587d660 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:57.364652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-882861e1-db6d-43e5-a723-c6b27587d660 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:57.499538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-882861e1-db6d-43e5-a723-c6b27587d660 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:57.507481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-882861e1-db6d-43e5-a723-c6b27587d660 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.156338 Aug 01 15:45:57.508045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 954/1811] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:57 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:57.512542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7cf6d143-9bc5-44e3-96bd-73c52cd52280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:57.514670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7cf6d143-9bc5-44e3-96bd-73c52cd52280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:57.520452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7cf6d143-9bc5-44e3-96bd-73c52cd52280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:57.520908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7cf6d143-9bc5-44e3-96bd-73c52cd52280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:57.521683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7cf6d143-9bc5-44e3-96bd-73c52cd52280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:57.522146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7cf6d143-9bc5-44e3-96bd-73c52cd52280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:57.551747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7cf6d143-9bc5-44e3-96bd-73c52cd52280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042681 Aug 01 15:45:57.552299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 955/1812] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:57 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:58.275892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3d34b125-5d45-451d-a7b2-4db53958da52 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:58.276565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3d34b125-5d45-451d-a7b2-4db53958da52 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:58.283162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d34b125-5d45-451d-a7b2-4db53958da52 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:58.283618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d34b125-5d45-451d-a7b2-4db53958da52 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:58.284392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d34b125-5d45-451d-a7b2-4db53958da52 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:58.284887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d34b125-5d45-451d-a7b2-4db53958da52 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:58.287556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:45:58.417458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3d34b125-5d45-451d-a7b2-4db53958da52 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:58.425650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3d34b125-5d45-451d-a7b2-4db53958da52 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.153636 Aug 01 15:45:58.426251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 956/1813] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:58 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:58.530313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4c10ec13-eeaf-4753-8003-7fd3031a7a08 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:58.530931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4c10ec13-eeaf-4753-8003-7fd3031a7a08 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:58.536937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c10ec13-eeaf-4753-8003-7fd3031a7a08 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:58.537389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c10ec13-eeaf-4753-8003-7fd3031a7a08 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:58.538259 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c10ec13-eeaf-4753-8003-7fd3031a7a08 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:58.538696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c10ec13-eeaf-4753-8003-7fd3031a7a08 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:58.670605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4c10ec13-eeaf-4753-8003-7fd3031a7a08 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:45:58.678651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4c10ec13-eeaf-4753-8003-7fd3031a7a08 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.152776 Aug 01 15:45:58.679218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 957/1814] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:45:58 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:45:58.683943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e03f79d4-2bd7-484d-b639-e0001c313526 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:58.686286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e03f79d4-2bd7-484d-b639-e0001c313526 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:58.691932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e03f79d4-2bd7-484d-b639-e0001c313526 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:58.692385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e03f79d4-2bd7-484d-b639-e0001c313526 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:58.693172 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e03f79d4-2bd7-484d-b639-e0001c313526 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:58.693593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e03f79d4-2bd7-484d-b639-e0001c313526 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:58.723368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e03f79d4-2bd7-484d-b639-e0001c313526 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043130 Aug 01 15:45:58.723932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 958/1815] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:45:58 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:45:58.792253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-35b283f5-3fbd-4500-b70c-95088ac79bd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:45:58.792739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-35b283f5-3fbd-4500-b70c-95088ac79bd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:45:58.798894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35b283f5-3fbd-4500-b70c-95088ac79bd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:58.799336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35b283f5-3fbd-4500-b70c-95088ac79bd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:45:58.800101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35b283f5-3fbd-4500-b70c-95088ac79bd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:45:58.800528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35b283f5-3fbd-4500-b70c-95088ac79bd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:46:01.815559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:46:01.816367 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:46:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf (ip 10.222.0.83) !!! Aug 01 15:46:08.796739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=85 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:08.819018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=21 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:46:16.502532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:46:16.503162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:46:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf (ip 10.222.0.83) !!! Aug 01 15:46:58.666996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b2cb9b78-c33c-4dc3-b328-ae077d10c16a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf" status: 202 len: 0 microversion: 2.1 time: 120.138943 Aug 01 15:46:58.667893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 858/1816] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 1 15:44:58 2022] DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf => generated 0 bytes in 120141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:46:58.773510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d1e47e0e-d3b2-4006-ba9b-fb487af60c4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:46:58.774236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d1e47e0e-d3b2-4006-ba9b-fb487af60c4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:46:58.781452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1e47e0e-d3b2-4006-ba9b-fb487af60c4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:46:58.781932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1e47e0e-d3b2-4006-ba9b-fb487af60c4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:46:58.782711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1e47e0e-d3b2-4006-ba9b-fb487af60c4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:46:58.783149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1e47e0e-d3b2-4006-ba9b-fb487af60c4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:46:58.846465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.objects.instance [None req-35b283f5-3fbd-4500-b70c-95088ac79bd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lazy-loading 'services' on Instance uuid 93144385-4cac-4970-9814-564a351af373 {{(pid=124526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:46:58.929285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d1e47e0e-d3b2-4006-ba9b-fb487af60c4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:46:58.937416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d1e47e0e-d3b2-4006-ba9b-fb487af60c4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.268120 Aug 01 15:46:58.937997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 859/1817] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:46:58 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:46:58.942643 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5e7376a1-f902-4f25-8791-e02cd764c617 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:46:58.943259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5e7376a1-f902-4f25-8791-e02cd764c617 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:46:58.949615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e7376a1-f902-4f25-8791-e02cd764c617 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:46:58.950329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e7376a1-f902-4f25-8791-e02cd764c617 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:46:58.951400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e7376a1-f902-4f25-8791-e02cd764c617 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:46:58.951875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e7376a1-f902-4f25-8791-e02cd764c617 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:46:59.088439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5e7376a1-f902-4f25-8791-e02cd764c617 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:46:59.096808 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5e7376a1-f902-4f25-8791-e02cd764c617 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.157838 Aug 01 15:46:59.097374 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 860/1818] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:46:58 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:46:59.102120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9d0f194d-9c33-4aa0-b45a-3afff8e21b6c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:46:59.104383 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9d0f194d-9c33-4aa0-b45a-3afff8e21b6c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:46:59.111740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d0f194d-9c33-4aa0-b45a-3afff8e21b6c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:46:59.112190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d0f194d-9c33-4aa0-b45a-3afff8e21b6c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:46:59.112966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d0f194d-9c33-4aa0-b45a-3afff8e21b6c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:46:59.113404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d0f194d-9c33-4aa0-b45a-3afff8e21b6c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:46:59.143046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9d0f194d-9c33-4aa0-b45a-3afff8e21b6c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Aug 01 15:46:59.143535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 861/1819] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:46:59 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:46:59.148296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-70c2ffc8-3cc2-4f2e-8afb-41b71d95a646 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:46:59.148789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-70c2ffc8-3cc2-4f2e-8afb-41b71d95a646 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:46:59.154935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70c2ffc8-3cc2-4f2e-8afb-41b71d95a646 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:46:59.155385 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70c2ffc8-3cc2-4f2e-8afb-41b71d95a646 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:46:59.156141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70c2ffc8-3cc2-4f2e-8afb-41b71d95a646 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:46:59.156585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70c2ffc8-3cc2-4f2e-8afb-41b71d95a646 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:08.853357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=4 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:09.152428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=8 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:09.175111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:19.193435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-35b283f5-3fbd-4500-b70c-95088ac79bd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2449af8-7c42-4bcd-bd2f-825a7dfe852e) Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-35b283f5-3fbd-4500-b70c-95088ac79bd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Request method failure captured: Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf HTTP/1.1 Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_K53ddQWvF8bwwX7kPrpmXB-Ft4gpk37Z_xQqLmOiw7qzQc0ix5_nT8dQWyuY23pJ-Kp8DZ5Muml7xjPBHUc8LoO6PfskGPOrUZ9RKz2fqvze9FjRell81KUxGu4MHB1g-dHKhXvmVsu1ur8xU-2fAKxciMJycj3fu7Jp1bTJHl6wc Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 15:47:19.195995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 15:47:19.197690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/38f80d210cce4a41af527ac134deba93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_38f80d210cce4a41af527ac134deba93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}] Aug 01 15:47:19.197690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:47:19.197690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:47:19.197690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:47:19.197690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:47:19.197690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 15:47:19.197690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 15:47:19.197690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: 77cb30fae1184064a8c4f822d4d31096 Aug 01 15:47:19.197690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:47:19.197690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2449af8-7c42-4bcd-bd2f-825a7dfe852e) Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'server_id': '93144385-4cac-4970-9814-564a351af373', 'id': 'f418e61d-d2e6-4530-844c-fab840a592cf'} Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 01 15:47:19.198789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2449af8-7c42-4bcd-bd2f-825a7dfe852e) Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:47:19.200234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2449af8-7c42-4bcd-bd2f-825a7dfe852e) Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:47:19.204973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2449af8-7c42-4bcd-bd2f-825a7dfe852e) Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:47:19.206994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2449af8-7c42-4bcd-bd2f-825a7dfe852e) Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2449af8-7c42-4bcd-bd2f-825a7dfe852e) Aug 01 15:47:19.209091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:47:19.212908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-35b283f5-3fbd-4500-b70c-95088ac79bd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2449af8-7c42-4bcd-bd2f-825a7dfe852e) {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:47:19.212908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-35b283f5-3fbd-4500-b70c-95088ac79bd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf" status: 400 len: 269 microversion: 2.1 time: 80.472575 Aug 01 15:47:19.212908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 959/1820] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 1 15:45:58 2022] DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf => generated 269 bytes in 80474 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:47:19.212908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ab2c8482-a7d7-4488-94bd-d3169a24d9c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:19.213994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ab2c8482-a7d7-4488-94bd-d3169a24d9c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:19.213994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab2c8482-a7d7-4488-94bd-d3169a24d9c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:19.213994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab2c8482-a7d7-4488-94bd-d3169a24d9c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:19.213994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab2c8482-a7d7-4488-94bd-d3169a24d9c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:19.214600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab2c8482-a7d7-4488-94bd-d3169a24d9c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:19.246510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-70c2ffc8-3cc2-4f2e-8afb-41b71d95a646 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lazy-loading 'services' on Instance uuid 93144385-4cac-4970-9814-564a351af373 {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:47:19.351076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ab2c8482-a7d7-4488-94bd-d3169a24d9c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:19.358515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ab2c8482-a7d7-4488-94bd-d3169a24d9c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.159252 Aug 01 15:47:19.359303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 960/1821] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:19 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:47:19.363734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-94cc53dd-98a9-4773-ac1f-ed612672f480 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:19.364352 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-94cc53dd-98a9-4773-ac1f-ed612672f480 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:19.370368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-94cc53dd-98a9-4773-ac1f-ed612672f480 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:19.370829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-94cc53dd-98a9-4773-ac1f-ed612672f480 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:19.371606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-94cc53dd-98a9-4773-ac1f-ed612672f480 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:19.372109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-94cc53dd-98a9-4773-ac1f-ed612672f480 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:19.512387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-94cc53dd-98a9-4773-ac1f-ed612672f480 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:19.522192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-94cc53dd-98a9-4773-ac1f-ed612672f480 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.161802 Aug 01 15:47:19.522786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 961/1822] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:19 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:47:19.528291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-648ea5bd-dcd7-449c-83e7-3bfa6a2110e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:19.531183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-648ea5bd-dcd7-449c-83e7-3bfa6a2110e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:19.537915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-648ea5bd-dcd7-449c-83e7-3bfa6a2110e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:19.538384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-648ea5bd-dcd7-449c-83e7-3bfa6a2110e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:19.539206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-648ea5bd-dcd7-449c-83e7-3bfa6a2110e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:19.539696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-648ea5bd-dcd7-449c-83e7-3bfa6a2110e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:19.572539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-648ea5bd-dcd7-449c-83e7-3bfa6a2110e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048568 Aug 01 15:47:19.573044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 962/1823] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:19 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:20.506079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1b1097d4-b56b-44cd-8b17-8bf6efae63db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:20.506714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1b1097d4-b56b-44cd-8b17-8bf6efae63db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:20.513138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b1097d4-b56b-44cd-8b17-8bf6efae63db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:20.513586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b1097d4-b56b-44cd-8b17-8bf6efae63db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:20.514394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b1097d4-b56b-44cd-8b17-8bf6efae63db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:20.515496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b1097d4-b56b-44cd-8b17-8bf6efae63db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:20.544244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1b1097d4-b56b-44cd-8b17-8bf6efae63db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:47:20.639748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1b1097d4-b56b-44cd-8b17-8bf6efae63db tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "DELETE /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 204 len: 0 microversion: 2.1 time: 0.137347 Aug 01 15:47:20.642766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 963/1824] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 15:47:20 2022] DELETE /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:47:20.708348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-7eaed3eb-e756-464e-8e35-460acbce89f7 req-822a2a90-4099-44da-b96f-9686f8e12ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f0755f-45c5-4c98-96b7-9c4b6415d331", "tag": "6c507929-7001-4435-a0b5-2d19c503a391"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:47:20.719532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-7eaed3eb-e756-464e-8e35-460acbce89f7 req-822a2a90-4099-44da-b96f-9686f8e12ed0 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:20.719975 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-7eaed3eb-e756-464e-8e35-460acbce89f7 req-822a2a90-4099-44da-b96f-9686f8e12ed0 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:20.731437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-7eaed3eb-e756-464e-8e35-460acbce89f7 req-822a2a90-4099-44da-b96f-9686f8e12ed0 service nova] Creating event network-changed:6c507929-7001-4435-a0b5-2d19c503a391 for instance 58f0755f-45c5-4c98-96b7-9c4b6415d331 on hv-cinder-84753 Aug 01 15:47:20.736453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-7eaed3eb-e756-464e-8e35-460acbce89f7 req-822a2a90-4099-44da-b96f-9686f8e12ed0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092017 Aug 01 15:47:20.737052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 964/1825] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:20.742251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-10b19811-512e-4dcd-bcc7-abf37f2d4648 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:20.742956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-10b19811-512e-4dcd-bcc7-abf37f2d4648 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:20.749680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10b19811-512e-4dcd-bcc7-abf37f2d4648 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:20.750262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10b19811-512e-4dcd-bcc7-abf37f2d4648 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:20.751060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10b19811-512e-4dcd-bcc7-abf37f2d4648 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:20.751494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10b19811-512e-4dcd-bcc7-abf37f2d4648 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:20.973790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-10b19811-512e-4dcd-bcc7-abf37f2d4648 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:20.982455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-10b19811-512e-4dcd-bcc7-abf37f2d4648 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.244226 Aug 01 15:47:20.983039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 965/1826] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:20 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:47:21.000664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c6823399-eae7-4620-bd80-e2bb296f980f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:21.002953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c6823399-eae7-4620-bd80-e2bb296f980f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:21.009184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c6823399-eae7-4620-bd80-e2bb296f980f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:21.009618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c6823399-eae7-4620-bd80-e2bb296f980f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:21.010525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c6823399-eae7-4620-bd80-e2bb296f980f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:21.010876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c6823399-eae7-4620-bd80-e2bb296f980f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:21.042807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c6823399-eae7-4620-bd80-e2bb296f980f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048214 Aug 01 15:47:21.043739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 966/1827] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:20 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:21.051216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4b7cec76-9a57-46b8-b9ec-0ded98e9c394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:21.051843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4b7cec76-9a57-46b8-b9ec-0ded98e9c394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:21.058284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b7cec76-9a57-46b8-b9ec-0ded98e9c394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:21.058742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b7cec76-9a57-46b8-b9ec-0ded98e9c394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:21.059517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b7cec76-9a57-46b8-b9ec-0ded98e9c394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:21.059951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b7cec76-9a57-46b8-b9ec-0ded98e9c394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:21.286546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4b7cec76-9a57-46b8-b9ec-0ded98e9c394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:21.294512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4b7cec76-9a57-46b8-b9ec-0ded98e9c394 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1568 microversion: 2.1 time: 0.247025 Aug 01 15:47:21.295091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 967/1828] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:21 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:47:22.007035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-39877989-aa95-4d00-b73c-8359d80e2e8f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:22.007746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-39877989-aa95-4d00-b73c-8359d80e2e8f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:22.015343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39877989-aa95-4d00-b73c-8359d80e2e8f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:22.015782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39877989-aa95-4d00-b73c-8359d80e2e8f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:22.016552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39877989-aa95-4d00-b73c-8359d80e2e8f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:22.016980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39877989-aa95-4d00-b73c-8359d80e2e8f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:22.156506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-39877989-aa95-4d00-b73c-8359d80e2e8f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:22.164929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-39877989-aa95-4d00-b73c-8359d80e2e8f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.162839 Aug 01 15:47:22.165576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 968/1829] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:22 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:22.170345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0bbf0e08-e8df-4bb6-870d-ec71df14fd91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:22.172483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0bbf0e08-e8df-4bb6-870d-ec71df14fd91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:22.178421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0bbf0e08-e8df-4bb6-870d-ec71df14fd91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:22.178876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0bbf0e08-e8df-4bb6-870d-ec71df14fd91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:22.179796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0bbf0e08-e8df-4bb6-870d-ec71df14fd91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:22.180226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0bbf0e08-e8df-4bb6-870d-ec71df14fd91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:22.211921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0bbf0e08-e8df-4bb6-870d-ec71df14fd91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045296 Aug 01 15:47:22.212589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 969/1830] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:22 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:22.318410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8d2a3367-54c0-45a1-ba8a-f226fd626ac4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:22.319069 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8d2a3367-54c0-45a1-ba8a-f226fd626ac4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:22.325298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d2a3367-54c0-45a1-ba8a-f226fd626ac4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:22.325743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d2a3367-54c0-45a1-ba8a-f226fd626ac4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:22.326546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d2a3367-54c0-45a1-ba8a-f226fd626ac4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:22.326974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d2a3367-54c0-45a1-ba8a-f226fd626ac4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:22.473014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8d2a3367-54c0-45a1-ba8a-f226fd626ac4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:22.480824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8d2a3367-54c0-45a1-ba8a-f226fd626ac4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.167230 Aug 01 15:47:22.481580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 970/1831] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:22 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:23.187829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-56981b8f-b82d-477c-b730-4e2ad50dd411 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:23.188547 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-56981b8f-b82d-477c-b730-4e2ad50dd411 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:23.194928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56981b8f-b82d-477c-b730-4e2ad50dd411 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:23.195379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56981b8f-b82d-477c-b730-4e2ad50dd411 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:23.196144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56981b8f-b82d-477c-b730-4e2ad50dd411 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:23.196581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56981b8f-b82d-477c-b730-4e2ad50dd411 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:23.325880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-56981b8f-b82d-477c-b730-4e2ad50dd411 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:23.334620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-56981b8f-b82d-477c-b730-4e2ad50dd411 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.150753 Aug 01 15:47:23.335218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 971/1832] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:23 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:23.339804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8c8e0681-6348-4aec-9e39-1253e85372cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:23.341980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8c8e0681-6348-4aec-9e39-1253e85372cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:23.349142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8c8e0681-6348-4aec-9e39-1253e85372cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:23.349627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8c8e0681-6348-4aec-9e39-1253e85372cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:23.350397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8c8e0681-6348-4aec-9e39-1253e85372cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:23.350839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8c8e0681-6348-4aec-9e39-1253e85372cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:23.379303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8c8e0681-6348-4aec-9e39-1253e85372cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043075 Aug 01 15:47:23.379848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 972/1833] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:23 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:23.502906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8f98b166-1eb0-43c3-927f-689ef2310610 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:23.503602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8f98b166-1eb0-43c3-927f-689ef2310610 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:23.509781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f98b166-1eb0-43c3-927f-689ef2310610 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:23.510262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f98b166-1eb0-43c3-927f-689ef2310610 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:23.511056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f98b166-1eb0-43c3-927f-689ef2310610 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:23.511491 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f98b166-1eb0-43c3-927f-689ef2310610 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:23.648339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f98b166-1eb0-43c3-927f-689ef2310610 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:23.656594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8f98b166-1eb0-43c3-927f-689ef2310610 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.158109 Aug 01 15:47:23.657183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 973/1834] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:23 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:24.359429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5478c248-470a-4f23-b706-fc5851c20853 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:24.360431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5478c248-470a-4f23-b706-fc5851c20853 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:24.368626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5478c248-470a-4f23-b706-fc5851c20853 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:24.369131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5478c248-470a-4f23-b706-fc5851c20853 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:24.369846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5478c248-470a-4f23-b706-fc5851c20853 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:24.370367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5478c248-470a-4f23-b706-fc5851c20853 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:24.501877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5478c248-470a-4f23-b706-fc5851c20853 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:24.509869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5478c248-470a-4f23-b706-fc5851c20853 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.155681 Aug 01 15:47:24.510460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 974/1835] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:24 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:24.515562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d903e7b0-adca-47f8-ac25-7fa3be838568 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:24.517682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d903e7b0-adca-47f8-ac25-7fa3be838568 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:24.523796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d903e7b0-adca-47f8-ac25-7fa3be838568 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:24.524251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d903e7b0-adca-47f8-ac25-7fa3be838568 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:24.525048 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d903e7b0-adca-47f8-ac25-7fa3be838568 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:24.525512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d903e7b0-adca-47f8-ac25-7fa3be838568 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:24.542421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:24.557168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d903e7b0-adca-47f8-ac25-7fa3be838568 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045667 Aug 01 15:47:24.557732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 975/1836] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:24 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:24.678336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-100d1996-1451-4270-893b-ca8b4effd91e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:24.678953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-100d1996-1451-4270-893b-ca8b4effd91e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:24.685034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-100d1996-1451-4270-893b-ca8b4effd91e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:24.685479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-100d1996-1451-4270-893b-ca8b4effd91e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:24.686263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-100d1996-1451-4270-893b-ca8b4effd91e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:24.687362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-100d1996-1451-4270-893b-ca8b4effd91e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:24.821110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-100d1996-1451-4270-893b-ca8b4effd91e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:24.828734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-100d1996-1451-4270-893b-ca8b4effd91e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.154516 Aug 01 15:47:24.829291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 976/1837] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:24 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:25.531705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eb3e3f2e-c3e7-49db-96f1-00b569e8e5ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:25.532422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eb3e3f2e-c3e7-49db-96f1-00b569e8e5ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:25.538970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb3e3f2e-c3e7-49db-96f1-00b569e8e5ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:25.539409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb3e3f2e-c3e7-49db-96f1-00b569e8e5ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:25.540175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb3e3f2e-c3e7-49db-96f1-00b569e8e5ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:25.540613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb3e3f2e-c3e7-49db-96f1-00b569e8e5ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:25.670134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eb3e3f2e-c3e7-49db-96f1-00b569e8e5ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:25.678612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eb3e3f2e-c3e7-49db-96f1-00b569e8e5ab tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.150768 Aug 01 15:47:25.679209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 977/1838] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:25 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:25.683894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-008c429e-2771-474a-99a2-1e6e8413b721 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:25.686030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-008c429e-2771-474a-99a2-1e6e8413b721 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:25.692435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-008c429e-2771-474a-99a2-1e6e8413b721 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:25.692884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-008c429e-2771-474a-99a2-1e6e8413b721 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:25.693650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-008c429e-2771-474a-99a2-1e6e8413b721 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:25.694125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-008c429e-2771-474a-99a2-1e6e8413b721 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:25.723268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-008c429e-2771-474a-99a2-1e6e8413b721 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043015 Aug 01 15:47:25.723835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 978/1839] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:25 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:25.849766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e44b055a-24c8-43fe-86e6-57b2845da5c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:25.850280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e44b055a-24c8-43fe-86e6-57b2845da5c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:25.856310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e44b055a-24c8-43fe-86e6-57b2845da5c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:25.856765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e44b055a-24c8-43fe-86e6-57b2845da5c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:25.857530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e44b055a-24c8-43fe-86e6-57b2845da5c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:25.858013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e44b055a-24c8-43fe-86e6-57b2845da5c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:25.992050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e44b055a-24c8-43fe-86e6-57b2845da5c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:26.000032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e44b055a-24c8-43fe-86e6-57b2845da5c7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.154290 Aug 01 15:47:26.000591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 979/1840] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:25 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:26.700556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-48390e27-7a93-432e-a47e-1377f519f829 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:26.701200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-48390e27-7a93-432e-a47e-1377f519f829 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:26.708350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48390e27-7a93-432e-a47e-1377f519f829 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:26.708802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48390e27-7a93-432e-a47e-1377f519f829 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:26.709576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48390e27-7a93-432e-a47e-1377f519f829 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:26.710049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48390e27-7a93-432e-a47e-1377f519f829 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:26.843351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48390e27-7a93-432e-a47e-1377f519f829 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:26.851628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-48390e27-7a93-432e-a47e-1377f519f829 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.155028 Aug 01 15:47:26.852229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 980/1841] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:26 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:26.856693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4e11b51f-b50f-4e7f-a23a-e8684a5ba246 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:26.858832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4e11b51f-b50f-4e7f-a23a-e8684a5ba246 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:26.864562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e11b51f-b50f-4e7f-a23a-e8684a5ba246 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:26.865016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e11b51f-b50f-4e7f-a23a-e8684a5ba246 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:26.865802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e11b51f-b50f-4e7f-a23a-e8684a5ba246 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:26.866242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e11b51f-b50f-4e7f-a23a-e8684a5ba246 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:26.895624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4e11b51f-b50f-4e7f-a23a-e8684a5ba246 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 Aug 01 15:47:26.896194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 981/1842] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:26 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:27.021565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2b474ea3-4f2b-4514-bc16-85c204812116 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:27.022127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2b474ea3-4f2b-4514-bc16-85c204812116 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:27.028260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2b474ea3-4f2b-4514-bc16-85c204812116 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:27.028710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2b474ea3-4f2b-4514-bc16-85c204812116 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:27.029488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2b474ea3-4f2b-4514-bc16-85c204812116 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:27.029951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2b474ea3-4f2b-4514-bc16-85c204812116 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:27.162685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2b474ea3-4f2b-4514-bc16-85c204812116 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:27.170266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2b474ea3-4f2b-4514-bc16-85c204812116 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.152683 Aug 01 15:47:27.171317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 982/1843] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:27 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:27.875682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fba62e2f-c396-4d07-8dbb-17244e8260b6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:27.876385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fba62e2f-c396-4d07-8dbb-17244e8260b6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:27.882957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fba62e2f-c396-4d07-8dbb-17244e8260b6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:27.883410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fba62e2f-c396-4d07-8dbb-17244e8260b6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:27.884188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fba62e2f-c396-4d07-8dbb-17244e8260b6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:27.884626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fba62e2f-c396-4d07-8dbb-17244e8260b6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:28.025072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fba62e2f-c396-4d07-8dbb-17244e8260b6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:28.033652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fba62e2f-c396-4d07-8dbb-17244e8260b6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.163489 Aug 01 15:47:28.034265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 983/1844] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:27 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:47:28.038944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-898e2ae7-6364-46e8-9da0-4f0e7fd97cc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:28.041072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-898e2ae7-6364-46e8-9da0-4f0e7fd97cc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:28.047590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-898e2ae7-6364-46e8-9da0-4f0e7fd97cc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:28.048042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-898e2ae7-6364-46e8-9da0-4f0e7fd97cc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:28.048825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-898e2ae7-6364-46e8-9da0-4f0e7fd97cc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:28.049266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-898e2ae7-6364-46e8-9da0-4f0e7fd97cc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:28.078235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-898e2ae7-6364-46e8-9da0-4f0e7fd97cc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 Aug 01 15:47:28.078795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 984/1845] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:28 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:28.191958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a747c3f4-bdc5-4cba-9e72-349dabec68dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:28.192483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a747c3f4-bdc5-4cba-9e72-349dabec68dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:28.204063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a747c3f4-bdc5-4cba-9e72-349dabec68dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:28.204514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a747c3f4-bdc5-4cba-9e72-349dabec68dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:28.205288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a747c3f4-bdc5-4cba-9e72-349dabec68dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:28.205793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a747c3f4-bdc5-4cba-9e72-349dabec68dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:28.344667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a747c3f4-bdc5-4cba-9e72-349dabec68dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:28.352523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a747c3f4-bdc5-4cba-9e72-349dabec68dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.164613 Aug 01 15:47:28.353088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 985/1846] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:28 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:29.055916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2bae839d-b048-4aba-a822-6f445a6fb8b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:29.056425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2bae839d-b048-4aba-a822-6f445a6fb8b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:29.063676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bae839d-b048-4aba-a822-6f445a6fb8b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:29.064134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bae839d-b048-4aba-a822-6f445a6fb8b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:29.065216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bae839d-b048-4aba-a822-6f445a6fb8b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:29.065916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bae839d-b048-4aba-a822-6f445a6fb8b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:29.198336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2bae839d-b048-4aba-a822-6f445a6fb8b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:29.206212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2bae839d-b048-4aba-a822-6f445a6fb8b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.154833 Aug 01 15:47:29.206780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 986/1847] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:29 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:29.211452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-330f1124-5a08-4654-b531-015d248705a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:29.214380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-330f1124-5a08-4654-b531-015d248705a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:29.222108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-330f1124-5a08-4654-b531-015d248705a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:29.222598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-330f1124-5a08-4654-b531-015d248705a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:29.223369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-330f1124-5a08-4654-b531-015d248705a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:29.223826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-330f1124-5a08-4654-b531-015d248705a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:29.250924 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=4 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:29.253874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-330f1124-5a08-4654-b531-015d248705a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046026 Aug 01 15:47:29.254560 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 987/1848] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:29 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:29.374806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8e52a2b4-3183-4753-84dd-a45cd00ae546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:29.375428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8e52a2b4-3183-4753-84dd-a45cd00ae546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:29.381550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e52a2b4-3183-4753-84dd-a45cd00ae546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:29.382042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e52a2b4-3183-4753-84dd-a45cd00ae546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:29.382808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e52a2b4-3183-4753-84dd-a45cd00ae546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:29.383248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e52a2b4-3183-4753-84dd-a45cd00ae546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:29.523224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8e52a2b4-3183-4753-84dd-a45cd00ae546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:29.531416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8e52a2b4-3183-4753-84dd-a45cd00ae546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.161136 Aug 01 15:47:29.531984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 988/1849] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:29 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:30.227735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f816da3c-10dc-4b62-a82f-b70eee6e7738 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:30.228377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f816da3c-10dc-4b62-a82f-b70eee6e7738 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:30.234937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f816da3c-10dc-4b62-a82f-b70eee6e7738 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:30.235378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f816da3c-10dc-4b62-a82f-b70eee6e7738 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:30.236143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f816da3c-10dc-4b62-a82f-b70eee6e7738 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:30.236574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f816da3c-10dc-4b62-a82f-b70eee6e7738 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:30.367227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f816da3c-10dc-4b62-a82f-b70eee6e7738 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:30.376511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f816da3c-10dc-4b62-a82f-b70eee6e7738 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.152641 Aug 01 15:47:30.377093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 989/1850] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:30 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:30.389267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5d9b3c73-ff03-4b39-af34-603df7854640 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:30.391985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5d9b3c73-ff03-4b39-af34-603df7854640 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:30.398001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d9b3c73-ff03-4b39-af34-603df7854640 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:30.398452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d9b3c73-ff03-4b39-af34-603df7854640 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:30.399211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d9b3c73-ff03-4b39-af34-603df7854640 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:30.399640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d9b3c73-ff03-4b39-af34-603df7854640 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:30.427956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5d9b3c73-ff03-4b39-af34-603df7854640 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049845 Aug 01 15:47:30.428998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 990/1851] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:30 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:30.552635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5526a5d3-908e-4a69-ba52-e048a0f67183 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:30.553243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5526a5d3-908e-4a69-ba52-e048a0f67183 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:30.559280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5526a5d3-908e-4a69-ba52-e048a0f67183 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:30.559729 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5526a5d3-908e-4a69-ba52-e048a0f67183 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:30.560483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5526a5d3-908e-4a69-ba52-e048a0f67183 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:30.560917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5526a5d3-908e-4a69-ba52-e048a0f67183 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:30.703186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5526a5d3-908e-4a69-ba52-e048a0f67183 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:30.711113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5526a5d3-908e-4a69-ba52-e048a0f67183 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.162275 Aug 01 15:47:30.711762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 991/1852] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:30 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:31.398951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1ed33c3e-5eac-46ca-8bf8-66b2cb7bd769 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:31.399624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1ed33c3e-5eac-46ca-8bf8-66b2cb7bd769 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:31.406506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ed33c3e-5eac-46ca-8bf8-66b2cb7bd769 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:31.406957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ed33c3e-5eac-46ca-8bf8-66b2cb7bd769 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:31.407721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ed33c3e-5eac-46ca-8bf8-66b2cb7bd769 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:31.408151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ed33c3e-5eac-46ca-8bf8-66b2cb7bd769 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:31.412153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:31.537377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1ed33c3e-5eac-46ca-8bf8-66b2cb7bd769 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:31.545428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1ed33c3e-5eac-46ca-8bf8-66b2cb7bd769 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.150322 Aug 01 15:47:31.546637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 992/1853] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:31 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:31.551301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9c9a6104-41c3-4c9d-bc5d-ce73582709e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:31.553403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9c9a6104-41c3-4c9d-bc5d-ce73582709e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:31.559343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c9a6104-41c3-4c9d-bc5d-ce73582709e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:31.559787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c9a6104-41c3-4c9d-bc5d-ce73582709e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:31.560547 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c9a6104-41c3-4c9d-bc5d-ce73582709e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:31.560989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c9a6104-41c3-4c9d-bc5d-ce73582709e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:31.589501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9c9a6104-41c3-4c9d-bc5d-ce73582709e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041857 Aug 01 15:47:31.590077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 993/1854] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:31 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:31.735373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fd834da7-60c2-4672-ae6f-f4c7b0e6b151 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:31.735889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fd834da7-60c2-4672-ae6f-f4c7b0e6b151 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:31.742334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd834da7-60c2-4672-ae6f-f4c7b0e6b151 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:31.742841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd834da7-60c2-4672-ae6f-f4c7b0e6b151 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:31.743617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd834da7-60c2-4672-ae6f-f4c7b0e6b151 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:31.744110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd834da7-60c2-4672-ae6f-f4c7b0e6b151 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:31.895779 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fd834da7-60c2-4672-ae6f-f4c7b0e6b151 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:31.903347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fd834da7-60c2-4672-ae6f-f4c7b0e6b151 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.172496 Aug 01 15:47:31.903936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 994/1855] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:31 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:32.569065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c7f31bff-b336-4d3a-86e7-466c7f55d8ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:32.569741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c7f31bff-b336-4d3a-86e7-466c7f55d8ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:32.576468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c7f31bff-b336-4d3a-86e7-466c7f55d8ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:32.576912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c7f31bff-b336-4d3a-86e7-466c7f55d8ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:32.577673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c7f31bff-b336-4d3a-86e7-466c7f55d8ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:32.578137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c7f31bff-b336-4d3a-86e7-466c7f55d8ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:32.704693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c7f31bff-b336-4d3a-86e7-466c7f55d8ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:32.712667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c7f31bff-b336-4d3a-86e7-466c7f55d8ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.147496 Aug 01 15:47:32.713235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 995/1856] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:32 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:32.718199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f569fbd0-d966-4c30-8977-961312b95188 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:32.720599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f569fbd0-d966-4c30-8977-961312b95188 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:32.726531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f569fbd0-d966-4c30-8977-961312b95188 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:32.726979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f569fbd0-d966-4c30-8977-961312b95188 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:32.727749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f569fbd0-d966-4c30-8977-961312b95188 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:32.728279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f569fbd0-d966-4c30-8977-961312b95188 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:32.757861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f569fbd0-d966-4c30-8977-961312b95188 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043531 Aug 01 15:47:32.758454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 996/1857] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:32 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:32.926149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3b2a529e-0093-4bbe-89ea-1971ea066a10 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:32.926765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3b2a529e-0093-4bbe-89ea-1971ea066a10 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:32.932855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3b2a529e-0093-4bbe-89ea-1971ea066a10 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:32.933306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3b2a529e-0093-4bbe-89ea-1971ea066a10 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:32.934104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3b2a529e-0093-4bbe-89ea-1971ea066a10 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:32.934594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3b2a529e-0093-4bbe-89ea-1971ea066a10 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:33.064039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3b2a529e-0093-4bbe-89ea-1971ea066a10 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:33.071738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3b2a529e-0093-4bbe-89ea-1971ea066a10 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.149502 Aug 01 15:47:33.072311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 997/1858] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:32 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:33.735533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-806cd3fa-b0aa-422c-9152-22fca34eeade tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:33.736208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-806cd3fa-b0aa-422c-9152-22fca34eeade tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:33.742634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-806cd3fa-b0aa-422c-9152-22fca34eeade tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:33.743078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-806cd3fa-b0aa-422c-9152-22fca34eeade tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:33.743831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-806cd3fa-b0aa-422c-9152-22fca34eeade tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:33.744263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-806cd3fa-b0aa-422c-9152-22fca34eeade tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:33.880559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-806cd3fa-b0aa-422c-9152-22fca34eeade tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:33.888542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-806cd3fa-b0aa-422c-9152-22fca34eeade tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.157527 Aug 01 15:47:33.889116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 998/1859] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:33 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:33.893788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-739ec46d-8d2f-4490-a65e-caf3aefe8055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:33.896019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-739ec46d-8d2f-4490-a65e-caf3aefe8055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:33.902373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-739ec46d-8d2f-4490-a65e-caf3aefe8055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:33.902824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-739ec46d-8d2f-4490-a65e-caf3aefe8055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:33.905810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-739ec46d-8d2f-4490-a65e-caf3aefe8055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:33.905810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-739ec46d-8d2f-4490-a65e-caf3aefe8055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:33.933981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-739ec46d-8d2f-4490-a65e-caf3aefe8055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Aug 01 15:47:33.934546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 999/1860] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:33 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:34.093519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-49b8a619-2090-4f4f-9bad-69854c3287a0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:34.094457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-49b8a619-2090-4f4f-9bad-69854c3287a0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:34.101699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49b8a619-2090-4f4f-9bad-69854c3287a0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:34.102174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49b8a619-2090-4f4f-9bad-69854c3287a0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:34.103008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49b8a619-2090-4f4f-9bad-69854c3287a0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:34.103432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49b8a619-2090-4f4f-9bad-69854c3287a0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:34.238500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-49b8a619-2090-4f4f-9bad-69854c3287a0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:34.246149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-49b8a619-2090-4f4f-9bad-69854c3287a0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.157209 Aug 01 15:47:34.246720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1000/1861] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:34 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:34.910464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eb76bbc0-1ec8-489e-969e-c294091c6b8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:34.911152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eb76bbc0-1ec8-489e-969e-c294091c6b8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:34.917663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb76bbc0-1ec8-489e-969e-c294091c6b8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:34.918153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb76bbc0-1ec8-489e-969e-c294091c6b8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:34.918917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb76bbc0-1ec8-489e-969e-c294091c6b8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:34.919354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eb76bbc0-1ec8-489e-969e-c294091c6b8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:35.052828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eb76bbc0-1ec8-489e-969e-c294091c6b8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:35.060875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eb76bbc0-1ec8-489e-969e-c294091c6b8d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.154302 Aug 01 15:47:35.062073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1001/1862] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:34 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:35.066706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0e152d8e-aaa2-4097-b0ab-2d0505e27ed5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:35.068826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0e152d8e-aaa2-4097-b0ab-2d0505e27ed5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:35.074878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e152d8e-aaa2-4097-b0ab-2d0505e27ed5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:35.075327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e152d8e-aaa2-4097-b0ab-2d0505e27ed5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:35.076091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e152d8e-aaa2-4097-b0ab-2d0505e27ed5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:35.076525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e152d8e-aaa2-4097-b0ab-2d0505e27ed5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:35.260449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0e152d8e-aaa2-4097-b0ab-2d0505e27ed5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197242 Aug 01 15:47:35.261115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1002/1863] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:35 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:35.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b30e5e70-3cbb-4a99-ab0e-55c6b69cbe65 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:35.267874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b30e5e70-3cbb-4a99-ab0e-55c6b69cbe65 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:35.273696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b30e5e70-3cbb-4a99-ab0e-55c6b69cbe65 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:35.274168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b30e5e70-3cbb-4a99-ab0e-55c6b69cbe65 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:35.274918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b30e5e70-3cbb-4a99-ab0e-55c6b69cbe65 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:35.275349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b30e5e70-3cbb-4a99-ab0e-55c6b69cbe65 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:35.411885 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b30e5e70-3cbb-4a99-ab0e-55c6b69cbe65 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:35.419520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b30e5e70-3cbb-4a99-ab0e-55c6b69cbe65 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.155810 Aug 01 15:47:35.420088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1003/1864] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:35 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:36.083080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b6d31799-1241-4f37-87b7-1231059123d3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:36.083722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b6d31799-1241-4f37-87b7-1231059123d3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:36.090242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b6d31799-1241-4f37-87b7-1231059123d3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:36.090695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b6d31799-1241-4f37-87b7-1231059123d3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:36.091474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b6d31799-1241-4f37-87b7-1231059123d3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:36.091908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b6d31799-1241-4f37-87b7-1231059123d3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:36.221427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b6d31799-1241-4f37-87b7-1231059123d3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:36.229941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b6d31799-1241-4f37-87b7-1231059123d3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.150746 Aug 01 15:47:36.230511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1004/1865] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:36 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:36.271965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d5661e53-d7a1-4629-852c-2f26774f8277 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:36.274128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d5661e53-d7a1-4629-852c-2f26774f8277 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:36.280649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5661e53-d7a1-4629-852c-2f26774f8277 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:36.281102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5661e53-d7a1-4629-852c-2f26774f8277 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:36.281876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5661e53-d7a1-4629-852c-2f26774f8277 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:36.282332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5661e53-d7a1-4629-852c-2f26774f8277 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:36.312217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d5661e53-d7a1-4629-852c-2f26774f8277 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044125 Aug 01 15:47:36.312762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1005/1866] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:36 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:47:36.440721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a08e0581-8ea2-48eb-829c-7a6ed4e4dd46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:36.441338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a08e0581-8ea2-48eb-829c-7a6ed4e4dd46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:36.444365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:36.448805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a08e0581-8ea2-48eb-829c-7a6ed4e4dd46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:36.449284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a08e0581-8ea2-48eb-829c-7a6ed4e4dd46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:36.450072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a08e0581-8ea2-48eb-829c-7a6ed4e4dd46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:36.450505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a08e0581-8ea2-48eb-829c-7a6ed4e4dd46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:36.584649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a08e0581-8ea2-48eb-829c-7a6ed4e4dd46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:36.592211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a08e0581-8ea2-48eb-829c-7a6ed4e4dd46 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.155362 Aug 01 15:47:36.593335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1006/1867] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:36 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:37.252744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7b0a6b89-11fc-4b2c-b6a0-45a17dfd7cf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:37.253392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7b0a6b89-11fc-4b2c-b6a0-45a17dfd7cf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:37.260425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b0a6b89-11fc-4b2c-b6a0-45a17dfd7cf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:37.260882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b0a6b89-11fc-4b2c-b6a0-45a17dfd7cf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:37.261725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b0a6b89-11fc-4b2c-b6a0-45a17dfd7cf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:37.262201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b0a6b89-11fc-4b2c-b6a0-45a17dfd7cf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:37.393751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7b0a6b89-11fc-4b2c-b6a0-45a17dfd7cf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:37.401667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7b0a6b89-11fc-4b2c-b6a0-45a17dfd7cf1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153427 Aug 01 15:47:37.402251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1007/1868] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:37 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:37.406728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7b867fb1-49d0-460d-9fc9-4d95bcb058a3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:37.408878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7b867fb1-49d0-460d-9fc9-4d95bcb058a3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:37.415184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b867fb1-49d0-460d-9fc9-4d95bcb058a3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:37.415767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b867fb1-49d0-460d-9fc9-4d95bcb058a3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:37.416594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b867fb1-49d0-460d-9fc9-4d95bcb058a3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:37.417031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b867fb1-49d0-460d-9fc9-4d95bcb058a3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:37.445166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:37.450716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7b867fb1-49d0-460d-9fc9-4d95bcb058a3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047502 Aug 01 15:47:37.451278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1008/1869] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:37 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:37.615280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bfc563e2-93c0-49fc-a05f-2e19707ef4b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:37.615900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bfc563e2-93c0-49fc-a05f-2e19707ef4b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:37.621966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bfc563e2-93c0-49fc-a05f-2e19707ef4b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:37.622417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bfc563e2-93c0-49fc-a05f-2e19707ef4b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:37.623180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bfc563e2-93c0-49fc-a05f-2e19707ef4b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:37.623618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bfc563e2-93c0-49fc-a05f-2e19707ef4b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:37.763210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bfc563e2-93c0-49fc-a05f-2e19707ef4b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:37.770929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bfc563e2-93c0-49fc-a05f-2e19707ef4b3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.159716 Aug 01 15:47:37.771535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1009/1870] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:37 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:47:38.422554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-98e92b0b-7fa8-424a-b06f-6d495cfb75c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:38.423251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-98e92b0b-7fa8-424a-b06f-6d495cfb75c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:38.429738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98e92b0b-7fa8-424a-b06f-6d495cfb75c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:38.430219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98e92b0b-7fa8-424a-b06f-6d495cfb75c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:38.430990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98e92b0b-7fa8-424a-b06f-6d495cfb75c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:38.431432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98e92b0b-7fa8-424a-b06f-6d495cfb75c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:38.562618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-98e92b0b-7fa8-424a-b06f-6d495cfb75c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:38.570708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-98e92b0b-7fa8-424a-b06f-6d495cfb75c3 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.152065 Aug 01 15:47:38.571278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1010/1871] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:38 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:38.575832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-514f0d4a-9183-4876-9ae1-fa743fb6b68d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:38.578067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-514f0d4a-9183-4876-9ae1-fa743fb6b68d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:38.584045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-514f0d4a-9183-4876-9ae1-fa743fb6b68d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:38.584495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-514f0d4a-9183-4876-9ae1-fa743fb6b68d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:38.585261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-514f0d4a-9183-4876-9ae1-fa743fb6b68d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:38.585693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-514f0d4a-9183-4876-9ae1-fa743fb6b68d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:38.615014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-514f0d4a-9183-4876-9ae1-fa743fb6b68d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042701 Aug 01 15:47:38.615565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1011/1872] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:38 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:38.792832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d1320ca8-55f4-4ffa-9768-3f08c919fe38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:38.793401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d1320ca8-55f4-4ffa-9768-3f08c919fe38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:38.800035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d1320ca8-55f4-4ffa-9768-3f08c919fe38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:38.800487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d1320ca8-55f4-4ffa-9768-3f08c919fe38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:38.801255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d1320ca8-55f4-4ffa-9768-3f08c919fe38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:38.801695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d1320ca8-55f4-4ffa-9768-3f08c919fe38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:38.933743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d1320ca8-55f4-4ffa-9768-3f08c919fe38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:38.942037 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d1320ca8-55f4-4ffa-9768-3f08c919fe38 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.153155 Aug 01 15:47:38.942596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1012/1873] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:38 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:39.592354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f5bd2684-9bf3-448e-ae37-e41433916990 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:39.593489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f5bd2684-9bf3-448e-ae37-e41433916990 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:39.600386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f5bd2684-9bf3-448e-ae37-e41433916990 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:39.600831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f5bd2684-9bf3-448e-ae37-e41433916990 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:39.601600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f5bd2684-9bf3-448e-ae37-e41433916990 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:39.602088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f5bd2684-9bf3-448e-ae37-e41433916990 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:39.732022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f5bd2684-9bf3-448e-ae37-e41433916990 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:39.740388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f5bd2684-9bf3-448e-ae37-e41433916990 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.152021 Aug 01 15:47:39.740952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1013/1874] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:39 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:39.745551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d6dc588a-aa8f-4c68-9e49-5c98752411a7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:39.747698 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d6dc588a-aa8f-4c68-9e49-5c98752411a7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:39.754598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6dc588a-aa8f-4c68-9e49-5c98752411a7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:39.755131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6dc588a-aa8f-4c68-9e49-5c98752411a7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:39.755846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6dc588a-aa8f-4c68-9e49-5c98752411a7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:39.756281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6dc588a-aa8f-4c68-9e49-5c98752411a7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:39.785098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d6dc588a-aa8f-4c68-9e49-5c98752411a7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043150 Aug 01 15:47:39.785650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1014/1875] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:39 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:39.963751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ae267300-5338-4835-a3b7-37e48b185552 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:39.964372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ae267300-5338-4835-a3b7-37e48b185552 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:39.970778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae267300-5338-4835-a3b7-37e48b185552 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:39.971235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae267300-5338-4835-a3b7-37e48b185552 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:39.972001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae267300-5338-4835-a3b7-37e48b185552 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:39.972442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae267300-5338-4835-a3b7-37e48b185552 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:40.103916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ae267300-5338-4835-a3b7-37e48b185552 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:40.112099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ae267300-5338-4835-a3b7-37e48b185552 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.152302 Aug 01 15:47:40.112783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1015/1876] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:39 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:47:40.762669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f78783c5-466e-47a4-84a7-348beaa8b8b9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:40.763355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f78783c5-466e-47a4-84a7-348beaa8b8b9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:40.770040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f78783c5-466e-47a4-84a7-348beaa8b8b9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:40.770499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f78783c5-466e-47a4-84a7-348beaa8b8b9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:40.771279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f78783c5-466e-47a4-84a7-348beaa8b8b9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:40.771720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f78783c5-466e-47a4-84a7-348beaa8b8b9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:40.907470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f78783c5-466e-47a4-84a7-348beaa8b8b9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:40.915554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f78783c5-466e-47a4-84a7-348beaa8b8b9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.156994 Aug 01 15:47:40.916116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1016/1877] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:40 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:40.920797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6bf6c61c-0281-4b36-b2f6-7ec47f523450 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:40.922956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6bf6c61c-0281-4b36-b2f6-7ec47f523450 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:40.930068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6bf6c61c-0281-4b36-b2f6-7ec47f523450 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:40.930524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6bf6c61c-0281-4b36-b2f6-7ec47f523450 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:40.931304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6bf6c61c-0281-4b36-b2f6-7ec47f523450 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:40.931747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6bf6c61c-0281-4b36-b2f6-7ec47f523450 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:40.961775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6bf6c61c-0281-4b36-b2f6-7ec47f523450 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Aug 01 15:47:40.962437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1017/1878] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:40 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:41.133322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6544527f-7937-498e-b056-d7ac618f0378 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:41.133972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6544527f-7937-498e-b056-d7ac618f0378 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:41.140564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6544527f-7937-498e-b056-d7ac618f0378 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:41.141015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6544527f-7937-498e-b056-d7ac618f0378 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:41.141787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6544527f-7937-498e-b056-d7ac618f0378 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:41.142257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6544527f-7937-498e-b056-d7ac618f0378 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:41.279363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6544527f-7937-498e-b056-d7ac618f0378 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:41.286828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6544527f-7937-498e-b056-d7ac618f0378 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.157496 Aug 01 15:47:41.287381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1018/1879] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:41 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:41.938033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-08808b31-3acf-4113-8e95-e43ee51e594e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:41.938898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-08808b31-3acf-4113-8e95-e43ee51e594e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:41.945539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08808b31-3acf-4113-8e95-e43ee51e594e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:41.946024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08808b31-3acf-4113-8e95-e43ee51e594e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:41.946801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08808b31-3acf-4113-8e95-e43ee51e594e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:41.947242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08808b31-3acf-4113-8e95-e43ee51e594e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:42.080486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-08808b31-3acf-4113-8e95-e43ee51e594e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:42.088412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-08808b31-3acf-4113-8e95-e43ee51e594e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.155231 Aug 01 15:47:42.088962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1019/1880] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:41 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:42.094350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ca296de8-7bb7-4391-a2ef-2792639f5264 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:42.096557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ca296de8-7bb7-4391-a2ef-2792639f5264 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:42.102276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ca296de8-7bb7-4391-a2ef-2792639f5264 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:42.102721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ca296de8-7bb7-4391-a2ef-2792639f5264 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:42.103481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ca296de8-7bb7-4391-a2ef-2792639f5264 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:42.103908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ca296de8-7bb7-4391-a2ef-2792639f5264 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:42.134149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ca296de8-7bb7-4391-a2ef-2792639f5264 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Aug 01 15:47:42.134721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1020/1881] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:42 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:42.307569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-89da5d24-fe6f-4c98-b9db-52b0247fa635 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:42.308192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-89da5d24-fe6f-4c98-b9db-52b0247fa635 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:42.314207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89da5d24-fe6f-4c98-b9db-52b0247fa635 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:42.314671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89da5d24-fe6f-4c98-b9db-52b0247fa635 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:42.315442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89da5d24-fe6f-4c98-b9db-52b0247fa635 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:42.315884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89da5d24-fe6f-4c98-b9db-52b0247fa635 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:42.449540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-89da5d24-fe6f-4c98-b9db-52b0247fa635 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:42.458562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-89da5d24-fe6f-4c98-b9db-52b0247fa635 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.154799 Aug 01 15:47:42.459135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1021/1882] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:42 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:43.109694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-55bf837c-a1ad-4947-9a3f-3ba432a9500f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:43.110361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-55bf837c-a1ad-4947-9a3f-3ba432a9500f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:43.116935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55bf837c-a1ad-4947-9a3f-3ba432a9500f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:43.117383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55bf837c-a1ad-4947-9a3f-3ba432a9500f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:43.118179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55bf837c-a1ad-4947-9a3f-3ba432a9500f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:43.118618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55bf837c-a1ad-4947-9a3f-3ba432a9500f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:43.245581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-55bf837c-a1ad-4947-9a3f-3ba432a9500f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:43.253652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-55bf837c-a1ad-4947-9a3f-3ba432a9500f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.147851 Aug 01 15:47:43.254247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1022/1883] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:43 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:47:43.258791 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8f940f4c-dbea-4d94-a6b9-6f98dce20a1a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:43.260932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8f940f4c-dbea-4d94-a6b9-6f98dce20a1a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:43.268475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f940f4c-dbea-4d94-a6b9-6f98dce20a1a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:43.268997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f940f4c-dbea-4d94-a6b9-6f98dce20a1a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:43.270039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f940f4c-dbea-4d94-a6b9-6f98dce20a1a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:43.270624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f940f4c-dbea-4d94-a6b9-6f98dce20a1a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:43.300953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8f940f4c-dbea-4d94-a6b9-6f98dce20a1a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 Aug 01 15:47:43.301517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1023/1884] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:43 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:43.481191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-483fa235-9498-4808-b476-9df23a71b580 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:43.481815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-483fa235-9498-4808-b476-9df23a71b580 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:43.487910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-483fa235-9498-4808-b476-9df23a71b580 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:43.488356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-483fa235-9498-4808-b476-9df23a71b580 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:43.489117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-483fa235-9498-4808-b476-9df23a71b580 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:43.489549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-483fa235-9498-4808-b476-9df23a71b580 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:43.623211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-483fa235-9498-4808-b476-9df23a71b580 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:43.631579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-483fa235-9498-4808-b476-9df23a71b580 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.154238 Aug 01 15:47:43.632146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1024/1885] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:43 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:44.275795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3cfc5f72-e716-499a-b20d-60a611043030 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:44.276480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3cfc5f72-e716-499a-b20d-60a611043030 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:44.283706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cfc5f72-e716-499a-b20d-60a611043030 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:44.284241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cfc5f72-e716-499a-b20d-60a611043030 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:44.285011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cfc5f72-e716-499a-b20d-60a611043030 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:44.285454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cfc5f72-e716-499a-b20d-60a611043030 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:44.304085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:44.414462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3cfc5f72-e716-499a-b20d-60a611043030 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:44.423041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3cfc5f72-e716-499a-b20d-60a611043030 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.151227 Aug 01 15:47:44.423610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1025/1886] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:44 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:44.428548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0a308b11-88bb-44ea-8856-d2d3a1eea44b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:44.430755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0a308b11-88bb-44ea-8856-d2d3a1eea44b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:44.436736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a308b11-88bb-44ea-8856-d2d3a1eea44b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:44.437183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a308b11-88bb-44ea-8856-d2d3a1eea44b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:44.437964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a308b11-88bb-44ea-8856-d2d3a1eea44b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:44.438401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a308b11-88bb-44ea-8856-d2d3a1eea44b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:44.467911 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0a308b11-88bb-44ea-8856-d2d3a1eea44b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042813 Aug 01 15:47:44.468451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1026/1887] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:44 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:44.653219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8aff206c-f46d-448e-ab8f-268e5c529647 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:44.653824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8aff206c-f46d-448e-ab8f-268e5c529647 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:44.659949 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8aff206c-f46d-448e-ab8f-268e5c529647 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:44.660395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8aff206c-f46d-448e-ab8f-268e5c529647 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:44.661143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8aff206c-f46d-448e-ab8f-268e5c529647 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:44.661575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8aff206c-f46d-448e-ab8f-268e5c529647 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:44.793368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8aff206c-f46d-448e-ab8f-268e5c529647 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:44.801547 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8aff206c-f46d-448e-ab8f-268e5c529647 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.152205 Aug 01 15:47:44.802146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1027/1888] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:44 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:45.444295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-548d5f9d-11db-498a-8c03-f7cd58defc81 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:45.444962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-548d5f9d-11db-498a-8c03-f7cd58defc81 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:45.451612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-548d5f9d-11db-498a-8c03-f7cd58defc81 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:45.452058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-548d5f9d-11db-498a-8c03-f7cd58defc81 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:45.453335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-548d5f9d-11db-498a-8c03-f7cd58defc81 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:45.453777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-548d5f9d-11db-498a-8c03-f7cd58defc81 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:45.582473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-548d5f9d-11db-498a-8c03-f7cd58defc81 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:45.590352 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-548d5f9d-11db-498a-8c03-f7cd58defc81 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.149975 Aug 01 15:47:45.590924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1028/1889] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:45 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:45.596401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1a600f62-9374-40b9-9d08-9ddaac2c9ca7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:45.598510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1a600f62-9374-40b9-9d08-9ddaac2c9ca7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:45.604339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1a600f62-9374-40b9-9d08-9ddaac2c9ca7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:45.604793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1a600f62-9374-40b9-9d08-9ddaac2c9ca7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:45.605664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1a600f62-9374-40b9-9d08-9ddaac2c9ca7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:45.606040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1a600f62-9374-40b9-9d08-9ddaac2c9ca7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:45.634302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1a600f62-9374-40b9-9d08-9ddaac2c9ca7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042330 Aug 01 15:47:45.634851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1029/1890] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:45 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:45.823348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e1483ebf-454e-4711-b702-cd700adf3149 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:45.823909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e1483ebf-454e-4711-b702-cd700adf3149 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:45.830745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1483ebf-454e-4711-b702-cd700adf3149 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:45.831197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1483ebf-454e-4711-b702-cd700adf3149 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:45.831969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1483ebf-454e-4711-b702-cd700adf3149 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:45.832413 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1483ebf-454e-4711-b702-cd700adf3149 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:45.967135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e1483ebf-454e-4711-b702-cd700adf3149 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:45.979208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e1483ebf-454e-4711-b702-cd700adf3149 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.159526 Aug 01 15:47:45.980307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1030/1891] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:45 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:46.612786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-31c0756c-4465-4686-bdb6-43497d850c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:46.613457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-31c0756c-4465-4686-bdb6-43497d850c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:46.620041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31c0756c-4465-4686-bdb6-43497d850c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:46.620497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31c0756c-4465-4686-bdb6-43497d850c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:46.621269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31c0756c-4465-4686-bdb6-43497d850c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:46.621708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31c0756c-4465-4686-bdb6-43497d850c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:46.751388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-31c0756c-4465-4686-bdb6-43497d850c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:46.760038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-31c0756c-4465-4686-bdb6-43497d850c57 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.151261 Aug 01 15:47:46.760598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1031/1892] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:46 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:46.765152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-08b23f4d-c351-434a-a347-bce57035f756 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:46.767302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-08b23f4d-c351-434a-a347-bce57035f756 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:46.773097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08b23f4d-c351-434a-a347-bce57035f756 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:46.773555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08b23f4d-c351-434a-a347-bce57035f756 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:46.774368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08b23f4d-c351-434a-a347-bce57035f756 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:46.774819 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08b23f4d-c351-434a-a347-bce57035f756 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:46.803475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-08b23f4d-c351-434a-a347-bce57035f756 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041870 Aug 01 15:47:46.804030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1032/1893] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:46 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:47.004287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b48cba2a-47a4-4623-bf83-9a48df1d8796 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:47.004822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b48cba2a-47a4-4623-bf83-9a48df1d8796 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:47.010962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b48cba2a-47a4-4623-bf83-9a48df1d8796 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:47.011413 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b48cba2a-47a4-4623-bf83-9a48df1d8796 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:47.012178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b48cba2a-47a4-4623-bf83-9a48df1d8796 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:47.012621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b48cba2a-47a4-4623-bf83-9a48df1d8796 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:47.142466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b48cba2a-47a4-4623-bf83-9a48df1d8796 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:47.150083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b48cba2a-47a4-4623-bf83-9a48df1d8796 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.150321 Aug 01 15:47:47.150645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1033/1894] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:46 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:47.780565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b2cb2327-2ad0-4ba3-9480-c1f9b0a60a0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:47.781243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b2cb2327-2ad0-4ba3-9480-c1f9b0a60a0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:47.788668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2cb2327-2ad0-4ba3-9480-c1f9b0a60a0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:47.789119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2cb2327-2ad0-4ba3-9480-c1f9b0a60a0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:47.789913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2cb2327-2ad0-4ba3-9480-c1f9b0a60a0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:47.790345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2cb2327-2ad0-4ba3-9480-c1f9b0a60a0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:47.925113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b2cb2327-2ad0-4ba3-9480-c1f9b0a60a0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:47.933089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b2cb2327-2ad0-4ba3-9480-c1f9b0a60a0b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.156364 Aug 01 15:47:47.933660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1034/1895] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:47 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:47.938460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9f62cd57-b9c9-416a-9cd9-62e8921b660e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:47.941158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9f62cd57-b9c9-416a-9cd9-62e8921b660e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:47.947295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9f62cd57-b9c9-416a-9cd9-62e8921b660e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:47.947742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9f62cd57-b9c9-416a-9cd9-62e8921b660e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:47.948515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9f62cd57-b9c9-416a-9cd9-62e8921b660e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:47.948958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9f62cd57-b9c9-416a-9cd9-62e8921b660e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:47.979118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9f62cd57-b9c9-416a-9cd9-62e8921b660e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Aug 01 15:47:47.979675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1035/1896] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:47 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:48.171653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-00ea55b6-2652-4910-a37c-dbd386856204 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:48.172271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-00ea55b6-2652-4910-a37c-dbd386856204 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:48.178483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-00ea55b6-2652-4910-a37c-dbd386856204 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:48.178881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-00ea55b6-2652-4910-a37c-dbd386856204 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:48.179645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-00ea55b6-2652-4910-a37c-dbd386856204 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:48.180081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-00ea55b6-2652-4910-a37c-dbd386856204 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:48.311792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-00ea55b6-2652-4910-a37c-dbd386856204 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:48.319899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-00ea55b6-2652-4910-a37c-dbd386856204 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.152095 Aug 01 15:47:48.320470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1036/1897] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:48 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:48.954373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-64c9550d-6713-4bb6-97f9-f0133cd8e4ae tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:48.956126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-64c9550d-6713-4bb6-97f9-f0133cd8e4ae tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:48.962684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64c9550d-6713-4bb6-97f9-f0133cd8e4ae tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:48.963144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64c9550d-6713-4bb6-97f9-f0133cd8e4ae tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:48.963919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64c9550d-6713-4bb6-97f9-f0133cd8e4ae tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:48.964365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64c9550d-6713-4bb6-97f9-f0133cd8e4ae tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:49.096550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-64c9550d-6713-4bb6-97f9-f0133cd8e4ae tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:49.104538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-64c9550d-6713-4bb6-97f9-f0133cd8e4ae tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.154127 Aug 01 15:47:49.105149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1037/1898] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:48 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:49.109836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-684e288f-322f-4f95-9c3c-4630084e3890 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:49.112561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-684e288f-322f-4f95-9c3c-4630084e3890 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:49.118639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-684e288f-322f-4f95-9c3c-4630084e3890 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:49.119095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-684e288f-322f-4f95-9c3c-4630084e3890 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:49.119867 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-684e288f-322f-4f95-9c3c-4630084e3890 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:49.120307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-684e288f-322f-4f95-9c3c-4630084e3890 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:49.152213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-684e288f-322f-4f95-9c3c-4630084e3890 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046000 Aug 01 15:47:49.152781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1038/1899] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:49 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:49.341320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2e440ee8-63b7-44d6-a4ca-aa3d5e9ec05e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:49.341851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2e440ee8-63b7-44d6-a4ca-aa3d5e9ec05e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:49.348743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e440ee8-63b7-44d6-a4ca-aa3d5e9ec05e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:49.349194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e440ee8-63b7-44d6-a4ca-aa3d5e9ec05e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:49.349990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e440ee8-63b7-44d6-a4ca-aa3d5e9ec05e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:49.350430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e440ee8-63b7-44d6-a4ca-aa3d5e9ec05e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:49.487328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2e440ee8-63b7-44d6-a4ca-aa3d5e9ec05e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:49.495077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2e440ee8-63b7-44d6-a4ca-aa3d5e9ec05e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.157913 Aug 01 15:47:49.495645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1039/1900] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:49 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:50.126841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5f44cb5b-3b17-48be-a088-9ae3b69f868e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:50.128019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5f44cb5b-3b17-48be-a088-9ae3b69f868e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:50.135067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f44cb5b-3b17-48be-a088-9ae3b69f868e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:50.135524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f44cb5b-3b17-48be-a088-9ae3b69f868e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:50.136315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f44cb5b-3b17-48be-a088-9ae3b69f868e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:50.136761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f44cb5b-3b17-48be-a088-9ae3b69f868e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:50.267438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5f44cb5b-3b17-48be-a088-9ae3b69f868e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:50.276221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5f44cb5b-3b17-48be-a088-9ae3b69f868e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153236 Aug 01 15:47:50.276825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1040/1901] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:50 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:50.281459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-51328918-c953-4314-87f7-e91959ff10af tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:50.283639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-51328918-c953-4314-87f7-e91959ff10af tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:50.289700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-51328918-c953-4314-87f7-e91959ff10af tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:50.290183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-51328918-c953-4314-87f7-e91959ff10af tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:50.290970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-51328918-c953-4314-87f7-e91959ff10af tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:50.291414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-51328918-c953-4314-87f7-e91959ff10af tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:50.321239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-51328918-c953-4314-87f7-e91959ff10af tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043287 Aug 01 15:47:50.321728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1041/1902] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:50 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:50.516475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-35269b23-5a66-4b05-96e7-95f657b6969c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:50.517100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-35269b23-5a66-4b05-96e7-95f657b6969c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:50.523575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35269b23-5a66-4b05-96e7-95f657b6969c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:50.524017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35269b23-5a66-4b05-96e7-95f657b6969c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:50.524876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35269b23-5a66-4b05-96e7-95f657b6969c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:50.525314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35269b23-5a66-4b05-96e7-95f657b6969c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:50.529557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:50.661556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-35269b23-5a66-4b05-96e7-95f657b6969c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:50.670120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-35269b23-5a66-4b05-96e7-95f657b6969c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.157372 Aug 01 15:47:50.671051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1042/1903] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:50 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:51.297966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2d72b413-771c-432c-b92b-1df1ff51c9b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:51.298682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2d72b413-771c-432c-b92b-1df1ff51c9b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:51.305406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d72b413-771c-432c-b92b-1df1ff51c9b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:51.305858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d72b413-771c-432c-b92b-1df1ff51c9b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:51.306654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d72b413-771c-432c-b92b-1df1ff51c9b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:51.307093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d72b413-771c-432c-b92b-1df1ff51c9b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:51.438412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2d72b413-771c-432c-b92b-1df1ff51c9b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:51.447483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2d72b413-771c-432c-b92b-1df1ff51c9b4 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153370 Aug 01 15:47:51.448060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1043/1904] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:51 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:51.452792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7fec8d2c-8e2f-440a-aef4-af0f03698283 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:51.454989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7fec8d2c-8e2f-440a-aef4-af0f03698283 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:51.462082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fec8d2c-8e2f-440a-aef4-af0f03698283 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:51.462536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fec8d2c-8e2f-440a-aef4-af0f03698283 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:51.463316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fec8d2c-8e2f-440a-aef4-af0f03698283 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:51.463754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fec8d2c-8e2f-440a-aef4-af0f03698283 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:51.493774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7fec8d2c-8e2f-440a-aef4-af0f03698283 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Aug 01 15:47:51.494365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1044/1905] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:51 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:51.692448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-910ce59c-75b2-4f0b-a278-1c113a849fa2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:51.693103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-910ce59c-75b2-4f0b-a278-1c113a849fa2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:51.699465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-910ce59c-75b2-4f0b-a278-1c113a849fa2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:51.699914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-910ce59c-75b2-4f0b-a278-1c113a849fa2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:51.700689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-910ce59c-75b2-4f0b-a278-1c113a849fa2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:51.701132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-910ce59c-75b2-4f0b-a278-1c113a849fa2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:51.843250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-910ce59c-75b2-4f0b-a278-1c113a849fa2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:51.851772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-910ce59c-75b2-4f0b-a278-1c113a849fa2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.163770 Aug 01 15:47:51.852357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1045/1906] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:51 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:52.470502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-52b1622a-3a1a-403d-9bf8-da718a2be2ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:52.471179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-52b1622a-3a1a-403d-9bf8-da718a2be2ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:52.477910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52b1622a-3a1a-403d-9bf8-da718a2be2ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:52.478363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52b1622a-3a1a-403d-9bf8-da718a2be2ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:52.479124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52b1622a-3a1a-403d-9bf8-da718a2be2ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:52.479557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52b1622a-3a1a-403d-9bf8-da718a2be2ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:52.611391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-52b1622a-3a1a-403d-9bf8-da718a2be2ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:52.622838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-52b1622a-3a1a-403d-9bf8-da718a2be2ac tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.156524 Aug 01 15:47:52.623412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1046/1907] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:52 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:52.628523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-24b7e215-0357-4bb7-8116-969c5540eb00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:52.630656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-24b7e215-0357-4bb7-8116-969c5540eb00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:52.637443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24b7e215-0357-4bb7-8116-969c5540eb00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:52.637916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24b7e215-0357-4bb7-8116-969c5540eb00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:52.638683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24b7e215-0357-4bb7-8116-969c5540eb00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:52.639128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24b7e215-0357-4bb7-8116-969c5540eb00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:52.668255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-24b7e215-0357-4bb7-8116-969c5540eb00 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043828 Aug 01 15:47:52.668809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1047/1908] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:52 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:52.873621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cec08a3a-c409-4faa-a170-fbc9d740f82b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:52.874264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cec08a3a-c409-4faa-a170-fbc9d740f82b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:52.881097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cec08a3a-c409-4faa-a170-fbc9d740f82b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:52.881539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cec08a3a-c409-4faa-a170-fbc9d740f82b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:52.882319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cec08a3a-c409-4faa-a170-fbc9d740f82b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:52.882750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cec08a3a-c409-4faa-a170-fbc9d740f82b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:53.014620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cec08a3a-c409-4faa-a170-fbc9d740f82b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:53.022275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cec08a3a-c409-4faa-a170-fbc9d740f82b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.152409 Aug 01 15:47:53.022855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1048/1909] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:52 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:53.645675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5e187d71-90cd-4fb6-b64e-07674b592214 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:53.646421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5e187d71-90cd-4fb6-b64e-07674b592214 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:53.653049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e187d71-90cd-4fb6-b64e-07674b592214 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:53.653506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e187d71-90cd-4fb6-b64e-07674b592214 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:53.654312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e187d71-90cd-4fb6-b64e-07674b592214 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:53.654749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e187d71-90cd-4fb6-b64e-07674b592214 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:54.024176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5e187d71-90cd-4fb6-b64e-07674b592214 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:54.032220 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5e187d71-90cd-4fb6-b64e-07674b592214 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.391388 Aug 01 15:47:54.032794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1049/1910] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:53 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:54.038550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-11105cb1-986e-48b6-8c59-79c45b4b4556 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:54.039727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-11105cb1-986e-48b6-8c59-79c45b4b4556 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:54.045592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-11105cb1-986e-48b6-8c59-79c45b4b4556 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:54.046092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-11105cb1-986e-48b6-8c59-79c45b4b4556 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:54.046856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-11105cb1-986e-48b6-8c59-79c45b4b4556 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:54.047295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-11105cb1-986e-48b6-8c59-79c45b4b4556 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:54.077650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-11105cb1-986e-48b6-8c59-79c45b4b4556 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Aug 01 15:47:54.078358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1050/1911] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:54 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:54.083670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-74241f10-869f-4bbe-90e4-dc6de758c8f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:54.084406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-74241f10-869f-4bbe-90e4-dc6de758c8f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:54.093125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-74241f10-869f-4bbe-90e4-dc6de758c8f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:54.094219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-74241f10-869f-4bbe-90e4-dc6de758c8f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:54.095617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-74241f10-869f-4bbe-90e4-dc6de758c8f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:54.096407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-74241f10-869f-4bbe-90e4-dc6de758c8f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:54.234642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-74241f10-869f-4bbe-90e4-dc6de758c8f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:54.242678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-74241f10-869f-4bbe-90e4-dc6de758c8f8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.163278 Aug 01 15:47:54.243248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1051/1912] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:54 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:47:55.053842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ddb858d0-1c6c-48e3-91c5-ba2cfa716a88 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:55.054507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ddb858d0-1c6c-48e3-91c5-ba2cfa716a88 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:55.060679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ddb858d0-1c6c-48e3-91c5-ba2cfa716a88 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:55.061158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ddb858d0-1c6c-48e3-91c5-ba2cfa716a88 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:55.061964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ddb858d0-1c6c-48e3-91c5-ba2cfa716a88 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:55.062407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ddb858d0-1c6c-48e3-91c5-ba2cfa716a88 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:55.192174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ddb858d0-1c6c-48e3-91c5-ba2cfa716a88 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:55.200179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ddb858d0-1c6c-48e3-91c5-ba2cfa716a88 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.151441 Aug 01 15:47:55.200755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1052/1913] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:55 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:55.205823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5a3fab9f-bb26-42cc-8248-f91a0dc30d2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:55.207984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5a3fab9f-bb26-42cc-8248-f91a0dc30d2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:55.213836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a3fab9f-bb26-42cc-8248-f91a0dc30d2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:55.214340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a3fab9f-bb26-42cc-8248-f91a0dc30d2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:55.215129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a3fab9f-bb26-42cc-8248-f91a0dc30d2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:55.215554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a3fab9f-bb26-42cc-8248-f91a0dc30d2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:55.244727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5a3fab9f-bb26-42cc-8248-f91a0dc30d2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042962 Aug 01 15:47:55.245290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1053/1914] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:55 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:55.263434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b2db737b-53f5-4a4e-b617-905649dd5e3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:55.264049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b2db737b-53f5-4a4e-b617-905649dd5e3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:55.270706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2db737b-53f5-4a4e-b617-905649dd5e3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:55.271156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2db737b-53f5-4a4e-b617-905649dd5e3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:55.271923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2db737b-53f5-4a4e-b617-905649dd5e3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:55.272361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2db737b-53f5-4a4e-b617-905649dd5e3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:55.401261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b2db737b-53f5-4a4e-b617-905649dd5e3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:55.408954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b2db737b-53f5-4a4e-b617-905649dd5e3a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.149157 Aug 01 15:47:55.409522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1054/1915] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:55 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:56.222611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-09bf610f-74f3-4013-a5c2-c6b4285edfaa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:56.223334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-09bf610f-74f3-4013-a5c2-c6b4285edfaa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:56.230216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09bf610f-74f3-4013-a5c2-c6b4285edfaa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:56.230689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09bf610f-74f3-4013-a5c2-c6b4285edfaa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:56.231450 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09bf610f-74f3-4013-a5c2-c6b4285edfaa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:56.231892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09bf610f-74f3-4013-a5c2-c6b4285edfaa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:56.445003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-09bf610f-74f3-4013-a5c2-c6b4285edfaa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:56.453342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-09bf610f-74f3-4013-a5c2-c6b4285edfaa tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.234856 Aug 01 15:47:56.453845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1055/1916] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:56 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:56.459328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2a4c5305-791a-4bd3-bdaa-6b5ec5818ce3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:56.461360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2a4c5305-791a-4bd3-bdaa-6b5ec5818ce3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:56.464275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:56.468407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a4c5305-791a-4bd3-bdaa-6b5ec5818ce3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:56.468857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a4c5305-791a-4bd3-bdaa-6b5ec5818ce3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:56.469920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a4c5305-791a-4bd3-bdaa-6b5ec5818ce3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:56.470450 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a4c5305-791a-4bd3-bdaa-6b5ec5818ce3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:56.500079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2a4c5305-791a-4bd3-bdaa-6b5ec5818ce3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045175 Aug 01 15:47:56.500751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1056/1917] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:56 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:56.506365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f13d36b1-a2b3-416b-a1f9-5ee562ccd359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:56.506969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f13d36b1-a2b3-416b-a1f9-5ee562ccd359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:56.512840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f13d36b1-a2b3-416b-a1f9-5ee562ccd359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:56.513294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f13d36b1-a2b3-416b-a1f9-5ee562ccd359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:56.514094 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f13d36b1-a2b3-416b-a1f9-5ee562ccd359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:56.514533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f13d36b1-a2b3-416b-a1f9-5ee562ccd359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:56.728051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f13d36b1-a2b3-416b-a1f9-5ee562ccd359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:56.735541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f13d36b1-a2b3-416b-a1f9-5ee562ccd359 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.233927 Aug 01 15:47:56.736109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1057/1918] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:56 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:47:57.478165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-44071031-3f10-4075-84be-7cb8a9cf17bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:57.478824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-44071031-3f10-4075-84be-7cb8a9cf17bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:57.485379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-44071031-3f10-4075-84be-7cb8a9cf17bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:57.485821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-44071031-3f10-4075-84be-7cb8a9cf17bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:57.486678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-44071031-3f10-4075-84be-7cb8a9cf17bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:57.487117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-44071031-3f10-4075-84be-7cb8a9cf17bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:57.622839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-44071031-3f10-4075-84be-7cb8a9cf17bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:57.626426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:47:57.632637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-44071031-3f10-4075-84be-7cb8a9cf17bf tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.158335 Aug 01 15:47:57.633232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1058/1919] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:57 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:57.638097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aa99a3be-7188-4978-b5f9-a3b93847d496 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:57.640260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aa99a3be-7188-4978-b5f9-a3b93847d496 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:57.647155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa99a3be-7188-4978-b5f9-a3b93847d496 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:57.647604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa99a3be-7188-4978-b5f9-a3b93847d496 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:57.648387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa99a3be-7188-4978-b5f9-a3b93847d496 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:57.648825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa99a3be-7188-4978-b5f9-a3b93847d496 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:57.679344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aa99a3be-7188-4978-b5f9-a3b93847d496 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Aug 01 15:47:57.679926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1059/1920] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:57 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:57.757185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2bd3a8e8-08fd-4a5c-8e47-79af8da0f4e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:57.757710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2bd3a8e8-08fd-4a5c-8e47-79af8da0f4e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:57.764035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bd3a8e8-08fd-4a5c-8e47-79af8da0f4e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:57.764496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bd3a8e8-08fd-4a5c-8e47-79af8da0f4e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:57.765271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bd3a8e8-08fd-4a5c-8e47-79af8da0f4e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:57.765709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2bd3a8e8-08fd-4a5c-8e47-79af8da0f4e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:57.910410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2bd3a8e8-08fd-4a5c-8e47-79af8da0f4e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:57.918249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2bd3a8e8-08fd-4a5c-8e47-79af8da0f4e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.165022 Aug 01 15:47:57.918817 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1060/1921] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:57 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:58.655841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c55eb608-d404-471d-82f7-e1719eb12906 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:58.656550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c55eb608-d404-471d-82f7-e1719eb12906 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:58.663331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c55eb608-d404-471d-82f7-e1719eb12906 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:58.663789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c55eb608-d404-471d-82f7-e1719eb12906 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:58.664577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c55eb608-d404-471d-82f7-e1719eb12906 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:58.665010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c55eb608-d404-471d-82f7-e1719eb12906 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:58.802926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c55eb608-d404-471d-82f7-e1719eb12906 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:47:58.811027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c55eb608-d404-471d-82f7-e1719eb12906 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.160068 Aug 01 15:47:58.811601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1061/1922] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:47:58 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:47:58.816567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e0e61257-4f0a-4d5b-804c-3126a77b0e61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:58.818737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e0e61257-4f0a-4d5b-804c-3126a77b0e61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:58.824816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e0e61257-4f0a-4d5b-804c-3126a77b0e61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:58.825267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e0e61257-4f0a-4d5b-804c-3126a77b0e61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:58.826077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e0e61257-4f0a-4d5b-804c-3126a77b0e61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:58.826519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e0e61257-4f0a-4d5b-804c-3126a77b0e61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:58.857258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e0e61257-4f0a-4d5b-804c-3126a77b0e61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Aug 01 15:47:58.857824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1062/1923] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:47:58 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:47:58.863082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-08d70e0d-5cfd-45b4-a319-85104d874fa5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:47:58.863583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-08d70e0d-5cfd-45b4-a319-85104d874fa5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:47:58.869667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08d70e0d-5cfd-45b4-a319-85104d874fa5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:58.870154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08d70e0d-5cfd-45b4-a319-85104d874fa5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:47:58.870973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08d70e0d-5cfd-45b4-a319-85104d874fa5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:47:58.871367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08d70e0d-5cfd-45b4-a319-85104d874fa5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:48:00.930895 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:48:00.931604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:48:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf (ip 10.222.0.83) !!! Aug 01 15:48:08.867133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=14 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:08.893543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=28 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:48:59.212572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:48:59.213199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:48:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf (ip 10.222.0.83) !!! Aug 01 15:48:59.300526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-70c2ffc8-3cc2-4f2e-8afb-41b71d95a646 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4acc9ce8-5720-4fd2-a04d-8b6fcdd19501) Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-70c2ffc8-3cc2-4f2e-8afb-41b71d95a646 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Request method failure captured: Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf HTTP/1.1 Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_K53ddQWvF8bwwX7kPrpmXB-Ft4gpk37Z_xQqLmOiw7qzQc0ix5_nT8dQWyuY23pJ-Kp8DZ5Muml7xjPBHUc8LoO6PfskGPOrUZ9RKz2fqvze9FjRell81KUxGu4MHB1g-dHKhXvmVsu1ur8xU-2fAKxciMJycj3fu7Jp1bTJHl6wc Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:48:59.302844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:48:59.304447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/38f80d210cce4a41af527ac134deba93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_38f80d210cce4a41af527ac134deba93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}] Aug 01 15:48:59.304447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:48:59.304447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:48:59.304447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:48:59.304447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:48:59.304447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:48:59.304447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:48:59.304447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 77cb30fae1184064a8c4f822d4d31096 Aug 01 15:48:59.304447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:48:59.304447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4acc9ce8-5720-4fd2-a04d-8b6fcdd19501) Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'server_id': '93144385-4cac-4970-9814-564a351af373', 'id': 'f418e61d-d2e6-4530-844c-fab840a592cf'} Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 01 15:48:59.305140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4acc9ce8-5720-4fd2-a04d-8b6fcdd19501) Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:48:59.307172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4acc9ce8-5720-4fd2-a04d-8b6fcdd19501) Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:48:59.308394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4acc9ce8-5720-4fd2-a04d-8b6fcdd19501) Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:48:59.310727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4acc9ce8-5720-4fd2-a04d-8b6fcdd19501) Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4acc9ce8-5720-4fd2-a04d-8b6fcdd19501) Aug 01 15:48:59.312215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:48:59.315086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-70c2ffc8-3cc2-4f2e-8afb-41b71d95a646 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4acc9ce8-5720-4fd2-a04d-8b6fcdd19501) {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:48:59.315086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-70c2ffc8-3cc2-4f2e-8afb-41b71d95a646 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf" status: 400 len: 269 microversion: 2.1 time: 120.159804 Aug 01 15:48:59.315086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 862/1924] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 1 15:46:59 2022] DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf => generated 269 bytes in 120161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:48:59.315086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3469910a-d161-499e-8d21-cf26a3e8d402 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:48:59.315573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3469910a-d161-499e-8d21-cf26a3e8d402 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:48:59.319238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3469910a-d161-499e-8d21-cf26a3e8d402 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:48:59.319692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3469910a-d161-499e-8d21-cf26a3e8d402 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:48:59.320473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3469910a-d161-499e-8d21-cf26a3e8d402 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:48:59.320963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3469910a-d161-499e-8d21-cf26a3e8d402 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:48:59.467120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3469910a-d161-499e-8d21-cf26a3e8d402 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:48:59.475065 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3469910a-d161-499e-8d21-cf26a3e8d402 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.168904 Aug 01 15:48:59.475625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 863/1925] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:48:59 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:48:59.480082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4431c577-5ed2-44fd-acd9-410bb50bfab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:48:59.480682 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4431c577-5ed2-44fd-acd9-410bb50bfab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:48:59.487179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4431c577-5ed2-44fd-acd9-410bb50bfab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:48:59.487625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4431c577-5ed2-44fd-acd9-410bb50bfab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:48:59.488386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4431c577-5ed2-44fd-acd9-410bb50bfab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:48:59.488816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4431c577-5ed2-44fd-acd9-410bb50bfab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:48:59.628914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4431c577-5ed2-44fd-acd9-410bb50bfab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:48:59.637262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4431c577-5ed2-44fd-acd9-410bb50bfab5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.160572 Aug 01 15:48:59.637840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 864/1926] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:48:59 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:48:59.642498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-44011a2a-99e8-4393-a2e4-dc4d711eb308 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:48:59.644744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-44011a2a-99e8-4393-a2e4-dc4d711eb308 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:48:59.651137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44011a2a-99e8-4393-a2e4-dc4d711eb308 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:48:59.651462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44011a2a-99e8-4393-a2e4-dc4d711eb308 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:48:59.652232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44011a2a-99e8-4393-a2e4-dc4d711eb308 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:48:59.652661 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-44011a2a-99e8-4393-a2e4-dc4d711eb308 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:48:59.683547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-44011a2a-99e8-4393-a2e4-dc4d711eb308 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Aug 01 15:48:59.684165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 865/1927] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:48:59 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:48:59.689530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a10bc1cd-f4b2-40d7-866b-e86861b84144 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:48:59.690063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a10bc1cd-f4b2-40d7-866b-e86861b84144 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:48:59.696341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a10bc1cd-f4b2-40d7-866b-e86861b84144 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:48:59.696792 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a10bc1cd-f4b2-40d7-866b-e86861b84144 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:48:59.697565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a10bc1cd-f4b2-40d7-866b-e86861b84144 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:48:59.698030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a10bc1cd-f4b2-40d7-866b-e86861b84144 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:48:59.767582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.objects.instance [None req-08d70e0d-5cfd-45b4-a319-85104d874fa5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lazy-loading 'services' on Instance uuid 93144385-4cac-4970-9814-564a351af373 {{(pid=124526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:49:06.205137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:49:06.205823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:49:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf (ip 10.222.0.83) !!! Aug 01 15:49:09.693787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=8 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:09.720669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=22 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:09.772234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=4 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:19.468859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-a10bc1cd-f4b2-40d7-866b-e86861b84144 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lazy-loading 'services' on Instance uuid 93144385-4cac-4970-9814-564a351af373 {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:49:19.497418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-08d70e0d-5cfd-45b4-a319-85104d874fa5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79ed345d-e5b6-495c-a00f-ab1a0dc74f35) Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-08d70e0d-5cfd-45b4-a319-85104d874fa5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Request method failure captured: Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf HTTP/1.1 Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_K53ddQWvF8bwwX7kPrpmXB-Ft4gpk37Z_xQqLmOiw7qzQc0ix5_nT8dQWyuY23pJ-Kp8DZ5Muml7xjPBHUc8LoO6PfskGPOrUZ9RKz2fqvze9FjRell81KUxGu4MHB1g-dHKhXvmVsu1ur8xU-2fAKxciMJycj3fu7Jp1bTJHl6wc Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 15:49:19.500589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 15:49:19.503049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/38f80d210cce4a41af527ac134deba93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_38f80d210cce4a41af527ac134deba93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}] Aug 01 15:49:19.503049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:49:19.503049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:49:19.503049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:49:19.503049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:49:19.503049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 15:49:19.503049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 15:49:19.503049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: 77cb30fae1184064a8c4f822d4d31096 Aug 01 15:49:19.503049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:49:19.503049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79ed345d-e5b6-495c-a00f-ab1a0dc74f35) Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'server_id': '93144385-4cac-4970-9814-564a351af373', 'id': 'f418e61d-d2e6-4530-844c-fab840a592cf'} Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 01 15:49:19.503877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79ed345d-e5b6-495c-a00f-ab1a0dc74f35) Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:49:19.505004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79ed345d-e5b6-495c-a00f-ab1a0dc74f35) Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:49:19.506254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79ed345d-e5b6-495c-a00f-ab1a0dc74f35) Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:49:19.507434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79ed345d-e5b6-495c-a00f-ab1a0dc74f35) Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79ed345d-e5b6-495c-a00f-ab1a0dc74f35) Aug 01 15:49:19.508586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:49:19.509692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-08d70e0d-5cfd-45b4-a319-85104d874fa5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79ed345d-e5b6-495c-a00f-ab1a0dc74f35) {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:49:19.509692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-08d70e0d-5cfd-45b4-a319-85104d874fa5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf" status: 400 len: 269 microversion: 2.1 time: 80.643595 Aug 01 15:49:19.509692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1063/1928] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 1 15:47:58 2022] DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf => generated 269 bytes in 80645 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:49:19.509692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-df42c1c0-4078-4aa3-be9a-4b8aed9d1bdf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:19.511394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-df42c1c0-4078-4aa3-be9a-4b8aed9d1bdf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:19.515344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df42c1c0-4078-4aa3-be9a-4b8aed9d1bdf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:19.515841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df42c1c0-4078-4aa3-be9a-4b8aed9d1bdf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:19.517450 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df42c1c0-4078-4aa3-be9a-4b8aed9d1bdf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:19.517796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-df42c1c0-4078-4aa3-be9a-4b8aed9d1bdf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:19.664963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-df42c1c0-4078-4aa3-be9a-4b8aed9d1bdf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:19.673617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-df42c1c0-4078-4aa3-be9a-4b8aed9d1bdf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.169632 Aug 01 15:49:19.674219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1064/1929] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:19 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:49:19.678751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8f8dea3c-c100-4b6c-ac53-36ddcf3817e5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:19.679360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8f8dea3c-c100-4b6c-ac53-36ddcf3817e5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:19.685821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f8dea3c-c100-4b6c-ac53-36ddcf3817e5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:19.686502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f8dea3c-c100-4b6c-ac53-36ddcf3817e5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:19.687272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f8dea3c-c100-4b6c-ac53-36ddcf3817e5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:19.687710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f8dea3c-c100-4b6c-ac53-36ddcf3817e5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:19.837032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f8dea3c-c100-4b6c-ac53-36ddcf3817e5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:19.845814 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8f8dea3c-c100-4b6c-ac53-36ddcf3817e5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.170544 Aug 01 15:49:19.846446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1065/1930] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:19 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:49:19.857465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a7416569-68a6-42dd-8a58-4af0af1eca72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:19.862493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a7416569-68a6-42dd-8a58-4af0af1eca72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:19.869015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a7416569-68a6-42dd-8a58-4af0af1eca72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:19.869552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a7416569-68a6-42dd-8a58-4af0af1eca72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:19.870449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a7416569-68a6-42dd-8a58-4af0af1eca72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:19.870960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a7416569-68a6-42dd-8a58-4af0af1eca72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:19.904724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a7416569-68a6-42dd-8a58-4af0af1eca72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057151 Aug 01 15:49:19.905663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1066/1931] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:19 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:20.695649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-100d8c07-6681-4c0f-a66d-ee9e1d89090e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:20.696370 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-100d8c07-6681-4c0f-a66d-ee9e1d89090e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:20.702742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-100d8c07-6681-4c0f-a66d-ee9e1d89090e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:20.703188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-100d8c07-6681-4c0f-a66d-ee9e1d89090e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:20.704479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-100d8c07-6681-4c0f-a66d-ee9e1d89090e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:20.704913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-100d8c07-6681-4c0f-a66d-ee9e1d89090e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:20.853428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-100d8c07-6681-4c0f-a66d-ee9e1d89090e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:20.861737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-100d8c07-6681-4c0f-a66d-ee9e1d89090e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.169848 Aug 01 15:49:20.862369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1067/1932] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:20 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:20.880725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bf0a53a1-2c4b-4099-9706-bfaa17f3054c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:20.881346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bf0a53a1-2c4b-4099-9706-bfaa17f3054c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:20.887630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf0a53a1-2c4b-4099-9706-bfaa17f3054c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:20.888083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf0a53a1-2c4b-4099-9706-bfaa17f3054c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:20.888898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf0a53a1-2c4b-4099-9706-bfaa17f3054c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:20.889286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf0a53a1-2c4b-4099-9706-bfaa17f3054c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:21.055448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bf0a53a1-2c4b-4099-9706-bfaa17f3054c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:21.064707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bf0a53a1-2c4b-4099-9706-bfaa17f3054c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.188575 Aug 01 15:49:21.065305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1068/1933] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:20 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:21.070597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b662298f-ea20-4dc2-b0cc-f2fc5854c360 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:21.072912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b662298f-ea20-4dc2-b0cc-f2fc5854c360 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:21.080357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b662298f-ea20-4dc2-b0cc-f2fc5854c360 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:21.080804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b662298f-ea20-4dc2-b0cc-f2fc5854c360 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:21.081591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b662298f-ea20-4dc2-b0cc-f2fc5854c360 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:21.082071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b662298f-ea20-4dc2-b0cc-f2fc5854c360 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:21.116310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b662298f-ea20-4dc2-b0cc-f2fc5854c360 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049753 Aug 01 15:49:21.116885 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1069/1934] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:21 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:21.825546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:49:21.826446 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:49:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf (ip 10.222.0.83) !!! Aug 01 15:49:21.885305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f73e238f-fca6-4d2b-82c0-b9b601ffb86a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:21.885937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f73e238f-fca6-4d2b-82c0-b9b601ffb86a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:21.893079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f73e238f-fca6-4d2b-82c0-b9b601ffb86a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:21.893534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f73e238f-fca6-4d2b-82c0-b9b601ffb86a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:21.894335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f73e238f-fca6-4d2b-82c0-b9b601ffb86a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:21.894777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f73e238f-fca6-4d2b-82c0-b9b601ffb86a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:22.041466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f73e238f-fca6-4d2b-82c0-b9b601ffb86a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:22.049598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f73e238f-fca6-4d2b-82c0-b9b601ffb86a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.168358 Aug 01 15:49:22.050205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1070/1935] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:21 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:22.090347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-14f8c2da-535a-40e1-961c-8deb74446be9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:22.090879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-14f8c2da-535a-40e1-961c-8deb74446be9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:22.097168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14f8c2da-535a-40e1-961c-8deb74446be9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:22.097641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14f8c2da-535a-40e1-961c-8deb74446be9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:22.098425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14f8c2da-535a-40e1-961c-8deb74446be9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:22.098854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14f8c2da-535a-40e1-961c-8deb74446be9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:22.235669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-14f8c2da-535a-40e1-961c-8deb74446be9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:22.243811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-14f8c2da-535a-40e1-961c-8deb74446be9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.157505 Aug 01 15:49:22.244376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1071/1936] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:22 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:22.249019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-261f760f-e700-4b47-b1e5-64b423ea44cd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:22.251875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-261f760f-e700-4b47-b1e5-64b423ea44cd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:22.258197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-261f760f-e700-4b47-b1e5-64b423ea44cd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:22.258671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-261f760f-e700-4b47-b1e5-64b423ea44cd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:22.259452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-261f760f-e700-4b47-b1e5-64b423ea44cd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:22.259890 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-261f760f-e700-4b47-b1e5-64b423ea44cd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:22.289710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-261f760f-e700-4b47-b1e5-64b423ea44cd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044298 Aug 01 15:49:22.290299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1072/1937] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:22 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:22.776818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:49:22.776818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:49:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:49:23.070653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-57860fea-a922-482e-8565-553da60e752d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:23.071274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-57860fea-a922-482e-8565-553da60e752d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:23.078142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-57860fea-a922-482e-8565-553da60e752d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:23.078599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-57860fea-a922-482e-8565-553da60e752d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:23.080104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-57860fea-a922-482e-8565-553da60e752d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:23.080636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-57860fea-a922-482e-8565-553da60e752d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:23.216179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-57860fea-a922-482e-8565-553da60e752d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:23.224089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-57860fea-a922-482e-8565-553da60e752d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.157329 Aug 01 15:49:23.224693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1073/1938] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:23 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:23.265870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-52de3b74-cc0e-4c23-83d6-cdaa12a47368 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:23.267094 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-52de3b74-cc0e-4c23-83d6-cdaa12a47368 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:23.273194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52de3b74-cc0e-4c23-83d6-cdaa12a47368 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:23.273642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52de3b74-cc0e-4c23-83d6-cdaa12a47368 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:23.274447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52de3b74-cc0e-4c23-83d6-cdaa12a47368 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:23.274887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52de3b74-cc0e-4c23-83d6-cdaa12a47368 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:23.408319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-52de3b74-cc0e-4c23-83d6-cdaa12a47368 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:23.416369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-52de3b74-cc0e-4c23-83d6-cdaa12a47368 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.154464 Aug 01 15:49:23.416930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1074/1939] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:23 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:23.421527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bfccac35-9eb1-4916-94bf-8f9f7645c2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:23.424230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bfccac35-9eb1-4916-94bf-8f9f7645c2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:23.431871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bfccac35-9eb1-4916-94bf-8f9f7645c2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:23.431871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bfccac35-9eb1-4916-94bf-8f9f7645c2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:23.432382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bfccac35-9eb1-4916-94bf-8f9f7645c2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:23.432694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bfccac35-9eb1-4916-94bf-8f9f7645c2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:23.466130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bfccac35-9eb1-4916-94bf-8f9f7645c2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048049 Aug 01 15:49:23.466697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1075/1940] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:23 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:24.245185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1891c198-82a3-4ace-9d98-375d0d5c7053 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:24.245844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1891c198-82a3-4ace-9d98-375d0d5c7053 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:24.252712 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1891c198-82a3-4ace-9d98-375d0d5c7053 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:24.253206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1891c198-82a3-4ace-9d98-375d0d5c7053 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:24.254039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1891c198-82a3-4ace-9d98-375d0d5c7053 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:24.254511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1891c198-82a3-4ace-9d98-375d0d5c7053 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:24.387974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1891c198-82a3-4ace-9d98-375d0d5c7053 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:24.396152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1891c198-82a3-4ace-9d98-375d0d5c7053 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.154809 Aug 01 15:49:24.396717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1076/1941] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:24 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:24.438683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aaff510f-88df-4871-b121-0c2989deefa6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:24.439297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aaff510f-88df-4871-b121-0c2989deefa6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:24.445274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aaff510f-88df-4871-b121-0c2989deefa6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:24.445716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aaff510f-88df-4871-b121-0c2989deefa6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:24.446507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aaff510f-88df-4871-b121-0c2989deefa6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:24.446944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aaff510f-88df-4871-b121-0c2989deefa6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:24.580735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aaff510f-88df-4871-b121-0c2989deefa6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:24.588859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aaff510f-88df-4871-b121-0c2989deefa6 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153782 Aug 01 15:49:24.589354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1077/1942] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:24 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:24.595314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eec2a480-15c5-4f75-a5a4-53cac1350ac3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:24.598554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eec2a480-15c5-4f75-a5a4-53cac1350ac3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:24.605108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eec2a480-15c5-4f75-a5a4-53cac1350ac3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:24.605554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eec2a480-15c5-4f75-a5a4-53cac1350ac3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:24.606345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eec2a480-15c5-4f75-a5a4-53cac1350ac3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:24.606781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eec2a480-15c5-4f75-a5a4-53cac1350ac3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:24.639424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eec2a480-15c5-4f75-a5a4-53cac1350ac3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049005 Aug 01 15:49:24.640009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1078/1943] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:24 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:25.418031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8a4c7c0b-995b-4aa0-9ec9-81a9a3b33579 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:25.418687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8a4c7c0b-995b-4aa0-9ec9-81a9a3b33579 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:25.425186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a4c7c0b-995b-4aa0-9ec9-81a9a3b33579 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:25.425640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a4c7c0b-995b-4aa0-9ec9-81a9a3b33579 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:25.426446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a4c7c0b-995b-4aa0-9ec9-81a9a3b33579 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:25.426890 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a4c7c0b-995b-4aa0-9ec9-81a9a3b33579 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:25.559577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8a4c7c0b-995b-4aa0-9ec9-81a9a3b33579 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:25.567671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8a4c7c0b-995b-4aa0-9ec9-81a9a3b33579 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.153613 Aug 01 15:49:25.568236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1079/1944] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:25 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:25.609239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-67e85a7e-d53d-475f-a271-e2c77e7a0d55 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:25.609922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-67e85a7e-d53d-475f-a271-e2c77e7a0d55 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:25.615965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67e85a7e-d53d-475f-a271-e2c77e7a0d55 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:25.616416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67e85a7e-d53d-475f-a271-e2c77e7a0d55 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:25.617181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67e85a7e-d53d-475f-a271-e2c77e7a0d55 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:25.617618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67e85a7e-d53d-475f-a271-e2c77e7a0d55 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:25.636032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:25.758237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-67e85a7e-d53d-475f-a271-e2c77e7a0d55 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:25.770148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-67e85a7e-d53d-475f-a271-e2c77e7a0d55 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.164619 Aug 01 15:49:25.770728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1080/1945] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:25 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:25.775403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8fc33e65-d23d-4505-a073-eb657279e7dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:25.777549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8fc33e65-d23d-4505-a073-eb657279e7dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:25.784763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fc33e65-d23d-4505-a073-eb657279e7dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:25.785272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fc33e65-d23d-4505-a073-eb657279e7dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:25.786181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fc33e65-d23d-4505-a073-eb657279e7dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:25.786625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fc33e65-d23d-4505-a073-eb657279e7dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:25.816891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8fc33e65-d23d-4505-a073-eb657279e7dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045106 Aug 01 15:49:25.817449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1081/1946] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:25 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:26.588637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-441f64e6-f901-40e9-915e-082e3f1079cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:26.589292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-441f64e6-f901-40e9-915e-082e3f1079cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:26.596721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-441f64e6-f901-40e9-915e-082e3f1079cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:26.597160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-441f64e6-f901-40e9-915e-082e3f1079cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:26.597950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-441f64e6-f901-40e9-915e-082e3f1079cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:26.598385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-441f64e6-f901-40e9-915e-082e3f1079cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:26.736652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-441f64e6-f901-40e9-915e-082e3f1079cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:26.747885 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-441f64e6-f901-40e9-915e-082e3f1079cd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.162932 Aug 01 15:49:26.748472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1082/1947] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:26 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:26.792087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-76352eb0-6207-4c3b-a863-2419e65bb6f7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:26.792703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-76352eb0-6207-4c3b-a863-2419e65bb6f7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:26.798911 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76352eb0-6207-4c3b-a863-2419e65bb6f7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:26.799363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76352eb0-6207-4c3b-a863-2419e65bb6f7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:26.800132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76352eb0-6207-4c3b-a863-2419e65bb6f7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:26.800574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76352eb0-6207-4c3b-a863-2419e65bb6f7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:26.936910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-76352eb0-6207-4c3b-a863-2419e65bb6f7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:26.945563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-76352eb0-6207-4c3b-a863-2419e65bb6f7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.157246 Aug 01 15:49:26.946205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1083/1948] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:26 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:26.950866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-541402fb-5388-41e2-99f5-a4fde86e1430 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:26.953121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-541402fb-5388-41e2-99f5-a4fde86e1430 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:26.959795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-541402fb-5388-41e2-99f5-a4fde86e1430 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:26.960247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-541402fb-5388-41e2-99f5-a4fde86e1430 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:26.961016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-541402fb-5388-41e2-99f5-a4fde86e1430 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:26.961453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-541402fb-5388-41e2-99f5-a4fde86e1430 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:26.992034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-541402fb-5388-41e2-99f5-a4fde86e1430 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Aug 01 15:49:26.992595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1084/1949] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:26 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:27.769406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-007a5d89-641c-42fe-8fd5-bcc577ef822d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:27.770105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-007a5d89-641c-42fe-8fd5-bcc577ef822d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:27.776813 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-007a5d89-641c-42fe-8fd5-bcc577ef822d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:27.777269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-007a5d89-641c-42fe-8fd5-bcc577ef822d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:27.778068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-007a5d89-641c-42fe-8fd5-bcc577ef822d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:27.778509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-007a5d89-641c-42fe-8fd5-bcc577ef822d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:27.916537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-007a5d89-641c-42fe-8fd5-bcc577ef822d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:27.924875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-007a5d89-641c-42fe-8fd5-bcc577ef822d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.160040 Aug 01 15:49:27.925453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1085/1950] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:27 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:27.966611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4a16dba1-6113-4b11-a845-6c1046b0c177 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:27.967142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4a16dba1-6113-4b11-a845-6c1046b0c177 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:27.973583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a16dba1-6113-4b11-a845-6c1046b0c177 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:27.974068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a16dba1-6113-4b11-a845-6c1046b0c177 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:27.974844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a16dba1-6113-4b11-a845-6c1046b0c177 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:27.975285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a16dba1-6113-4b11-a845-6c1046b0c177 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:28.110572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4a16dba1-6113-4b11-a845-6c1046b0c177 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:28.118763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4a16dba1-6113-4b11-a845-6c1046b0c177 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.156068 Aug 01 15:49:28.119334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1086/1951] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:27 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:28.123966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-662b2278-8999-4617-9449-326f925ffa72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:28.127091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-662b2278-8999-4617-9449-326f925ffa72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:28.133274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-662b2278-8999-4617-9449-326f925ffa72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:28.133722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-662b2278-8999-4617-9449-326f925ffa72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:28.134520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-662b2278-8999-4617-9449-326f925ffa72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:28.134949 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-662b2278-8999-4617-9449-326f925ffa72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:28.163518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-662b2278-8999-4617-9449-326f925ffa72 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 Aug 01 15:49:28.164077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1087/1952] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:28 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:28.946820 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e61f2ee4-0546-4c6c-beff-92895e1b876a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:28.947500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e61f2ee4-0546-4c6c-beff-92895e1b876a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:28.954092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e61f2ee4-0546-4c6c-beff-92895e1b876a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:28.954544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e61f2ee4-0546-4c6c-beff-92895e1b876a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:28.955308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e61f2ee4-0546-4c6c-beff-92895e1b876a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:28.955743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e61f2ee4-0546-4c6c-beff-92895e1b876a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:29.100758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e61f2ee4-0546-4c6c-beff-92895e1b876a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:29.108443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e61f2ee4-0546-4c6c-beff-92895e1b876a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.165504 Aug 01 15:49:29.109015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1088/1953] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:28 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:29.140507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aa143cab-cc42-47fe-a8b1-6467450e126e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:29.141118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aa143cab-cc42-47fe-a8b1-6467450e126e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:29.147368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa143cab-cc42-47fe-a8b1-6467450e126e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:29.147813 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa143cab-cc42-47fe-a8b1-6467450e126e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:29.148577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa143cab-cc42-47fe-a8b1-6467450e126e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:29.149009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa143cab-cc42-47fe-a8b1-6467450e126e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:29.281303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aa143cab-cc42-47fe-a8b1-6467450e126e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:29.290087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aa143cab-cc42-47fe-a8b1-6467450e126e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153315 Aug 01 15:49:29.290654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1089/1954] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:29 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:29.295192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6ca33bcd-8c44-4101-a863-ebdb8f6c8910 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:29.297936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6ca33bcd-8c44-4101-a863-ebdb8f6c8910 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:29.303947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ca33bcd-8c44-4101-a863-ebdb8f6c8910 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:29.304398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ca33bcd-8c44-4101-a863-ebdb8f6c8910 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:29.305166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ca33bcd-8c44-4101-a863-ebdb8f6c8910 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:29.305605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ca33bcd-8c44-4101-a863-ebdb8f6c8910 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:29.334762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6ca33bcd-8c44-4101-a863-ebdb8f6c8910 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043090 Aug 01 15:49:29.335323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1090/1955] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:29 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:29.473861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=4 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:30.130715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7b1503c5-6b72-4b82-95f4-15d2495982b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:30.131330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7b1503c5-6b72-4b82-95f4-15d2495982b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:30.138026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b1503c5-6b72-4b82-95f4-15d2495982b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:30.138479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b1503c5-6b72-4b82-95f4-15d2495982b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:30.139248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b1503c5-6b72-4b82-95f4-15d2495982b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:30.139687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b1503c5-6b72-4b82-95f4-15d2495982b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:30.273727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7b1503c5-6b72-4b82-95f4-15d2495982b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:30.281700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7b1503c5-6b72-4b82-95f4-15d2495982b0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.155360 Aug 01 15:49:30.282307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1091/1956] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:30 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:30.311569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-75d807cd-1733-4aaa-8147-649d1892d75a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:30.312179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-75d807cd-1733-4aaa-8147-649d1892d75a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:30.319116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75d807cd-1733-4aaa-8147-649d1892d75a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:30.319602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75d807cd-1733-4aaa-8147-649d1892d75a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:30.320379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75d807cd-1733-4aaa-8147-649d1892d75a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:30.320818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75d807cd-1733-4aaa-8147-649d1892d75a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:30.451772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-75d807cd-1733-4aaa-8147-649d1892d75a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:30.460005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-75d807cd-1733-4aaa-8147-649d1892d75a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.152107 Aug 01 15:49:30.460578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1092/1957] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:30 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:30.465123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cbbaa8c3-4164-4c40-bf16-f477d94636f1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:30.467294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cbbaa8c3-4164-4c40-bf16-f477d94636f1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:30.473603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cbbaa8c3-4164-4c40-bf16-f477d94636f1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:30.474096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cbbaa8c3-4164-4c40-bf16-f477d94636f1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:30.474870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cbbaa8c3-4164-4c40-bf16-f477d94636f1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:30.475312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cbbaa8c3-4164-4c40-bf16-f477d94636f1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:30.507801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cbbaa8c3-4164-4c40-bf16-f477d94636f1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046165 Aug 01 15:49:30.508421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1093/1958] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:30 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:31.302872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4cd4f8fa-79d4-459f-b887-d24dd976d3d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:31.303563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4cd4f8fa-79d4-459f-b887-d24dd976d3d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:31.310225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4cd4f8fa-79d4-459f-b887-d24dd976d3d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:31.310614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4cd4f8fa-79d4-459f-b887-d24dd976d3d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:31.311380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4cd4f8fa-79d4-459f-b887-d24dd976d3d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:31.311855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4cd4f8fa-79d4-459f-b887-d24dd976d3d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:31.442620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4cd4f8fa-79d4-459f-b887-d24dd976d3d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:31.453612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4cd4f8fa-79d4-459f-b887-d24dd976d3d3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.151356 Aug 01 15:49:31.453612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1094/1959] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:31 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:31.480436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b26b9d2e-eaed-44f3-8356-b98445a82b31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:31.481052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b26b9d2e-eaed-44f3-8356-b98445a82b31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:31.487320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b26b9d2e-eaed-44f3-8356-b98445a82b31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:31.487793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b26b9d2e-eaed-44f3-8356-b98445a82b31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:31.488566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b26b9d2e-eaed-44f3-8356-b98445a82b31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:31.489034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b26b9d2e-eaed-44f3-8356-b98445a82b31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:31.622655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b26b9d2e-eaed-44f3-8356-b98445a82b31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:31.632136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b26b9d2e-eaed-44f3-8356-b98445a82b31 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.155397 Aug 01 15:49:31.632716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1095/1960] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:31 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:31.637313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f2070bb3-35c8-4e95-af8c-7118f7ff234e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:31.639474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f2070bb3-35c8-4e95-af8c-7118f7ff234e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:31.646117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2070bb3-35c8-4e95-af8c-7118f7ff234e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:31.646571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2070bb3-35c8-4e95-af8c-7118f7ff234e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:31.647340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2070bb3-35c8-4e95-af8c-7118f7ff234e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:31.647776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2070bb3-35c8-4e95-af8c-7118f7ff234e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:31.678287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f2070bb3-35c8-4e95-af8c-7118f7ff234e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Aug 01 15:49:31.678860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1096/1961] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:31 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:32.472614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d42082f0-09dc-4347-ba6b-b69fd4879c90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:32.473242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d42082f0-09dc-4347-ba6b-b69fd4879c90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:32.479701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d42082f0-09dc-4347-ba6b-b69fd4879c90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:32.480152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d42082f0-09dc-4347-ba6b-b69fd4879c90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:32.480903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d42082f0-09dc-4347-ba6b-b69fd4879c90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:32.481334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d42082f0-09dc-4347-ba6b-b69fd4879c90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:32.485254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:32.614353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d42082f0-09dc-4347-ba6b-b69fd4879c90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:32.621899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d42082f0-09dc-4347-ba6b-b69fd4879c90 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.153568 Aug 01 15:49:32.622473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1097/1962] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:32 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:32.653378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ea9d01c5-1f87-434c-9963-d223e8c5cf01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:32.654002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ea9d01c5-1f87-434c-9963-d223e8c5cf01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:32.660076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea9d01c5-1f87-434c-9963-d223e8c5cf01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:32.660527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea9d01c5-1f87-434c-9963-d223e8c5cf01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:32.661287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea9d01c5-1f87-434c-9963-d223e8c5cf01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:32.661728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea9d01c5-1f87-434c-9963-d223e8c5cf01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:32.795517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ea9d01c5-1f87-434c-9963-d223e8c5cf01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:32.804190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ea9d01c5-1f87-434c-9963-d223e8c5cf01 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.154467 Aug 01 15:49:32.804756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1098/1963] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:32 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:32.809320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b7412adf-5deb-4d5a-ad83-e881b05ea698 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:32.811514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b7412adf-5deb-4d5a-ad83-e881b05ea698 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:32.818072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b7412adf-5deb-4d5a-ad83-e881b05ea698 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:32.818523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b7412adf-5deb-4d5a-ad83-e881b05ea698 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:32.819288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b7412adf-5deb-4d5a-ad83-e881b05ea698 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:32.819716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b7412adf-5deb-4d5a-ad83-e881b05ea698 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:32.849637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b7412adf-5deb-4d5a-ad83-e881b05ea698 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Aug 01 15:49:32.850235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1099/1964] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:32 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:33.644940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f9bf7904-b7a6-4787-8f7c-96be964d3651 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:33.645705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f9bf7904-b7a6-4787-8f7c-96be964d3651 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:33.652205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9bf7904-b7a6-4787-8f7c-96be964d3651 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:33.652656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9bf7904-b7a6-4787-8f7c-96be964d3651 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:33.653416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9bf7904-b7a6-4787-8f7c-96be964d3651 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:33.653866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9bf7904-b7a6-4787-8f7c-96be964d3651 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:33.793956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f9bf7904-b7a6-4787-8f7c-96be964d3651 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:33.805751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f9bf7904-b7a6-4787-8f7c-96be964d3651 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.165327 Aug 01 15:49:33.806671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1100/1965] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:33 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:33.832137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-acf52a71-f0e0-43a6-95bd-29f5e22961eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:33.832752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-acf52a71-f0e0-43a6-95bd-29f5e22961eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:33.839255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-acf52a71-f0e0-43a6-95bd-29f5e22961eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:33.839703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-acf52a71-f0e0-43a6-95bd-29f5e22961eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:33.840476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-acf52a71-f0e0-43a6-95bd-29f5e22961eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:33.840912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-acf52a71-f0e0-43a6-95bd-29f5e22961eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:33.982566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-acf52a71-f0e0-43a6-95bd-29f5e22961eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:33.991022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-acf52a71-f0e0-43a6-95bd-29f5e22961eb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.168691 Aug 01 15:49:33.991592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1101/1966] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:33 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:33.996163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5ce8a1f3-3efc-40f4-90ee-2ff3a1ba3181 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:33.998329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5ce8a1f3-3efc-40f4-90ee-2ff3a1ba3181 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:34.004987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5ce8a1f3-3efc-40f4-90ee-2ff3a1ba3181 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:34.005445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5ce8a1f3-3efc-40f4-90ee-2ff3a1ba3181 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:34.006245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5ce8a1f3-3efc-40f4-90ee-2ff3a1ba3181 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:34.006687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5ce8a1f3-3efc-40f4-90ee-2ff3a1ba3181 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:34.035891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5ce8a1f3-3efc-40f4-90ee-2ff3a1ba3181 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043261 Aug 01 15:49:34.036439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1102/1967] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:33 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:34.834340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ac469a20-3ec9-42d9-bddd-573dbf1c5fd9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:34.835055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ac469a20-3ec9-42d9-bddd-573dbf1c5fd9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:34.841580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac469a20-3ec9-42d9-bddd-573dbf1c5fd9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:34.842068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac469a20-3ec9-42d9-bddd-573dbf1c5fd9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:34.842844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac469a20-3ec9-42d9-bddd-573dbf1c5fd9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:34.843283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac469a20-3ec9-42d9-bddd-573dbf1c5fd9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:34.977629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ac469a20-3ec9-42d9-bddd-573dbf1c5fd9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:34.985401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ac469a20-3ec9-42d9-bddd-573dbf1c5fd9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.154891 Aug 01 15:49:34.985993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1103/1968] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:34 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:35.013360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e6be28a1-9705-4e72-b69c-f77bf05d381a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:35.014013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e6be28a1-9705-4e72-b69c-f77bf05d381a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:35.020760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6be28a1-9705-4e72-b69c-f77bf05d381a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:35.021206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6be28a1-9705-4e72-b69c-f77bf05d381a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:35.022007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6be28a1-9705-4e72-b69c-f77bf05d381a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:35.022452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6be28a1-9705-4e72-b69c-f77bf05d381a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:35.154260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e6be28a1-9705-4e72-b69c-f77bf05d381a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:35.162407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e6be28a1-9705-4e72-b69c-f77bf05d381a tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.152742 Aug 01 15:49:35.162992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1104/1969] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:35 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:35.171329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-33969562-dcc7-48dc-9373-f283754bee08 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:35.171329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-33969562-dcc7-48dc-9373-f283754bee08 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:35.176363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33969562-dcc7-48dc-9373-f283754bee08 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:35.176816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33969562-dcc7-48dc-9373-f283754bee08 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:35.177601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33969562-dcc7-48dc-9373-f283754bee08 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:35.178063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33969562-dcc7-48dc-9373-f283754bee08 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:35.209179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-33969562-dcc7-48dc-9373-f283754bee08 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Aug 01 15:49:35.209741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1105/1970] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:35 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:36.006712 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-885c442f-2fc2-481d-8da4-a63cbd3f6d4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:36.007416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-885c442f-2fc2-481d-8da4-a63cbd3f6d4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:36.013952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-885c442f-2fc2-481d-8da4-a63cbd3f6d4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:36.014418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-885c442f-2fc2-481d-8da4-a63cbd3f6d4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:36.015186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-885c442f-2fc2-481d-8da4-a63cbd3f6d4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:36.015625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-885c442f-2fc2-481d-8da4-a63cbd3f6d4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:36.150027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-885c442f-2fc2-481d-8da4-a63cbd3f6d4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:36.159595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-885c442f-2fc2-481d-8da4-a63cbd3f6d4b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.156719 Aug 01 15:49:36.161095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1106/1971] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:36 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:36.186570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aaa0a2a9-2bb2-4e6e-a24f-9f237da931a5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:36.187199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aaa0a2a9-2bb2-4e6e-a24f-9f237da931a5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:36.193387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aaa0a2a9-2bb2-4e6e-a24f-9f237da931a5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:36.193838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aaa0a2a9-2bb2-4e6e-a24f-9f237da931a5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:36.194948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aaa0a2a9-2bb2-4e6e-a24f-9f237da931a5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:36.195397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aaa0a2a9-2bb2-4e6e-a24f-9f237da931a5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:36.333999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aaa0a2a9-2bb2-4e6e-a24f-9f237da931a5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:36.342076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aaa0a2a9-2bb2-4e6e-a24f-9f237da931a5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.161369 Aug 01 15:49:36.342708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1107/1972] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:36 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:36.348107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1f058771-95c4-4a9e-9c68-77121deccaff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:36.350310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1f058771-95c4-4a9e-9c68-77121deccaff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:36.356447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f058771-95c4-4a9e-9c68-77121deccaff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:36.356906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f058771-95c4-4a9e-9c68-77121deccaff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:36.358332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f058771-95c4-4a9e-9c68-77121deccaff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:36.358332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f058771-95c4-4a9e-9c68-77121deccaff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:36.387415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1f058771-95c4-4a9e-9c68-77121deccaff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043715 Aug 01 15:49:36.387985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1108/1973] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:36 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:36.510647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:49:36.511523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:49:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf (ip 10.222.0.83) !!! Aug 01 15:49:37.184676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d03d7ab8-ecc9-4fd6-9375-dcc8f41774c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:37.185323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d03d7ab8-ecc9-4fd6-9375-dcc8f41774c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:37.192025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d03d7ab8-ecc9-4fd6-9375-dcc8f41774c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:37.192517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d03d7ab8-ecc9-4fd6-9375-dcc8f41774c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:37.193316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d03d7ab8-ecc9-4fd6-9375-dcc8f41774c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:37.193750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d03d7ab8-ecc9-4fd6-9375-dcc8f41774c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:37.334423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d03d7ab8-ecc9-4fd6-9375-dcc8f41774c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:37.342446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d03d7ab8-ecc9-4fd6-9375-dcc8f41774c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.161531 Aug 01 15:49:37.343034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1109/1974] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:37 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:37.364186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-93089818-3d00-4893-9af5-38f3c71fb04f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:37.364808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-93089818-3d00-4893-9af5-38f3c71fb04f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:37.371403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-93089818-3d00-4893-9af5-38f3c71fb04f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:37.371861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-93089818-3d00-4893-9af5-38f3c71fb04f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:37.372652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-93089818-3d00-4893-9af5-38f3c71fb04f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:37.373097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-93089818-3d00-4893-9af5-38f3c71fb04f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:37.505364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-93089818-3d00-4893-9af5-38f3c71fb04f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:37.513501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-93089818-3d00-4893-9af5-38f3c71fb04f tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153301 Aug 01 15:49:37.514106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1110/1975] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:37 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:37.519544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d358edf0-fda1-44c4-bc8b-24efd2028d01 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:37.521698 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d358edf0-fda1-44c4-bc8b-24efd2028d01 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:37.527841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d358edf0-fda1-44c4-bc8b-24efd2028d01 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:37.528297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d358edf0-fda1-44c4-bc8b-24efd2028d01 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:37.529067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d358edf0-fda1-44c4-bc8b-24efd2028d01 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:37.529509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d358edf0-fda1-44c4-bc8b-24efd2028d01 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:37.558694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d358edf0-fda1-44c4-bc8b-24efd2028d01 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043542 Aug 01 15:49:37.559253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1111/1976] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:37 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:38.364898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-73a1128d-d44d-43d5-9a19-284807b950ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:38.365572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-73a1128d-d44d-43d5-9a19-284807b950ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:38.372099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73a1128d-d44d-43d5-9a19-284807b950ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:38.372545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73a1128d-d44d-43d5-9a19-284807b950ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:38.373310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73a1128d-d44d-43d5-9a19-284807b950ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:38.373739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73a1128d-d44d-43d5-9a19-284807b950ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:38.506196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-73a1128d-d44d-43d5-9a19-284807b950ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:38.514028 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-73a1128d-d44d-43d5-9a19-284807b950ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.153749 Aug 01 15:49:38.514613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1112/1977] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:38 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:38.536439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9297a68c-690e-4899-a257-c47f78e94cc5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:38.537049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9297a68c-690e-4899-a257-c47f78e94cc5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:38.539960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:38.543810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9297a68c-690e-4899-a257-c47f78e94cc5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:38.547789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9297a68c-690e-4899-a257-c47f78e94cc5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:38.547789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9297a68c-690e-4899-a257-c47f78e94cc5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:38.547789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9297a68c-690e-4899-a257-c47f78e94cc5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:38.681162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9297a68c-690e-4899-a257-c47f78e94cc5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:38.684605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:38.690007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9297a68c-690e-4899-a257-c47f78e94cc5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.157864 Aug 01 15:49:38.690663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1113/1978] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:38 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:38.695308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-718eda5a-ebe9-43ec-864d-bbcd76ecea68 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:38.697528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-718eda5a-ebe9-43ec-864d-bbcd76ecea68 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:38.703584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-718eda5a-ebe9-43ec-864d-bbcd76ecea68 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:38.704543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-718eda5a-ebe9-43ec-864d-bbcd76ecea68 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:38.705311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-718eda5a-ebe9-43ec-864d-bbcd76ecea68 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:38.705747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-718eda5a-ebe9-43ec-864d-bbcd76ecea68 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:38.735851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-718eda5a-ebe9-43ec-864d-bbcd76ecea68 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Aug 01 15:49:38.736412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1114/1979] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:38 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:39.536509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-10bdce13-217c-4277-b65a-d23effc1804a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:39.537197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-10bdce13-217c-4277-b65a-d23effc1804a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:39.543719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10bdce13-217c-4277-b65a-d23effc1804a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:39.544168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10bdce13-217c-4277-b65a-d23effc1804a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:39.544931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10bdce13-217c-4277-b65a-d23effc1804a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:39.545366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10bdce13-217c-4277-b65a-d23effc1804a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:39.685198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-10bdce13-217c-4277-b65a-d23effc1804a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:39.692921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-10bdce13-217c-4277-b65a-d23effc1804a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.160898 Aug 01 15:49:39.693487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1115/1980] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:39 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:39.710509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d51a6ba8-ee82-46ab-b218-73623e8cd09e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:39.711125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d51a6ba8-ee82-46ab-b218-73623e8cd09e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:39.717262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d51a6ba8-ee82-46ab-b218-73623e8cd09e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:39.717710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d51a6ba8-ee82-46ab-b218-73623e8cd09e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:39.718514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d51a6ba8-ee82-46ab-b218-73623e8cd09e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:39.718947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d51a6ba8-ee82-46ab-b218-73623e8cd09e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:39.856230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d51a6ba8-ee82-46ab-b218-73623e8cd09e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:39.864126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d51a6ba8-ee82-46ab-b218-73623e8cd09e tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.157326 Aug 01 15:49:39.864695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1116/1981] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:39 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:39.869207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8c22a4c4-afe0-4011-aa14-43ee69ece2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:39.871364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8c22a4c4-afe0-4011-aa14-43ee69ece2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:39.877934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8c22a4c4-afe0-4011-aa14-43ee69ece2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:39.878391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8c22a4c4-afe0-4011-aa14-43ee69ece2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:39.879147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8c22a4c4-afe0-4011-aa14-43ee69ece2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:39.879580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8c22a4c4-afe0-4011-aa14-43ee69ece2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:39.910593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8c22a4c4-afe0-4011-aa14-43ee69ece2d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044849 Aug 01 15:49:39.911164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1117/1982] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:39 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:40.713878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-413d160b-56c8-4576-9fc2-78902dbe9931 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:40.714560 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-413d160b-56c8-4576-9fc2-78902dbe9931 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:40.722360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-413d160b-56c8-4576-9fc2-78902dbe9931 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:40.722818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-413d160b-56c8-4576-9fc2-78902dbe9931 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:40.723672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-413d160b-56c8-4576-9fc2-78902dbe9931 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:40.724140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-413d160b-56c8-4576-9fc2-78902dbe9931 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:40.864253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-413d160b-56c8-4576-9fc2-78902dbe9931 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:40.871903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-413d160b-56c8-4576-9fc2-78902dbe9931 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.161822 Aug 01 15:49:40.872501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1118/1983] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:40 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:40.885060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1c42a930-16ae-4ec5-8ee8-071ba2e2f3a7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:40.885680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1c42a930-16ae-4ec5-8ee8-071ba2e2f3a7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:40.892534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c42a930-16ae-4ec5-8ee8-071ba2e2f3a7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:40.893000 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c42a930-16ae-4ec5-8ee8-071ba2e2f3a7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:40.893969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c42a930-16ae-4ec5-8ee8-071ba2e2f3a7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:40.894448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c42a930-16ae-4ec5-8ee8-071ba2e2f3a7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:41.031360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1c42a930-16ae-4ec5-8ee8-071ba2e2f3a7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:41.040188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1c42a930-16ae-4ec5-8ee8-071ba2e2f3a7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.158970 Aug 01 15:49:41.040752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1119/1984] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:40 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:49:41.045413 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f8989778-5ba1-4d70-b240-1d965a55f6ee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:41.047626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f8989778-5ba1-4d70-b240-1d965a55f6ee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:41.053827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f8989778-5ba1-4d70-b240-1d965a55f6ee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:41.054354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f8989778-5ba1-4d70-b240-1d965a55f6ee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:41.055133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f8989778-5ba1-4d70-b240-1d965a55f6ee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:41.055570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f8989778-5ba1-4d70-b240-1d965a55f6ee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:41.086361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f8989778-5ba1-4d70-b240-1d965a55f6ee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044533 Aug 01 15:49:41.086923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1120/1985] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:41 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:41.893606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-db626a62-f345-47f6-bc4b-42293c73e725 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:41.894313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-db626a62-f345-47f6-bc4b-42293c73e725 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:41.901383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db626a62-f345-47f6-bc4b-42293c73e725 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:41.901831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db626a62-f345-47f6-bc4b-42293c73e725 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:41.902648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db626a62-f345-47f6-bc4b-42293c73e725 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:41.903091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db626a62-f345-47f6-bc4b-42293c73e725 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:42.038485 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-db626a62-f345-47f6-bc4b-42293c73e725 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:42.046128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-db626a62-f345-47f6-bc4b-42293c73e725 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.157102 Aug 01 15:49:42.046699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1121/1986] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:41 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:42.060463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5e45d0fc-2436-4db8-8e37-e41542c928fb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:42.061209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5e45d0fc-2436-4db8-8e37-e41542c928fb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:42.068855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e45d0fc-2436-4db8-8e37-e41542c928fb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:42.069311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e45d0fc-2436-4db8-8e37-e41542c928fb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:42.070128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e45d0fc-2436-4db8-8e37-e41542c928fb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:42.070572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e45d0fc-2436-4db8-8e37-e41542c928fb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:42.203598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5e45d0fc-2436-4db8-8e37-e41542c928fb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:42.211671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5e45d0fc-2436-4db8-8e37-e41542c928fb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.155055 Aug 01 15:49:42.212240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1122/1987] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:42 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:42.216769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-08047426-d54c-48eb-bb20-5de9c50e9c69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:42.218989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-08047426-d54c-48eb-bb20-5de9c50e9c69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:42.226476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08047426-d54c-48eb-bb20-5de9c50e9c69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:42.226926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08047426-d54c-48eb-bb20-5de9c50e9c69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:42.227718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08047426-d54c-48eb-bb20-5de9c50e9c69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:42.228142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08047426-d54c-48eb-bb20-5de9c50e9c69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:42.258541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-08047426-d54c-48eb-bb20-5de9c50e9c69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045247 Aug 01 15:49:42.259115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1123/1988] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:42 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:43.068245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b53e1129-ef29-4e90-87a7-655fab31c68c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:43.068891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b53e1129-ef29-4e90-87a7-655fab31c68c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:43.075455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b53e1129-ef29-4e90-87a7-655fab31c68c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:43.075910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b53e1129-ef29-4e90-87a7-655fab31c68c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:43.076677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b53e1129-ef29-4e90-87a7-655fab31c68c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:43.077112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b53e1129-ef29-4e90-87a7-655fab31c68c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:43.210574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b53e1129-ef29-4e90-87a7-655fab31c68c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:43.218516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b53e1129-ef29-4e90-87a7-655fab31c68c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.155059 Aug 01 15:49:43.219083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1124/1989] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:43 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:43.232339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8072f589-5788-415e-9fee-a48566b5c993 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:43.232955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8072f589-5788-415e-9fee-a48566b5c993 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:43.239017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8072f589-5788-415e-9fee-a48566b5c993 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:43.239535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8072f589-5788-415e-9fee-a48566b5c993 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:43.240308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8072f589-5788-415e-9fee-a48566b5c993 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:43.240753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8072f589-5788-415e-9fee-a48566b5c993 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:43.370683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8072f589-5788-415e-9fee-a48566b5c993 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:43.379089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8072f589-5788-415e-9fee-a48566b5c993 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.150507 Aug 01 15:49:43.379654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1125/1990] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:43 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:43.384167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-43225722-c052-4ea8-a760-69ee4ab2d971 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:43.386384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-43225722-c052-4ea8-a760-69ee4ab2d971 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:43.392811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43225722-c052-4ea8-a760-69ee4ab2d971 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:43.393253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43225722-c052-4ea8-a760-69ee4ab2d971 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:43.394041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43225722-c052-4ea8-a760-69ee4ab2d971 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:43.394470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43225722-c052-4ea8-a760-69ee4ab2d971 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:43.423009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-43225722-c052-4ea8-a760-69ee4ab2d971 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 Aug 01 15:49:43.423563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1126/1991] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:43 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:44.240544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8e962fe6-4ed3-4c01-8148-cb087650823d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:44.241189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8e962fe6-4ed3-4c01-8148-cb087650823d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:44.247857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e962fe6-4ed3-4c01-8148-cb087650823d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:44.252908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e962fe6-4ed3-4c01-8148-cb087650823d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:44.252908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e962fe6-4ed3-4c01-8148-cb087650823d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:44.252908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8e962fe6-4ed3-4c01-8148-cb087650823d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:44.382504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8e962fe6-4ed3-4c01-8148-cb087650823d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:44.390001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8e962fe6-4ed3-4c01-8148-cb087650823d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.153852 Aug 01 15:49:44.390567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1127/1992] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:44 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:44.400229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e61b96f5-6716-4f8d-8d9b-d95e33590241 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:44.400840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e61b96f5-6716-4f8d-8d9b-d95e33590241 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:44.406920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e61b96f5-6716-4f8d-8d9b-d95e33590241 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:44.407369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e61b96f5-6716-4f8d-8d9b-d95e33590241 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:44.408133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e61b96f5-6716-4f8d-8d9b-d95e33590241 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:44.408676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e61b96f5-6716-4f8d-8d9b-d95e33590241 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:44.536730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e61b96f5-6716-4f8d-8d9b-d95e33590241 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:44.544609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e61b96f5-6716-4f8d-8d9b-d95e33590241 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.148017 Aug 01 15:49:44.545164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1128/1993] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:44 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:44.550359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-526c9f15-7dd0-47b9-9056-d59218a39f1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:44.552468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-526c9f15-7dd0-47b9-9056-d59218a39f1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:44.558482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-526c9f15-7dd0-47b9-9056-d59218a39f1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:44.558926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-526c9f15-7dd0-47b9-9056-d59218a39f1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:44.559683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-526c9f15-7dd0-47b9-9056-d59218a39f1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:44.560108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-526c9f15-7dd0-47b9-9056-d59218a39f1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:44.589828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-526c9f15-7dd0-47b9-9056-d59218a39f1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043463 Aug 01 15:49:44.590344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1129/1994] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:44 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:45.412572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8da882a0-a8b6-46b8-9f07-9b6c3e1db7d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:45.413327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8da882a0-a8b6-46b8-9f07-9b6c3e1db7d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:45.419937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8da882a0-a8b6-46b8-9f07-9b6c3e1db7d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:45.420388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8da882a0-a8b6-46b8-9f07-9b6c3e1db7d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:45.421150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8da882a0-a8b6-46b8-9f07-9b6c3e1db7d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:45.421620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8da882a0-a8b6-46b8-9f07-9b6c3e1db7d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:45.440677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:45.555566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8da882a0-a8b6-46b8-9f07-9b6c3e1db7d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:45.563414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8da882a0-a8b6-46b8-9f07-9b6c3e1db7d6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.155153 Aug 01 15:49:45.571705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1130/1995] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:45 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:45.571705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1853ea1f-a717-4eea-b815-5a863a2cb599 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:45.571705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1853ea1f-a717-4eea-b815-5a863a2cb599 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:45.575292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1853ea1f-a717-4eea-b815-5a863a2cb599 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:45.575761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1853ea1f-a717-4eea-b815-5a863a2cb599 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:45.576565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1853ea1f-a717-4eea-b815-5a863a2cb599 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:45.577032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1853ea1f-a717-4eea-b815-5a863a2cb599 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:45.708906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1853ea1f-a717-4eea-b815-5a863a2cb599 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:45.717170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1853ea1f-a717-4eea-b815-5a863a2cb599 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.152077 Aug 01 15:49:45.717741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1131/1996] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:45 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:49:45.723727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c835619c-84e1-4d91-ae7d-3314fc92fc93 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:45.726148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c835619c-84e1-4d91-ae7d-3314fc92fc93 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:45.732488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c835619c-84e1-4d91-ae7d-3314fc92fc93 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:45.732929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c835619c-84e1-4d91-ae7d-3314fc92fc93 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:45.733701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c835619c-84e1-4d91-ae7d-3314fc92fc93 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:45.734179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c835619c-84e1-4d91-ae7d-3314fc92fc93 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:45.767921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c835619c-84e1-4d91-ae7d-3314fc92fc93 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048814 Aug 01 15:49:45.768988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1132/1997] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:45 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:46.584763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d76f357c-37cc-4a3e-a282-8f7dc2b41d5f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:46.585461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d76f357c-37cc-4a3e-a282-8f7dc2b41d5f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:46.591966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d76f357c-37cc-4a3e-a282-8f7dc2b41d5f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:46.592406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d76f357c-37cc-4a3e-a282-8f7dc2b41d5f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:46.593166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d76f357c-37cc-4a3e-a282-8f7dc2b41d5f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:46.593595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d76f357c-37cc-4a3e-a282-8f7dc2b41d5f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:46.723881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d76f357c-37cc-4a3e-a282-8f7dc2b41d5f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:46.732574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d76f357c-37cc-4a3e-a282-8f7dc2b41d5f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.151620 Aug 01 15:49:46.733176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1133/1998] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:46 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:46.739730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c830cb9f-3136-426d-bd79-2e4f309294cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:46.740344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c830cb9f-3136-426d-bd79-2e4f309294cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:46.746322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c830cb9f-3136-426d-bd79-2e4f309294cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:46.746760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c830cb9f-3136-426d-bd79-2e4f309294cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:46.747526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c830cb9f-3136-426d-bd79-2e4f309294cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:46.747964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c830cb9f-3136-426d-bd79-2e4f309294cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:46.882053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c830cb9f-3136-426d-bd79-2e4f309294cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:46.890033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c830cb9f-3136-426d-bd79-2e4f309294cc tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153925 Aug 01 15:49:46.890593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1134/1999] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:46 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:46.895186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7aa14fbb-0648-49c2-9f87-752b4afd6d25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:46.897396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7aa14fbb-0648-49c2-9f87-752b4afd6d25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:46.905417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aa14fbb-0648-49c2-9f87-752b4afd6d25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:46.905862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aa14fbb-0648-49c2-9f87-752b4afd6d25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:46.906705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aa14fbb-0648-49c2-9f87-752b4afd6d25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:46.907138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aa14fbb-0648-49c2-9f87-752b4afd6d25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:46.937984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7aa14fbb-0648-49c2-9f87-752b4afd6d25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046324 Aug 01 15:49:46.939140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1135/2000] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:46 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:47.754343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-243c6fcf-d7ed-4b27-9d91-7a694847a13a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:47.755052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-243c6fcf-d7ed-4b27-9d91-7a694847a13a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:47.761918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-243c6fcf-d7ed-4b27-9d91-7a694847a13a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:47.762379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-243c6fcf-d7ed-4b27-9d91-7a694847a13a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:47.763142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-243c6fcf-d7ed-4b27-9d91-7a694847a13a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:47.763580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-243c6fcf-d7ed-4b27-9d91-7a694847a13a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:47.899875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-243c6fcf-d7ed-4b27-9d91-7a694847a13a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:47.907816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-243c6fcf-d7ed-4b27-9d91-7a694847a13a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.157408 Aug 01 15:49:47.908395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1136/2001] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:47 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:49:47.912875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fd171172-261f-4e0b-8f53-22b35949d847 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:47.913524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fd171172-261f-4e0b-8f53-22b35949d847 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:47.920030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd171172-261f-4e0b-8f53-22b35949d847 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:47.920476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd171172-261f-4e0b-8f53-22b35949d847 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:47.921300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd171172-261f-4e0b-8f53-22b35949d847 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:47.921732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd171172-261f-4e0b-8f53-22b35949d847 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:48.055645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fd171172-261f-4e0b-8f53-22b35949d847 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:48.064549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fd171172-261f-4e0b-8f53-22b35949d847 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.155101 Aug 01 15:49:48.065130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1137/2002] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:47 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:49:48.069786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-03ad50a0-47e3-49f8-85c3-8c3793e7637b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:48.071972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-03ad50a0-47e3-49f8-85c3-8c3793e7637b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:48.078744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-03ad50a0-47e3-49f8-85c3-8c3793e7637b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:48.079690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-03ad50a0-47e3-49f8-85c3-8c3793e7637b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:48.080487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-03ad50a0-47e3-49f8-85c3-8c3793e7637b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:48.080900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-03ad50a0-47e3-49f8-85c3-8c3793e7637b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:48.112472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-03ad50a0-47e3-49f8-85c3-8c3793e7637b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046276 Aug 01 15:49:48.113051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1138/2003] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:48 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:48.929233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e6fe3783-44bd-4c12-b435-c8ec4446dba2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:48.930019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e6fe3783-44bd-4c12-b435-c8ec4446dba2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:48.936211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6fe3783-44bd-4c12-b435-c8ec4446dba2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:48.936664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6fe3783-44bd-4c12-b435-c8ec4446dba2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:48.937430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6fe3783-44bd-4c12-b435-c8ec4446dba2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:48.937872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6fe3783-44bd-4c12-b435-c8ec4446dba2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:49.072660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e6fe3783-44bd-4c12-b435-c8ec4446dba2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:49.080321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e6fe3783-44bd-4c12-b435-c8ec4446dba2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.155305 Aug 01 15:49:49.080892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1139/2004] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:48 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:49:49.090459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fee2df07-8ce9-4797-93d8-77669d09007d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:49.091058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fee2df07-8ce9-4797-93d8-77669d09007d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:49.097462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fee2df07-8ce9-4797-93d8-77669d09007d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:49.098030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fee2df07-8ce9-4797-93d8-77669d09007d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:49.098824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fee2df07-8ce9-4797-93d8-77669d09007d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:49.107021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fee2df07-8ce9-4797-93d8-77669d09007d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:49.232189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fee2df07-8ce9-4797-93d8-77669d09007d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:49.240844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fee2df07-8ce9-4797-93d8-77669d09007d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153992 Aug 01 15:49:49.241423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1140/2005] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:49 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:49.246078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2e21eda7-8ae9-4f02-83ce-ee528056f26a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:49.248254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2e21eda7-8ae9-4f02-83ce-ee528056f26a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:49.254929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e21eda7-8ae9-4f02-83ce-ee528056f26a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:49.255388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e21eda7-8ae9-4f02-83ce-ee528056f26a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:49.256160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e21eda7-8ae9-4f02-83ce-ee528056f26a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:49.256600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e21eda7-8ae9-4f02-83ce-ee528056f26a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:49.287401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2e21eda7-8ae9-4f02-83ce-ee528056f26a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044902 Aug 01 15:49:49.287963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1141/2006] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:49 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:50.101035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8fdcbdda-6078-4bef-b585-bf561fe9bac3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:50.101657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8fdcbdda-6078-4bef-b585-bf561fe9bac3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:50.108248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fdcbdda-6078-4bef-b585-bf561fe9bac3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:50.108701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fdcbdda-6078-4bef-b585-bf561fe9bac3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:50.109465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fdcbdda-6078-4bef-b585-bf561fe9bac3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:50.109992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8fdcbdda-6078-4bef-b585-bf561fe9bac3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:50.244838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8fdcbdda-6078-4bef-b585-bf561fe9bac3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:50.253062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8fdcbdda-6078-4bef-b585-bf561fe9bac3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.155900 Aug 01 15:49:50.253633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1142/2007] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:50 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:50.262601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5c5db353-4df1-419b-93d7-ddddffb4ab6d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:50.263127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5c5db353-4df1-419b-93d7-ddddffb4ab6d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:50.269697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c5db353-4df1-419b-93d7-ddddffb4ab6d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:50.270175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c5db353-4df1-419b-93d7-ddddffb4ab6d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:50.270937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c5db353-4df1-419b-93d7-ddddffb4ab6d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:50.271371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c5db353-4df1-419b-93d7-ddddffb4ab6d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:50.400478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5c5db353-4df1-419b-93d7-ddddffb4ab6d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:50.408410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5c5db353-4df1-419b-93d7-ddddffb4ab6d tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.149555 Aug 01 15:49:50.409041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1143/2008] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:50 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:50.413640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e08e9e4e-c54f-478e-8a99-b173ce2f6e5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:50.415833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e08e9e4e-c54f-478e-8a99-b173ce2f6e5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:50.421713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e08e9e4e-c54f-478e-8a99-b173ce2f6e5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:50.422199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e08e9e4e-c54f-478e-8a99-b173ce2f6e5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:50.423580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e08e9e4e-c54f-478e-8a99-b173ce2f6e5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:50.424424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e08e9e4e-c54f-478e-8a99-b173ce2f6e5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:50.454012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e08e9e4e-c54f-478e-8a99-b173ce2f6e5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Aug 01 15:49:50.454573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1144/2009] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:50 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:51.275087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ce449ab4-7f63-41e9-9852-306f82b21e80 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:51.275725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ce449ab4-7f63-41e9-9852-306f82b21e80 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:51.282639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce449ab4-7f63-41e9-9852-306f82b21e80 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:51.283093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce449ab4-7f63-41e9-9852-306f82b21e80 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:51.283859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce449ab4-7f63-41e9-9852-306f82b21e80 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:51.284294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce449ab4-7f63-41e9-9852-306f82b21e80 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:51.417627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ce449ab4-7f63-41e9-9852-306f82b21e80 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:51.426026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ce449ab4-7f63-41e9-9852-306f82b21e80 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.154800 Aug 01 15:49:51.426516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1145/2010] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:51 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:51.431100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-decc2af0-fc6d-4d44-89c9-8ac72454b4ce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:51.431711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-decc2af0-fc6d-4d44-89c9-8ac72454b4ce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:51.437572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-decc2af0-fc6d-4d44-89c9-8ac72454b4ce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:51.438707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-decc2af0-fc6d-4d44-89c9-8ac72454b4ce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:51.439489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-decc2af0-fc6d-4d44-89c9-8ac72454b4ce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:51.439926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-decc2af0-fc6d-4d44-89c9-8ac72454b4ce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:51.572688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-decc2af0-fc6d-4d44-89c9-8ac72454b4ce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:51.580694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-decc2af0-fc6d-4d44-89c9-8ac72454b4ce tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.153167 Aug 01 15:49:51.581260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1146/2011] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:51 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:49:51.585771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9b4b4af7-dd11-4d7f-8138-991d98fdbb75 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:51.587918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9b4b4af7-dd11-4d7f-8138-991d98fdbb75 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:51.594625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b4b4af7-dd11-4d7f-8138-991d98fdbb75 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:51.595342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b4b4af7-dd11-4d7f-8138-991d98fdbb75 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:51.596174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b4b4af7-dd11-4d7f-8138-991d98fdbb75 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:51.596706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b4b4af7-dd11-4d7f-8138-991d98fdbb75 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:51.600557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:51.626660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9b4b4af7-dd11-4d7f-8138-991d98fdbb75 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044369 Aug 01 15:49:51.627227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1147/2012] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:51 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:52.447790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bbb9bd4e-4a41-4fb6-b252-8245b436a576 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:52.448491 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bbb9bd4e-4a41-4fb6-b252-8245b436a576 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:52.455685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bbb9bd4e-4a41-4fb6-b252-8245b436a576 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:52.456130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bbb9bd4e-4a41-4fb6-b252-8245b436a576 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:52.456891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bbb9bd4e-4a41-4fb6-b252-8245b436a576 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:52.457319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bbb9bd4e-4a41-4fb6-b252-8245b436a576 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:52.585296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bbb9bd4e-4a41-4fb6-b252-8245b436a576 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:52.592892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bbb9bd4e-4a41-4fb6-b252-8245b436a576 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.148918 Aug 01 15:49:52.593461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1148/2013] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:52 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:52.602751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e7ba908b-0d3e-4641-8d56-c00aaf6b8efb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:52.603364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e7ba908b-0d3e-4641-8d56-c00aaf6b8efb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:52.609247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e7ba908b-0d3e-4641-8d56-c00aaf6b8efb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:52.609702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e7ba908b-0d3e-4641-8d56-c00aaf6b8efb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:52.610570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e7ba908b-0d3e-4641-8d56-c00aaf6b8efb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:52.611107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e7ba908b-0d3e-4641-8d56-c00aaf6b8efb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:52.742815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e7ba908b-0d3e-4641-8d56-c00aaf6b8efb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:52.751355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e7ba908b-0d3e-4641-8d56-c00aaf6b8efb tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.151614 Aug 01 15:49:52.751929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1149/2014] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:52 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:52.756466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-387378d3-1466-438c-819b-b2f91f6652a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:52.758621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-387378d3-1466-438c-819b-b2f91f6652a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:52.764448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-387378d3-1466-438c-819b-b2f91f6652a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:52.764902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-387378d3-1466-438c-819b-b2f91f6652a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:52.765672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-387378d3-1466-438c-819b-b2f91f6652a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:52.766199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-387378d3-1466-438c-819b-b2f91f6652a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:52.799019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-387378d3-1466-438c-819b-b2f91f6652a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046040 Aug 01 15:49:52.799586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1150/2015] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:52 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:53.614220 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d51dcf39-c333-4bc3-b71f-be0fcad53a67 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:53.614905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d51dcf39-c333-4bc3-b71f-be0fcad53a67 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:53.621439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d51dcf39-c333-4bc3-b71f-be0fcad53a67 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:53.621912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d51dcf39-c333-4bc3-b71f-be0fcad53a67 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:53.622687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d51dcf39-c333-4bc3-b71f-be0fcad53a67 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:53.623126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d51dcf39-c333-4bc3-b71f-be0fcad53a67 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:53.755064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d51dcf39-c333-4bc3-b71f-be0fcad53a67 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:53.762683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d51dcf39-c333-4bc3-b71f-be0fcad53a67 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.152292 Aug 01 15:49:53.763255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1151/2016] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:53 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:53.772530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-29ff2201-e45f-4a95-b313-0696d3ee8002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:53.773199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-29ff2201-e45f-4a95-b313-0696d3ee8002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:53.781805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29ff2201-e45f-4a95-b313-0696d3ee8002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:53.782888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29ff2201-e45f-4a95-b313-0696d3ee8002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:53.783668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29ff2201-e45f-4a95-b313-0696d3ee8002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:53.784203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29ff2201-e45f-4a95-b313-0696d3ee8002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:53.921750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-29ff2201-e45f-4a95-b313-0696d3ee8002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:53.929883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-29ff2201-e45f-4a95-b313-0696d3ee8002 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.160996 Aug 01 15:49:53.930478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1152/2017] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:53 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:53.935180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5b171808-1d8b-4ef1-ab8e-9a0b40af3a62 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:53.937427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5b171808-1d8b-4ef1-ab8e-9a0b40af3a62 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:53.944020 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b171808-1d8b-4ef1-ab8e-9a0b40af3a62 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:53.944467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b171808-1d8b-4ef1-ab8e-9a0b40af3a62 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:53.945232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b171808-1d8b-4ef1-ab8e-9a0b40af3a62 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:53.945708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b171808-1d8b-4ef1-ab8e-9a0b40af3a62 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:53.977512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5b171808-1d8b-4ef1-ab8e-9a0b40af3a62 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045907 Aug 01 15:49:53.978114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1153/2018] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:53 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:54.785534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e2f39912-bf67-42ec-9b86-df37684f797b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:54.786280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e2f39912-bf67-42ec-9b86-df37684f797b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:54.792207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e2f39912-bf67-42ec-9b86-df37684f797b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:54.792735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e2f39912-bf67-42ec-9b86-df37684f797b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:54.793414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e2f39912-bf67-42ec-9b86-df37684f797b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:54.793846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e2f39912-bf67-42ec-9b86-df37684f797b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:54.937469 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e2f39912-bf67-42ec-9b86-df37684f797b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:54.945197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e2f39912-bf67-42ec-9b86-df37684f797b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.164663 Aug 01 15:49:54.945775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1154/2019] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:54 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:54.951241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-00d0e7b5-7571-4499-b18a-8b98be43e3f8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:54.951866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-00d0e7b5-7571-4499-b18a-8b98be43e3f8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:54.958374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-00d0e7b5-7571-4499-b18a-8b98be43e3f8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:54.958822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-00d0e7b5-7571-4499-b18a-8b98be43e3f8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:54.959589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-00d0e7b5-7571-4499-b18a-8b98be43e3f8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:54.960023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-00d0e7b5-7571-4499-b18a-8b98be43e3f8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:55.095517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-00d0e7b5-7571-4499-b18a-8b98be43e3f8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:55.103471 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-00d0e7b5-7571-4499-b18a-8b98be43e3f8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.155812 Aug 01 15:49:55.104044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1155/2020] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:54 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:55.108604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-661abdec-9ad3-4f43-8158-597aec1798c7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:55.110822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-661abdec-9ad3-4f43-8158-597aec1798c7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:55.116613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-661abdec-9ad3-4f43-8158-597aec1798c7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:55.117051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-661abdec-9ad3-4f43-8158-597aec1798c7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:55.117808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-661abdec-9ad3-4f43-8158-597aec1798c7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:55.118261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-661abdec-9ad3-4f43-8158-597aec1798c7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:55.147437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-661abdec-9ad3-4f43-8158-597aec1798c7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042383 Aug 01 15:49:55.148009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1156/2021] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:55 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:55.967797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-478d3653-f5a3-46b1-a24e-fe21dd4a9cfe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:55.968487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-478d3653-f5a3-46b1-a24e-fe21dd4a9cfe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:55.977183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-478d3653-f5a3-46b1-a24e-fe21dd4a9cfe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:55.978014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-478d3653-f5a3-46b1-a24e-fe21dd4a9cfe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:55.979217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-478d3653-f5a3-46b1-a24e-fe21dd4a9cfe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:55.979767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-478d3653-f5a3-46b1-a24e-fe21dd4a9cfe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:56.121046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-478d3653-f5a3-46b1-a24e-fe21dd4a9cfe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:56.128879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-478d3653-f5a3-46b1-a24e-fe21dd4a9cfe tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.164947 Aug 01 15:49:56.129463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1157/2022] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:55 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:56.133995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c7637270-66d7-49ca-8709-2da55b741757 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:56.134610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c7637270-66d7-49ca-8709-2da55b741757 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:56.140488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c7637270-66d7-49ca-8709-2da55b741757 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:56.140970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c7637270-66d7-49ca-8709-2da55b741757 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:56.141734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c7637270-66d7-49ca-8709-2da55b741757 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:56.142195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c7637270-66d7-49ca-8709-2da55b741757 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:56.270966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c7637270-66d7-49ca-8709-2da55b741757 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:56.278991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c7637270-66d7-49ca-8709-2da55b741757 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.148462 Aug 01 15:49:56.279565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1158/2023] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:56 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:49:56.284845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-78fbeefa-6700-4493-ba5c-03edabb2b400 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:56.287098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-78fbeefa-6700-4493-ba5c-03edabb2b400 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:56.293166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78fbeefa-6700-4493-ba5c-03edabb2b400 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:56.293614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78fbeefa-6700-4493-ba5c-03edabb2b400 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:56.294425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78fbeefa-6700-4493-ba5c-03edabb2b400 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:56.294863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78fbeefa-6700-4493-ba5c-03edabb2b400 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:56.324808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-78fbeefa-6700-4493-ba5c-03edabb2b400 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Aug 01 15:49:56.325375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1159/2024] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:56 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:57.150412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5cd27564-707a-4e9d-aeab-1ffa8c68230f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:57.151101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5cd27564-707a-4e9d-aeab-1ffa8c68230f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:57.157713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5cd27564-707a-4e9d-aeab-1ffa8c68230f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:57.158124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5cd27564-707a-4e9d-aeab-1ffa8c68230f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:57.158875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5cd27564-707a-4e9d-aeab-1ffa8c68230f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:57.159308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5cd27564-707a-4e9d-aeab-1ffa8c68230f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:57.294407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5cd27564-707a-4e9d-aeab-1ffa8c68230f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:57.302942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5cd27564-707a-4e9d-aeab-1ffa8c68230f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.156333 Aug 01 15:49:57.303517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1160/2025] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:57 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:57.308749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a83e372b-46ac-46d1-94fb-5534569271b1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:57.309357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a83e372b-46ac-46d1-94fb-5534569271b1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:57.316201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a83e372b-46ac-46d1-94fb-5534569271b1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:57.316642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a83e372b-46ac-46d1-94fb-5534569271b1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:57.317422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a83e372b-46ac-46d1-94fb-5534569271b1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:57.317863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a83e372b-46ac-46d1-94fb-5534569271b1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:57.485711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a83e372b-46ac-46d1-94fb-5534569271b1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:57.494007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a83e372b-46ac-46d1-94fb-5534569271b1 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.189420 Aug 01 15:49:57.494590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1161/2026] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:57 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:49:57.499204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cf36bf89-d808-4fd2-a73b-77f18d91eac7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:57.502131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cf36bf89-d808-4fd2-a73b-77f18d91eac7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:57.508216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf36bf89-d808-4fd2-a73b-77f18d91eac7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:57.508666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf36bf89-d808-4fd2-a73b-77f18d91eac7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:57.509480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf36bf89-d808-4fd2-a73b-77f18d91eac7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:57.509953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf36bf89-d808-4fd2-a73b-77f18d91eac7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:57.549874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cf36bf89-d808-4fd2-a73b-77f18d91eac7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054207 Aug 01 15:49:57.550483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1162/2027] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:57 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:58.324804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7f79164a-6f23-4b61-8391-6a91231ce6d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:58.325428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7f79164a-6f23-4b61-8391-6a91231ce6d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:58.329605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:58.334062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f79164a-6f23-4b61-8391-6a91231ce6d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:58.334516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f79164a-6f23-4b61-8391-6a91231ce6d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:58.335313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f79164a-6f23-4b61-8391-6a91231ce6d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:58.335790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f79164a-6f23-4b61-8391-6a91231ce6d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:58.468687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7f79164a-6f23-4b61-8391-6a91231ce6d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:58.472500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:49:58.477457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7f79164a-6f23-4b61-8391-6a91231ce6d4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.156594 Aug 01 15:49:58.478067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1163/2028] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:58 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:58.637839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c261cb4c-b4c2-413e-9005-ececa51876c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:58.638480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c261cb4c-b4c2-413e-9005-ececa51876c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:58.645104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c261cb4c-b4c2-413e-9005-ececa51876c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:58.645552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c261cb4c-b4c2-413e-9005-ececa51876c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:58.646349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c261cb4c-b4c2-413e-9005-ececa51876c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:58.646784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c261cb4c-b4c2-413e-9005-ececa51876c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:58.782920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c261cb4c-b4c2-413e-9005-ececa51876c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:49:58.790970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c261cb4c-b4c2-413e-9005-ececa51876c7 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.278692 Aug 01 15:49:58.796920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1164/2029] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:49:58 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:49:58.908802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6fc05f17-b415-4245-8bee-0c9693a7ff6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:58.911088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6fc05f17-b415-4245-8bee-0c9693a7ff6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:58.917247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6fc05f17-b415-4245-8bee-0c9693a7ff6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:58.917691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6fc05f17-b415-4245-8bee-0c9693a7ff6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:58.918482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6fc05f17-b415-4245-8bee-0c9693a7ff6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:58.918919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6fc05f17-b415-4245-8bee-0c9693a7ff6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:58.948240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6fc05f17-b415-4245-8bee-0c9693a7ff6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155649 Aug 01 15:49:58.948802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1165/2030] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:49:58 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:49:58.953992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8ae0ffbf-09ac-4d78-bc35-9febad9d5bce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:49:58.954492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8ae0ffbf-09ac-4d78-bc35-9febad9d5bce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:49:58.960190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ae0ffbf-09ac-4d78-bc35-9febad9d5bce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:58.960642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ae0ffbf-09ac-4d78-bc35-9febad9d5bce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:49:58.961404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ae0ffbf-09ac-4d78-bc35-9febad9d5bce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:49:58.961838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ae0ffbf-09ac-4d78-bc35-9febad9d5bce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:50:08.958524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=6 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:50:08.981127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=16 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:00.123166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-a10bc1cd-f4b2-40d7-866b-e86861b84144 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-99676af4-d50f-4db9-830e-9181e05ee3b1) Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a10bc1cd-f4b2-40d7-866b-e86861b84144 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Request method failure captured: Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf HTTP/1.1 Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_K53ddQWvF8bwwX7kPrpmXB-Ft4gpk37Z_xQqLmOiw7qzQc0ix5_nT8dQWyuY23pJ-Kp8DZ5Muml7xjPBHUc8LoO6PfskGPOrUZ9RKz2fqvze9FjRell81KUxGu4MHB1g-dHKhXvmVsu1ur8xU-2fAKxciMJycj3fu7Jp1bTJHl6wc Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:51:00.126089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:51:00.127528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/38f80d210cce4a41af527ac134deba93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_38f80d210cce4a41af527ac134deba93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}] Aug 01 15:51:00.127528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:51:00.127528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:51:00.127528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:51:00.127528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:51:00.127528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:51:00.127528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:51:00.127528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 77cb30fae1184064a8c4f822d4d31096 Aug 01 15:51:00.127528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:51:00.127528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-99676af4-d50f-4db9-830e-9181e05ee3b1) Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'server_id': '93144385-4cac-4970-9814-564a351af373', 'id': 'f418e61d-d2e6-4530-844c-fab840a592cf'} Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 01 15:51:00.129005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-99676af4-d50f-4db9-830e-9181e05ee3b1) Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:51:00.130462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-99676af4-d50f-4db9-830e-9181e05ee3b1) Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:00.133830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-99676af4-d50f-4db9-830e-9181e05ee3b1) Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:51:00.135129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-99676af4-d50f-4db9-830e-9181e05ee3b1) Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-99676af4-d50f-4db9-830e-9181e05ee3b1) Aug 01 15:51:00.137031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.138705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a10bc1cd-f4b2-40d7-866b-e86861b84144 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-99676af4-d50f-4db9-830e-9181e05ee3b1) {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:51:00.138705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a10bc1cd-f4b2-40d7-866b-e86861b84144 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf" status: 400 len: 269 microversion: 2.1 time: 120.442462 Aug 01 15:51:00.138705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 866/2031] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 1 15:48:59 2022] DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf => generated 269 bytes in 120443 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:51:00.138705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4db83d6c-7d21-44ee-8ff6-a9d4c5a080e7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:00.139139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4db83d6c-7d21-44ee-8ff6-a9d4c5a080e7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:00.141863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4db83d6c-7d21-44ee-8ff6-a9d4c5a080e7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.142339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4db83d6c-7d21-44ee-8ff6-a9d4c5a080e7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.143115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4db83d6c-7d21-44ee-8ff6-a9d4c5a080e7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.143559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4db83d6c-7d21-44ee-8ff6-a9d4c5a080e7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.289357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4db83d6c-7d21-44ee-8ff6-a9d4c5a080e7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:00.297661 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4db83d6c-7d21-44ee-8ff6-a9d4c5a080e7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.168489 Aug 01 15:51:00.298229 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 867/2032] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:00 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:00.302750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0c94e5c0-6e43-4c04-a625-8af117a6df6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:00.303360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0c94e5c0-6e43-4c04-a625-8af117a6df6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:00.309402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c94e5c0-6e43-4c04-a625-8af117a6df6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.309854 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c94e5c0-6e43-4c04-a625-8af117a6df6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.310664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c94e5c0-6e43-4c04-a625-8af117a6df6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.311113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c94e5c0-6e43-4c04-a625-8af117a6df6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.324481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.objects.instance [None req-8ae0ffbf-09ac-4d78-bc35-9febad9d5bce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lazy-loading 'services' on Instance uuid 93144385-4cac-4970-9814-564a351af373 {{(pid=124526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:51:00.450603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c94e5c0-6e43-4c04-a625-8af117a6df6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:00.460112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0c94e5c0-6e43-4c04-a625-8af117a6df6c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1733 microversion: 2.1 time: 0.160881 Aug 01 15:51:00.460685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 868/2033] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:00 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:00.465385 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bb50c04c-b285-4317-bddf-7057c82c2f3a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:00.468245 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bb50c04c-b285-4317-bddf-7057c82c2f3a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:00.475021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bb50c04c-b285-4317-bddf-7057c82c2f3a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.475366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bb50c04c-b285-4317-bddf-7057c82c2f3a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.476138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bb50c04c-b285-4317-bddf-7057c82c2f3a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.476568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bb50c04c-b285-4317-bddf-7057c82c2f3a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.509298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bb50c04c-b285-4317-bddf-7057c82c2f3a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047503 Aug 01 15:51:00.509870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 869/2034] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:00 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:00.510797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-8ae0ffbf-09ac-4d78-bc35-9febad9d5bce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ac30e53-b54a-4742-9596-94b5a551865f) Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8ae0ffbf-09ac-4d78-bc35-9febad9d5bce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Request method failure captured: Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf HTTP/1.1 Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_K53ddQWvF8bwwX7kPrpmXB-Ft4gpk37Z_xQqLmOiw7qzQc0ix5_nT8dQWyuY23pJ-Kp8DZ5Muml7xjPBHUc8LoO6PfskGPOrUZ9RKz2fqvze9FjRell81KUxGu4MHB1g-dHKhXvmVsu1ur8xU-2fAKxciMJycj3fu7Jp1bTJHl6wc Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 15:51:00.513311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 15:51:00.515561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/38f80d210cce4a41af527ac134deba93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_38f80d210cce4a41af527ac134deba93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}] Aug 01 15:51:00.515561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:51:00.515561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:51:00.515561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:51:00.515561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:51:00.515561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 15:51:00.515561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 15:51:00.515561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: 77cb30fae1184064a8c4f822d4d31096 Aug 01 15:51:00.515561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:51:00.515561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ac30e53-b54a-4742-9596-94b5a551865f) Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'server_id': '93144385-4cac-4970-9814-564a351af373', 'id': 'f418e61d-d2e6-4530-844c-fab840a592cf'} Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 01 15:51:00.516358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ac30e53-b54a-4742-9596-94b5a551865f) Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:51:00.517629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ac30e53-b54a-4742-9596-94b5a551865f) Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:00.519330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ac30e53-b54a-4742-9596-94b5a551865f) Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:51:00.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ac30e53-b54a-4742-9596-94b5a551865f) Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ac30e53-b54a-4742-9596-94b5a551865f) Aug 01 15:51:00.521687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 15:51:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a6f897cd-305a-47bd-9f4b-aafcb84f5bb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a6f897cd-305a-47bd-9f4b-aafcb84f5bb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6f897cd-305a-47bd-9f4b-aafcb84f5bb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6f897cd-305a-47bd-9f4b-aafcb84f5bb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.525994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6f897cd-305a-47bd-9f4b-aafcb84f5bb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.526087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8ae0ffbf-09ac-4d78-bc35-9febad9d5bce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ac30e53-b54a-4742-9596-94b5a551865f) {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:51:00.526240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6f897cd-305a-47bd-9f4b-aafcb84f5bb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.526347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8ae0ffbf-09ac-4d78-bc35-9febad9d5bce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf" status: 400 len: 269 microversion: 2.1 time: 61.574119 Aug 01 15:51:00.526347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1166/2035] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 1 15:49:58 2022] DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf => generated 269 bytes in 61575 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:51:00.533082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-703bf1d1-f9cf-41a9-b20b-b26a53e894cc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:00.534318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-703bf1d1-f9cf-41a9-b20b-b26a53e894cc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:00.541671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-703bf1d1-f9cf-41a9-b20b-b26a53e894cc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.542410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-703bf1d1-f9cf-41a9-b20b-b26a53e894cc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.543190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-703bf1d1-f9cf-41a9-b20b-b26a53e894cc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.543624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-703bf1d1-f9cf-41a9-b20b-b26a53e894cc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.652395 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-a6f897cd-305a-47bd-9f4b-aafcb84f5bb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lazy-loading 'services' on Instance uuid 93144385-4cac-4970-9814-564a351af373 {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:51:00.696452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-703bf1d1-f9cf-41a9-b20b-b26a53e894cc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:00.706343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-703bf1d1-f9cf-41a9-b20b-b26a53e894cc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.178673 Aug 01 15:51:00.706929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1167/2036] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:00 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:00.711998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-339af375-34c0-4bec-824d-7f648f51aa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:00.712864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-339af375-34c0-4bec-824d-7f648f51aa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 462946dd-1a7a-43ec-8d8f-ca88a2b90b13] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:00.720179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-339af375-34c0-4bec-824d-7f648f51aa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.721253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-339af375-34c0-4bec-824d-7f648f51aa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.722464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-339af375-34c0-4bec-824d-7f648f51aa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.722906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-339af375-34c0-4bec-824d-7f648f51aa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.860296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-339af375-34c0-4bec-824d-7f648f51aa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:00.868404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-339af375-34c0-4bec-824d-7f648f51aa79 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13" status: 200 len: 1687 microversion: 2.1 time: 0.160289 Aug 01 15:51:00.869026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1168/2037] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:00 2022] GET /compute/v2.1/servers/462946dd-1a7a-43ec-8d8f-ca88a2b90b13 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:00.874105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2f5c4c23-e9a9-4749-9c1a-f8fef192292e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:00.876588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2f5c4c23-e9a9-4749-9c1a-f8fef192292e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:00.884123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f5c4c23-e9a9-4749-9c1a-f8fef192292e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.884813 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f5c4c23-e9a9-4749-9c1a-f8fef192292e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.885760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f5c4c23-e9a9-4749-9c1a-f8fef192292e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:00.886317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f5c4c23-e9a9-4749-9c1a-f8fef192292e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:00.918773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2f5c4c23-e9a9-4749-9c1a-f8fef192292e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048535 Aug 01 15:51:00.919261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1169/2038] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:00 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:00.923642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0f9dbce4-fa6e-44d8-b866-4aa55ec05716 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '.version_select at 0x7feb16144820>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:00.946514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0f9dbce4-fa6e-44d8-b866-4aa55ec05716 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320122182" status: 202 len: 0 microversion: 2.1 time: 0.026199 Aug 01 15:51:00.947397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1170/2039] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 1 15:51:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320122182 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:51:01.739766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1df7ddbd-7974-46f6-ad9f-d5f8ed1b0e13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:01.746375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1df7ddbd-7974-46f6-ad9f-d5f8ed1b0e13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:01.760102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1df7ddbd-7974-46f6-ad9f-d5f8ed1b0e13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:01.761282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1df7ddbd-7974-46f6-ad9f-d5f8ed1b0e13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:01.762972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1df7ddbd-7974-46f6-ad9f-d5f8ed1b0e13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:01.764024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1df7ddbd-7974-46f6-ad9f-d5f8ed1b0e13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:01.986107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1df7ddbd-7974-46f6-ad9f-d5f8ed1b0e13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:01.994306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1df7ddbd-7974-46f6-ad9f-d5f8ed1b0e13 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.268931 Aug 01 15:51:01.994925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1171/2040] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:01 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:02.058045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-adf820ae-f5d6-441f-8da3-ba54a41dd63b req-25f9f715-a89d-4197-9215-0e6b5f22ab3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "462946dd-1a7a-43ec-8d8f-ca88a2b90b13", "name": "network-vif-deleted", "tag": "f498a708-36e0-44d2-bc24-58d436d77bf2"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:51:02.067797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-adf820ae-f5d6-441f-8da3-ba54a41dd63b req-25f9f715-a89d-4197-9215-0e6b5f22ab3b service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:02.068247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-adf820ae-f5d6-441f-8da3-ba54a41dd63b req-25f9f715-a89d-4197-9215-0e6b5f22ab3b service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:02.080423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-adf820ae-f5d6-441f-8da3-ba54a41dd63b req-25f9f715-a89d-4197-9215-0e6b5f22ab3b service nova] Creating event network-vif-deleted:f498a708-36e0-44d2-bc24-58d436d77bf2 for instance 462946dd-1a7a-43ec-8d8f-ca88a2b90b13 on hv-cinder-84753 Aug 01 15:51:02.086804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-adf820ae-f5d6-441f-8da3-ba54a41dd63b req-25f9f715-a89d-4197-9215-0e6b5f22ab3b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090541 Aug 01 15:51:02.087419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1172/2041] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:02.093515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8864c82f-65a9-44f8-bf62-540cab8d7a61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:02.096074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8864c82f-65a9-44f8-bf62-540cab8d7a61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:02.102686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8864c82f-65a9-44f8-bf62-540cab8d7a61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:02.103143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8864c82f-65a9-44f8-bf62-540cab8d7a61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:02.103925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8864c82f-65a9-44f8-bf62-540cab8d7a61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:02.104366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8864c82f-65a9-44f8-bf62-540cab8d7a61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:02.137463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8864c82f-65a9-44f8-bf62-540cab8d7a61 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048809 Aug 01 15:51:02.138188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1173/2042] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:02 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:03.016552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1866cebc-a675-47b5-a483-b520e4cdc4bf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:03.017237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1866cebc-a675-47b5-a483-b520e4cdc4bf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:03.024950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1866cebc-a675-47b5-a483-b520e4cdc4bf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:03.025514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1866cebc-a675-47b5-a483-b520e4cdc4bf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:03.026544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1866cebc-a675-47b5-a483-b520e4cdc4bf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:03.026994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1866cebc-a675-47b5-a483-b520e4cdc4bf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:03.166554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1866cebc-a675-47b5-a483-b520e4cdc4bf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:03.174253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1866cebc-a675-47b5-a483-b520e4cdc4bf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.162219 Aug 01 15:51:03.174830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1174/2043] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:03 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:03.179642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4ab75d02-a5fe-4635-b067-7a01dc8ea329 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:03.181784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4ab75d02-a5fe-4635-b067-7a01dc8ea329 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:03.188371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ab75d02-a5fe-4635-b067-7a01dc8ea329 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:03.188864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ab75d02-a5fe-4635-b067-7a01dc8ea329 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:03.189721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ab75d02-a5fe-4635-b067-7a01dc8ea329 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:03.190192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ab75d02-a5fe-4635-b067-7a01dc8ea329 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:03.219768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4ab75d02-a5fe-4635-b067-7a01dc8ea329 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 Aug 01 15:51:03.220327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1175/2044] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:03 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:04.196876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-15f01942-2cb3-4d51-9a5d-02c7b0f0547d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:04.197545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-15f01942-2cb3-4d51-9a5d-02c7b0f0547d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:04.204663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15f01942-2cb3-4d51-9a5d-02c7b0f0547d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:04.205111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15f01942-2cb3-4d51-9a5d-02c7b0f0547d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:04.205865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15f01942-2cb3-4d51-9a5d-02c7b0f0547d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:04.206318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15f01942-2cb3-4d51-9a5d-02c7b0f0547d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:04.340566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-15f01942-2cb3-4d51-9a5d-02c7b0f0547d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:04.348654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-15f01942-2cb3-4d51-9a5d-02c7b0f0547d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.155648 Aug 01 15:51:04.349225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1176/2045] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:04 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:04.353915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-de98ca9a-e80c-4958-8d9d-4e5c2c168d97 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:04.356104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-de98ca9a-e80c-4958-8d9d-4e5c2c168d97 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:04.362772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-de98ca9a-e80c-4958-8d9d-4e5c2c168d97 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:04.363226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-de98ca9a-e80c-4958-8d9d-4e5c2c168d97 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:04.364090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-de98ca9a-e80c-4958-8d9d-4e5c2c168d97 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:04.364583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-de98ca9a-e80c-4958-8d9d-4e5c2c168d97 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:04.395129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-de98ca9a-e80c-4958-8d9d-4e5c2c168d97 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044869 Aug 01 15:51:04.395694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1177/2046] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:04 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:05.371634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1fc47a53-b9b6-4243-9763-6aeb4d23a49b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:05.372717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1fc47a53-b9b6-4243-9763-6aeb4d23a49b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:05.382604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fc47a53-b9b6-4243-9763-6aeb4d23a49b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:05.383050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fc47a53-b9b6-4243-9763-6aeb4d23a49b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:05.383819 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fc47a53-b9b6-4243-9763-6aeb4d23a49b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:05.384243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1fc47a53-b9b6-4243-9763-6aeb4d23a49b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:05.526741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1fc47a53-b9b6-4243-9763-6aeb4d23a49b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:05.535318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1fc47a53-b9b6-4243-9763-6aeb4d23a49b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.169200 Aug 01 15:51:05.535887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1178/2047] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:05 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:05.540718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c3c6c82b-3254-4b3c-a986-c8198379398f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:05.542880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c3c6c82b-3254-4b3c-a986-c8198379398f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:05.549745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3c6c82b-3254-4b3c-a986-c8198379398f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:05.549963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3c6c82b-3254-4b3c-a986-c8198379398f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:05.550628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3c6c82b-3254-4b3c-a986-c8198379398f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:05.551064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3c6c82b-3254-4b3c-a986-c8198379398f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:05.580208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c3c6c82b-3254-4b3c-a986-c8198379398f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043271 Aug 01 15:51:05.580793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1179/2048] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:05 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:06.557572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-190bc4be-f07c-454d-98ab-3a35d6775d4f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:06.558305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-190bc4be-f07c-454d-98ab-3a35d6775d4f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:06.564792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-190bc4be-f07c-454d-98ab-3a35d6775d4f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:06.565280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-190bc4be-f07c-454d-98ab-3a35d6775d4f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:06.566096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-190bc4be-f07c-454d-98ab-3a35d6775d4f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:06.566538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-190bc4be-f07c-454d-98ab-3a35d6775d4f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:06.702033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-190bc4be-f07c-454d-98ab-3a35d6775d4f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:06.709640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-190bc4be-f07c-454d-98ab-3a35d6775d4f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.155987 Aug 01 15:51:06.710244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1180/2049] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:06 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:06.714811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7d631793-a3f4-435c-8834-22e86cbe62e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:06.716978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7d631793-a3f4-435c-8834-22e86cbe62e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:06.723952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d631793-a3f4-435c-8834-22e86cbe62e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:06.724403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d631793-a3f4-435c-8834-22e86cbe62e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:06.725178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d631793-a3f4-435c-8834-22e86cbe62e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:06.725614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d631793-a3f4-435c-8834-22e86cbe62e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:06.755349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7d631793-a3f4-435c-8834-22e86cbe62e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Aug 01 15:51:06.755922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1181/2050] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:06 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:07.735892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0a312623-6e77-4a64-89cc-beab8818443b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:07.736567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0a312623-6e77-4a64-89cc-beab8818443b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:07.742931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a312623-6e77-4a64-89cc-beab8818443b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:07.743378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a312623-6e77-4a64-89cc-beab8818443b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:07.744130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a312623-6e77-4a64-89cc-beab8818443b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:07.744558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a312623-6e77-4a64-89cc-beab8818443b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:07.880929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0a312623-6e77-4a64-89cc-beab8818443b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:07.890154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0a312623-6e77-4a64-89cc-beab8818443b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.158683 Aug 01 15:51:07.891066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1182/2051] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:07 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:07.895833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0b12d701-d1a3-411d-8742-631bde5967a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:07.898006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0b12d701-d1a3-411d-8742-631bde5967a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:07.905107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b12d701-d1a3-411d-8742-631bde5967a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:07.905412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b12d701-d1a3-411d-8742-631bde5967a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:07.906222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b12d701-d1a3-411d-8742-631bde5967a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:07.906650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b12d701-d1a3-411d-8742-631bde5967a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:07.936747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0b12d701-d1a3-411d-8742-631bde5967a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044647 Aug 01 15:51:07.937297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1183/2052] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:07 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:08.912848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-585caf01-eef9-43ec-8e3a-7e6f6dd3a869 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:08.913541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-585caf01-eef9-43ec-8e3a-7e6f6dd3a869 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:08.920064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-585caf01-eef9-43ec-8e3a-7e6f6dd3a869 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:08.920665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-585caf01-eef9-43ec-8e3a-7e6f6dd3a869 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:08.921418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-585caf01-eef9-43ec-8e3a-7e6f6dd3a869 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:08.921856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-585caf01-eef9-43ec-8e3a-7e6f6dd3a869 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:08.940376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:09.063399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-585caf01-eef9-43ec-8e3a-7e6f6dd3a869 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:09.071171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-585caf01-eef9-43ec-8e3a-7e6f6dd3a869 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.162488 Aug 01 15:51:09.071741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1184/2053] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:08 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:09.076847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e293ed02-9a54-4b55-b4a0-0abdbe8ec21b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:09.079015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e293ed02-9a54-4b55-b4a0-0abdbe8ec21b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:09.084968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e293ed02-9a54-4b55-b4a0-0abdbe8ec21b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:09.085415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e293ed02-9a54-4b55-b4a0-0abdbe8ec21b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:09.086201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e293ed02-9a54-4b55-b4a0-0abdbe8ec21b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:09.086636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e293ed02-9a54-4b55-b4a0-0abdbe8ec21b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:09.115846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e293ed02-9a54-4b55-b4a0-0abdbe8ec21b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043064 Aug 01 15:51:09.116438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1185/2054] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:09 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:10.093223 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b623b8c4-5adf-4cf8-97f7-24b2593f80b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:10.093830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b623b8c4-5adf-4cf8-97f7-24b2593f80b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:10.100841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b623b8c4-5adf-4cf8-97f7-24b2593f80b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:10.101235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b623b8c4-5adf-4cf8-97f7-24b2593f80b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:10.102040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b623b8c4-5adf-4cf8-97f7-24b2593f80b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:10.102488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b623b8c4-5adf-4cf8-97f7-24b2593f80b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:10.237464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b623b8c4-5adf-4cf8-97f7-24b2593f80b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:10.245134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b623b8c4-5adf-4cf8-97f7-24b2593f80b2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.155766 Aug 01 15:51:10.245714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1186/2055] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:10 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:10.250797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-115a4da0-142a-424d-bdea-ec3848345786 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:10.252933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-115a4da0-142a-424d-bdea-ec3848345786 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:10.259073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-115a4da0-142a-424d-bdea-ec3848345786 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:10.259532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-115a4da0-142a-424d-bdea-ec3848345786 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:10.260299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-115a4da0-142a-424d-bdea-ec3848345786 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:10.260737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-115a4da0-142a-424d-bdea-ec3848345786 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:10.290391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-115a4da0-142a-424d-bdea-ec3848345786 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043583 Aug 01 15:51:10.290950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1187/2056] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:10 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:10.521720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=8 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:10.657198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=26 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:11.267143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-175e694e-48ce-4dc5-b0b2-1dfa4ab4dc9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:11.267710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-175e694e-48ce-4dc5-b0b2-1dfa4ab4dc9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:11.274297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-175e694e-48ce-4dc5-b0b2-1dfa4ab4dc9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:11.274752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-175e694e-48ce-4dc5-b0b2-1dfa4ab4dc9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:11.275522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-175e694e-48ce-4dc5-b0b2-1dfa4ab4dc9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:11.275960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-175e694e-48ce-4dc5-b0b2-1dfa4ab4dc9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:11.409124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-175e694e-48ce-4dc5-b0b2-1dfa4ab4dc9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:11.416812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-175e694e-48ce-4dc5-b0b2-1dfa4ab4dc9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.153695 Aug 01 15:51:11.417378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1188/2057] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:11 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:11.422458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-55be1424-8e73-4de6-af6d-26c2cebfc7fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:11.424628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-55be1424-8e73-4de6-af6d-26c2cebfc7fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:11.431362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55be1424-8e73-4de6-af6d-26c2cebfc7fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:11.431814 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55be1424-8e73-4de6-af6d-26c2cebfc7fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:11.432602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55be1424-8e73-4de6-af6d-26c2cebfc7fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:11.433041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55be1424-8e73-4de6-af6d-26c2cebfc7fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:11.463289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-55be1424-8e73-4de6-af6d-26c2cebfc7fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044871 Aug 01 15:51:11.463858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1189/2058] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:11 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:12.439289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0b099bbd-463a-457a-973a-bfba5ddc83cf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:12.439982 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0b099bbd-463a-457a-973a-bfba5ddc83cf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:12.446553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b099bbd-463a-457a-973a-bfba5ddc83cf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:12.446999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b099bbd-463a-457a-973a-bfba5ddc83cf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:12.447762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b099bbd-463a-457a-973a-bfba5ddc83cf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:12.448193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b099bbd-463a-457a-973a-bfba5ddc83cf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:12.584040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0b099bbd-463a-457a-973a-bfba5ddc83cf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:12.592960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0b099bbd-463a-457a-973a-bfba5ddc83cf tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.156357 Aug 01 15:51:12.594945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1190/2059] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:12 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:12.600237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6a4591bc-16ae-4747-b3f8-3245c3521a19 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:12.602550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6a4591bc-16ae-4747-b3f8-3245c3521a19 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:12.610708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a4591bc-16ae-4747-b3f8-3245c3521a19 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:12.611170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a4591bc-16ae-4747-b3f8-3245c3521a19 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:12.611952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a4591bc-16ae-4747-b3f8-3245c3521a19 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:12.612389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a4591bc-16ae-4747-b3f8-3245c3521a19 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:12.642526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6a4591bc-16ae-4747-b3f8-3245c3521a19 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046490 Aug 01 15:51:12.643096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1191/2060] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:12 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:13.614610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aa7131cc-a1dd-4d36-9e7e-33d9ee9f3573 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:13.615322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aa7131cc-a1dd-4d36-9e7e-33d9ee9f3573 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:13.622006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa7131cc-a1dd-4d36-9e7e-33d9ee9f3573 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:13.622501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa7131cc-a1dd-4d36-9e7e-33d9ee9f3573 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:13.623906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa7131cc-a1dd-4d36-9e7e-33d9ee9f3573 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:13.624400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa7131cc-a1dd-4d36-9e7e-33d9ee9f3573 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:13.758433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aa7131cc-a1dd-4d36-9e7e-33d9ee9f3573 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:13.766199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aa7131cc-a1dd-4d36-9e7e-33d9ee9f3573 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.155503 Aug 01 15:51:13.766814 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1192/2061] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:13 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:13.771571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-da218ec2-d898-45bb-bfbd-306a3e19f697 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:13.773717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-da218ec2-d898-45bb-bfbd-306a3e19f697 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:13.780224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da218ec2-d898-45bb-bfbd-306a3e19f697 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:13.780680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da218ec2-d898-45bb-bfbd-306a3e19f697 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:13.781449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da218ec2-d898-45bb-bfbd-306a3e19f697 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:13.781905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da218ec2-d898-45bb-bfbd-306a3e19f697 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:13.812715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-da218ec2-d898-45bb-bfbd-306a3e19f697 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Aug 01 15:51:13.813284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1193/2062] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:13 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:14.788210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-29dae225-8171-4dae-bf68-cdace0badef3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:14.788911 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-29dae225-8171-4dae-bf68-cdace0badef3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:14.796017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29dae225-8171-4dae-bf68-cdace0badef3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:14.796460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29dae225-8171-4dae-bf68-cdace0badef3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:14.797228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29dae225-8171-4dae-bf68-cdace0badef3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:14.797665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29dae225-8171-4dae-bf68-cdace0badef3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:14.953100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-29dae225-8171-4dae-bf68-cdace0badef3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:14.961525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-29dae225-8171-4dae-bf68-cdace0badef3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.177248 Aug 01 15:51:14.962117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1194/2063] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:14 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:14.969100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-51f4c146-0e7e-480e-8c2f-2551b56de389 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:14.974215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-51f4c146-0e7e-480e-8c2f-2551b56de389 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:14.976659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-51f4c146-0e7e-480e-8c2f-2551b56de389 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:14.977100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-51f4c146-0e7e-480e-8c2f-2551b56de389 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:14.977863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-51f4c146-0e7e-480e-8c2f-2551b56de389 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:14.978323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-51f4c146-0e7e-480e-8c2f-2551b56de389 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:15.008118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-51f4c146-0e7e-480e-8c2f-2551b56de389 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044946 Aug 01 15:51:15.008689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1195/2064] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:14 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:15.984519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-41217820-f9aa-427a-aaeb-3bd78c20fb2c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:15.985205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-41217820-f9aa-427a-aaeb-3bd78c20fb2c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:15.991810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41217820-f9aa-427a-aaeb-3bd78c20fb2c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:15.992263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41217820-f9aa-427a-aaeb-3bd78c20fb2c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:15.993039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41217820-f9aa-427a-aaeb-3bd78c20fb2c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:15.993513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41217820-f9aa-427a-aaeb-3bd78c20fb2c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:16.129195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-41217820-f9aa-427a-aaeb-3bd78c20fb2c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:16.136757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-41217820-f9aa-427a-aaeb-3bd78c20fb2c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.156112 Aug 01 15:51:16.137318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1196/2065] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:15 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:16.142613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ae7af853-12b9-4328-9b47-3773622ebe80 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:16.144722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ae7af853-12b9-4328-9b47-3773622ebe80 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:16.150516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae7af853-12b9-4328-9b47-3773622ebe80 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:16.150961 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae7af853-12b9-4328-9b47-3773622ebe80 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:16.151729 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae7af853-12b9-4328-9b47-3773622ebe80 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:16.152143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae7af853-12b9-4328-9b47-3773622ebe80 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:16.180418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ae7af853-12b9-4328-9b47-3773622ebe80 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042090 Aug 01 15:51:16.180963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1197/2066] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:16 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:17.159829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7bf14892-2dd8-4706-86f5-b261cf6d7aa9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:17.160512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7bf14892-2dd8-4706-86f5-b261cf6d7aa9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:17.167053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7bf14892-2dd8-4706-86f5-b261cf6d7aa9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:17.167506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7bf14892-2dd8-4706-86f5-b261cf6d7aa9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:17.168271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7bf14892-2dd8-4706-86f5-b261cf6d7aa9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:17.168716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7bf14892-2dd8-4706-86f5-b261cf6d7aa9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:17.308155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7bf14892-2dd8-4706-86f5-b261cf6d7aa9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:17.315742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7bf14892-2dd8-4706-86f5-b261cf6d7aa9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.159934 Aug 01 15:51:17.316326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1198/2067] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:17 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:17.320917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8d67a1af-4c24-4298-b772-b3597ca7586d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:17.323179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8d67a1af-4c24-4298-b772-b3597ca7586d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:17.329930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d67a1af-4c24-4298-b772-b3597ca7586d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:17.330389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d67a1af-4c24-4298-b772-b3597ca7586d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:17.331168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d67a1af-4c24-4298-b772-b3597ca7586d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:17.331607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d67a1af-4c24-4298-b772-b3597ca7586d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:17.362961 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8d67a1af-4c24-4298-b772-b3597ca7586d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Aug 01 15:51:17.363542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1199/2068] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 1 15:51:17 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:51:18.337596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cfe5747c-158d-4d9e-a59a-e4c6cbc512b7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:18.338286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cfe5747c-158d-4d9e-a59a-e4c6cbc512b7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:18.345305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cfe5747c-158d-4d9e-a59a-e4c6cbc512b7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:18.346054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cfe5747c-158d-4d9e-a59a-e4c6cbc512b7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:18.346822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cfe5747c-158d-4d9e-a59a-e4c6cbc512b7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:18.347261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cfe5747c-158d-4d9e-a59a-e4c6cbc512b7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:18.478927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cfe5747c-158d-4d9e-a59a-e4c6cbc512b7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:18.487150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cfe5747c-158d-4d9e-a59a-e4c6cbc512b7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.153546 Aug 01 15:51:18.487744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1200/2069] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:18 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:18.492197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dd6818ab-f08a-42df-a094-5bc2bdc71dc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:51:18.494411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dd6818ab-f08a-42df-a094-5bc2bdc71dc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:18.500380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd6818ab-f08a-42df-a094-5bc2bdc71dc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:18.500827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd6818ab-f08a-42df-a094-5bc2bdc71dc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:18.501596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd6818ab-f08a-42df-a094-5bc2bdc71dc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:18.502069 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd6818ab-f08a-42df-a094-5bc2bdc71dc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:18.506088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:18.593277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dd6818ab-f08a-42df-a094-5bc2bdc71dc9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "POST /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/action" status: 200 len: 76089 microversion: 2.1 time: 0.104184 Aug 01 15:51:18.594005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1201/2070] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 1 15:51:18 2022] POST /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63/action => generated 76089 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:51:19.509023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b14392c5-000a-4b58-ba4c-ff71a024c8af tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:19.509725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b14392c5-000a-4b58-ba4c-ff71a024c8af tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:19.517214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b14392c5-000a-4b58-ba4c-ff71a024c8af tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:19.517668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b14392c5-000a-4b58-ba4c-ff71a024c8af tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:19.518463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b14392c5-000a-4b58-ba4c-ff71a024c8af tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:19.518909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b14392c5-000a-4b58-ba4c-ff71a024c8af tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:19.652192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b14392c5-000a-4b58-ba4c-ff71a024c8af tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:19.660317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b14392c5-000a-4b58-ba4c-ff71a024c8af tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1450 microversion: 2.1 time: 0.155500 Aug 01 15:51:19.660880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1202/2071] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:19 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:19.971822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-a6f897cd-305a-47bd-9f4b-aafcb84f5bb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-848a1ce3-e88b-43c2-80e8-c11cd95ddf12) Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a6f897cd-305a-47bd-9f4b-aafcb84f5bb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Request method failure captured: Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf HTTP/1.1 Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_K53ddQWvF8bwwX7kPrpmXB-Ft4gpk37Z_xQqLmOiw7qzQc0ix5_nT8dQWyuY23pJ-Kp8DZ5Muml7xjPBHUc8LoO6PfskGPOrUZ9RKz2fqvze9FjRell81KUxGu4MHB1g-dHKhXvmVsu1ur8xU-2fAKxciMJycj3fu7Jp1bTJHl6wc Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:51:19.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:51:19.977761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/38f80d210cce4a41af527ac134deba93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_38f80d210cce4a41af527ac134deba93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/38f80d210cce4a41af527ac134deba93"}]}] Aug 01 15:51:19.977761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:51:19.977761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 38f80d210cce4a41af527ac134deba93 Aug 01 15:51:19.977761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1339515971 Aug 01 15:51:19.977761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:51:19.977761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:51:19.977761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:51:19.977761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 77cb30fae1184064a8c4f822d4d31096 Aug 01 15:51:19.977761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-VolumesSnapshotTestJSON-1339515971-project Aug 01 15:51:19.977761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-848a1ce3-e88b-43c2-80e8-c11cd95ddf12) Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'server_id': '93144385-4cac-4970-9814-564a351af373', 'id': 'f418e61d-d2e6-4530-844c-fab840a592cf'} Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 01 15:51:19.978556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-848a1ce3-e88b-43c2-80e8-c11cd95ddf12) Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:51:19.979677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-848a1ce3-e88b-43c2-80e8-c11cd95ddf12) Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:19.980857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-848a1ce3-e88b-43c2-80e8-c11cd95ddf12) Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:51:19.984302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-848a1ce3-e88b-43c2-80e8-c11cd95ddf12) Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-848a1ce3-e88b-43c2-80e8-c11cd95ddf12) Aug 01 15:51:19.985751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:19.987075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a6f897cd-305a-47bd-9f4b-aafcb84f5bb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-848a1ce3-e88b-43c2-80e8-c11cd95ddf12) {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:51:19.987075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a6f897cd-305a-47bd-9f4b-aafcb84f5bb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf" status: 400 len: 269 microversion: 2.1 time: 19.467073 Aug 01 15:51:19.987075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 870/2072] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 1 15:51:00 2022] DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373/os-volume_attachments/f418e61d-d2e6-4530-844c-fab840a592cf => generated 269 bytes in 19469 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:51:20.032775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-580870a5-db4a-4dc7-98a8-e20cf430e927 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:20.033288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-580870a5-db4a-4dc7-98a8-e20cf430e927 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:20.040367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-580870a5-db4a-4dc7-98a8-e20cf430e927 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:20.040835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-580870a5-db4a-4dc7-98a8-e20cf430e927 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:20.041618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-580870a5-db4a-4dc7-98a8-e20cf430e927 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:20.042126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-580870a5-db4a-4dc7-98a8-e20cf430e927 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:20.070898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-580870a5-db4a-4dc7-98a8-e20cf430e927 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:51:20.100981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-17ba3401-92d1-4ee7-b3af-8a5fcc8b7405 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:20.101468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-17ba3401-92d1-4ee7-b3af-8a5fcc8b7405 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:20.108004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17ba3401-92d1-4ee7-b3af-8a5fcc8b7405 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:20.108702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17ba3401-92d1-4ee7-b3af-8a5fcc8b7405 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:20.109553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17ba3401-92d1-4ee7-b3af-8a5fcc8b7405 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:20.109914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17ba3401-92d1-4ee7-b3af-8a5fcc8b7405 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:20.137035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-17ba3401-92d1-4ee7-b3af-8a5fcc8b7405 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Going to try to terminate instance {{(pid=124527) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:51:20.200665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-580870a5-db4a-4dc7-98a8-e20cf430e927 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 204 len: 0 microversion: 2.1 time: 0.171491 Aug 01 15:51:20.206287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1203/2073] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 15:51:20 2022] DELETE /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:51:20.229220 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fac2bb1d-45b0-4c49-a181-0e7a97721744 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:20.235058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fac2bb1d-45b0-4c49-a181-0e7a97721744 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:20.244112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-17ba3401-92d1-4ee7-b3af-8a5fcc8b7405 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 204 len: 0 microversion: 2.1 time: 0.146988 Aug 01 15:51:20.246507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 871/2074] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 15:51:20 2022] DELETE /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:51:20.259932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fac2bb1d-45b0-4c49-a181-0e7a97721744 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:20.259932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fac2bb1d-45b0-4c49-a181-0e7a97721744 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:20.261156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-08485d8c-7175-43ef-8496-091fc3fbaf60 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:20.261440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fac2bb1d-45b0-4c49-a181-0e7a97721744 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:20.262008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fac2bb1d-45b0-4c49-a181-0e7a97721744 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:20.262910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-08485d8c-7175-43ef-8496-091fc3fbaf60 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:20.270295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08485d8c-7175-43ef-8496-091fc3fbaf60 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:20.270925 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08485d8c-7175-43ef-8496-091fc3fbaf60 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:20.271728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08485d8c-7175-43ef-8496-091fc3fbaf60 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:20.272241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-08485d8c-7175-43ef-8496-091fc3fbaf60 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:20.640330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fac2bb1d-45b0-4c49-a181-0e7a97721744 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:20.648877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fac2bb1d-45b0-4c49-a181-0e7a97721744 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1555 microversion: 2.1 time: 0.433623 Aug 01 15:51:20.649462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1204/2075] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:20 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1555 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:20.654602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-08485d8c-7175-43ef-8496-091fc3fbaf60 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:20.670618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-08485d8c-7175-43ef-8496-091fc3fbaf60 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.414792 Aug 01 15:51:20.670618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 872/2076] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:20 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:20.682931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-153bbd78-9e15-4328-97d6-1da4bde5c15c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:20.683915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-153bbd78-9e15-4328-97d6-1da4bde5c15c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:20.690348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-153bbd78-9e15-4328-97d6-1da4bde5c15c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:20.690800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-153bbd78-9e15-4328-97d6-1da4bde5c15c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:20.691563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-153bbd78-9e15-4328-97d6-1da4bde5c15c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:20.691998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-153bbd78-9e15-4328-97d6-1da4bde5c15c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:20.909377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-153bbd78-9e15-4328-97d6-1da4bde5c15c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:20.922287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-153bbd78-9e15-4328-97d6-1da4bde5c15c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1444 microversion: 2.1 time: 0.243693 Aug 01 15:51:20.923330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1205/2077] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:20 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1444 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:21.072226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-cb28c676-5aff-4cd3-82e2-74f0080d0ca3 req-30a7aac2-5675-49c6-8e24-0878270bd31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f0755f-45c5-4c98-96b7-9c4b6415d331", "name": "network-vif-deleted", "tag": "6c507929-7001-4435-a0b5-2d19c503a391"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:51:21.083623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-cb28c676-5aff-4cd3-82e2-74f0080d0ca3 req-30a7aac2-5675-49c6-8e24-0878270bd31d service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:21.084102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-cb28c676-5aff-4cd3-82e2-74f0080d0ca3 req-30a7aac2-5675-49c6-8e24-0878270bd31d service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:21.096894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-cb28c676-5aff-4cd3-82e2-74f0080d0ca3 req-30a7aac2-5675-49c6-8e24-0878270bd31d service nova] Creating event network-vif-deleted:6c507929-7001-4435-a0b5-2d19c503a391 for instance 58f0755f-45c5-4c98-96b7-9c4b6415d331 on hv-cinder-84753 Aug 01 15:51:21.102169 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-cb28c676-5aff-4cd3-82e2-74f0080d0ca3 req-30a7aac2-5675-49c6-8e24-0878270bd31d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033908 Aug 01 15:51:21.102767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 873/2078] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:51:21.671144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d838f129-e09b-47b3-a849-d2b09b6c984e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:21.671761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d838f129-e09b-47b3-a849-d2b09b6c984e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:21.678416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d838f129-e09b-47b3-a849-d2b09b6c984e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:21.678869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d838f129-e09b-47b3-a849-d2b09b6c984e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:21.679647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d838f129-e09b-47b3-a849-d2b09b6c984e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:21.680080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d838f129-e09b-47b3-a849-d2b09b6c984e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:21.693915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-22b9cc48-0633-407a-ad9e-751da26b1150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:21.695387 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-22b9cc48-0633-407a-ad9e-751da26b1150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:21.705124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22b9cc48-0633-407a-ad9e-751da26b1150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:21.705582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22b9cc48-0633-407a-ad9e-751da26b1150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:21.706598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22b9cc48-0633-407a-ad9e-751da26b1150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:21.707685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22b9cc48-0633-407a-ad9e-751da26b1150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:21.762608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d838f129-e09b-47b3-a849-d2b09b6c984e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a26637889378427eb884eed624606fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3762799522514a268a4c8b8069baa882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:21.772083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d838f129-e09b-47b3-a849-d2b09b6c984e tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 200 len: 1513 microversion: 2.1 time: 0.104900 Aug 01 15:51:21.772658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1206/2079] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:21 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 1513 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:21.859006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-22b9cc48-0633-407a-ad9e-751da26b1150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:21.867674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-22b9cc48-0633-407a-ad9e-751da26b1150 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.178589 Aug 01 15:51:21.868252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 874/2080] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:21 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:21.944452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fea11e84-ded4-4deb-b5ac-7eb41f5a843a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:21.944984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fea11e84-ded4-4deb-b5ac-7eb41f5a843a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:21.951739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fea11e84-ded4-4deb-b5ac-7eb41f5a843a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:21.952277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fea11e84-ded4-4deb-b5ac-7eb41f5a843a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:21.953568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fea11e84-ded4-4deb-b5ac-7eb41f5a843a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:21.954149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fea11e84-ded4-4deb-b5ac-7eb41f5a843a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:22.021833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fea11e84-ded4-4deb-b5ac-7eb41f5a843a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:22.030275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fea11e84-ded4-4deb-b5ac-7eb41f5a843a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.089564 Aug 01 15:51:22.031022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1207/2081] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:21 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:22.793960 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a0c71e6d-a84f-44ef-8f26-999a011a2af7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:22.794982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a0c71e6d-a84f-44ef-8f26-999a011a2af7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] [instance: f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:22.801671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0c71e6d-a84f-44ef-8f26-999a011a2af7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:22.802147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0c71e6d-a84f-44ef-8f26-999a011a2af7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:22.802915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0c71e6d-a84f-44ef-8f26-999a011a2af7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:22.803346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0c71e6d-a84f-44ef-8f26-999a011a2af7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:22.817285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-a0c71e6d-a84f-44ef-8f26-999a011a2af7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] HTTP exception thrown: Instance f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 could not be found. Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a0c71e6d-a84f-44ef-8f26-999a011a2af7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Request method failure captured: Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 HTTP/1.1 Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_MRSx18qe0-nMQRCVTOOtvqQSKI6CbtrErBuIPA714SaR67jdqB1E-1QAQRrQSaE0Gfs0uGZLVllaEEW7KEgNFzO0C58U2szW0wH5qbWxKQOP84ic7gs0AyvppSL9mw9o70sdobvJAaWzxh27FKJ8ypKisgxF_qOUoN1RGH2a1YMnQ Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 3762799522514a268a4c8b8069baa882 Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-TestMinimumBasicScenario-1379656926 Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 15:51:22.819020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 15:51:22.820623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3762799522514a268a4c8b8069baa882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3762799522514a268a4c8b8069baa882"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3762799522514a268a4c8b8069baa882"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3762799522514a268a4c8b8069baa882"}]}] Aug 01 15:51:22.820623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-TestMinimumBasicScenario-1379656926 Aug 01 15:51:22.820623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 3762799522514a268a4c8b8069baa882 Aug 01 15:51:22.820623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1379656926 Aug 01 15:51:22.820623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-TestMinimumBasicScenario-1379656926-project Aug 01 15:51:22.820623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 15:51:22.820623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 15:51:22.820623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: a26637889378427eb884eed624606fd5 Aug 01 15:51:22.820623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-TestMinimumBasicScenario-1379656926-project Aug 01 15:51:22.820623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 15:51:22.820623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 could not be found. Aug 01 15:51:22.820623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': 'f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7'} Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 could not be found. Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:51:22.821495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 could not be found. Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 could not be found. Aug 01 15:51:22.822782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 15:51:22.823894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a0c71e6d-a84f-44ef-8f26-999a011a2af7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Returning 404 to user: Instance f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:51:22.823894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a0c71e6d-a84f-44ef-8f26-999a011a2af7 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7" status: 404 len: 111 microversion: 2.1 time: 0.030433 Aug 01 15:51:22.823894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 875/2082] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:22 2022] GET /compute/v2.1/servers/f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:51:22.829816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dd5269e3-405b-41a6-a04b-b24806dd14f5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] Calling method '.version_select at 0x7feb1a9a1310>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:22.849470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dd5269e3-405b-41a6-a04b-b24806dd14f5 tempest-TestMinimumBasicScenario-1379656926 tempest-TestMinimumBasicScenario-1379656926-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1779330007" status: 202 len: 0 microversion: 2.1 time: 0.023967 Aug 01 15:51:22.850090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1208/2083] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 1 15:51:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1779330007 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:51:22.888709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-02eff610-183e-4a01-ac96-a7c615f886f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:22.889414 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-02eff610-183e-4a01-ac96-a7c615f886f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:22.898129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-02eff610-183e-4a01-ac96-a7c615f886f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:22.898846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-02eff610-183e-4a01-ac96-a7c615f886f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:22.900053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-02eff610-183e-4a01-ac96-a7c615f886f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:22.900734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-02eff610-183e-4a01-ac96-a7c615f886f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:23.043802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-02eff610-183e-4a01-ac96-a7c615f886f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:23.053401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3e152678-974f-4406-b9de-3c9b5de48788 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:23.054470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3e152678-974f-4406-b9de-3c9b5de48788 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:23.056322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-02eff610-183e-4a01-ac96-a7c615f886f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.171231 Aug 01 15:51:23.057006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 876/2084] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:22 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:23.060750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e152678-974f-4406-b9de-3c9b5de48788 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:23.062379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e152678-974f-4406-b9de-3c9b5de48788 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:23.062829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e152678-974f-4406-b9de-3c9b5de48788 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:23.063371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3e152678-974f-4406-b9de-3c9b5de48788 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:23.132196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3e152678-974f-4406-b9de-3c9b5de48788 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:23.133453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-2677dd09-3587-4746-be1d-86294f497ba7 req-e6fd78e7-e3ab-4b72-b403-382e09df6efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7", "name": "network-vif-deleted", "tag": "363ae4d1-ef88-47d5-a3fb-e1b35283078c"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:51:23.140317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3e152678-974f-4406-b9de-3c9b5de48788 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.091346 Aug 01 15:51:23.146039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1209/2085] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:23 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:23.148307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-2677dd09-3587-4746-be1d-86294f497ba7 req-e6fd78e7-e3ab-4b72-b403-382e09df6efb service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:23.148749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-2677dd09-3587-4746-be1d-86294f497ba7 req-e6fd78e7-e3ab-4b72-b403-382e09df6efb service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:23.160119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-2677dd09-3587-4746-be1d-86294f497ba7 req-e6fd78e7-e3ab-4b72-b403-382e09df6efb service nova] Creating event network-vif-deleted:363ae4d1-ef88-47d5-a3fb-e1b35283078c for instance f4e6d4bc-0f50-48c9-ac74-5a6323cbb9d7 on hv-cinder-84753 Aug 01 15:51:23.165182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-2677dd09-3587-4746-be1d-86294f497ba7 req-e6fd78e7-e3ab-4b72-b403-382e09df6efb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036544 Aug 01 15:51:23.166369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 877/2086] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:51:24.079566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ae6eff0a-f531-406d-8e95-97d71de6c316 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:24.080246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ae6eff0a-f531-406d-8e95-97d71de6c316 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:24.087417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae6eff0a-f531-406d-8e95-97d71de6c316 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:24.088097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae6eff0a-f531-406d-8e95-97d71de6c316 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:24.088996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae6eff0a-f531-406d-8e95-97d71de6c316 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:24.089516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae6eff0a-f531-406d-8e95-97d71de6c316 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:24.161807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ff776249-7cf2-4eb6-a027-94e169083f00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:24.163095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ff776249-7cf2-4eb6-a027-94e169083f00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:24.169423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ff776249-7cf2-4eb6-a027-94e169083f00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:24.169875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ff776249-7cf2-4eb6-a027-94e169083f00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:24.171023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ff776249-7cf2-4eb6-a027-94e169083f00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:24.171467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ff776249-7cf2-4eb6-a027-94e169083f00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:24.255066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ff776249-7cf2-4eb6-a027-94e169083f00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:24.260258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ae6eff0a-f531-406d-8e95-97d71de6c316 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:24.263454 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ff776249-7cf2-4eb6-a027-94e169083f00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.105879 Aug 01 15:51:24.269097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 878/2087] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:24 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:24.270160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ae6eff0a-f531-406d-8e95-97d71de6c316 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.195279 Aug 01 15:51:24.270725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1210/2088] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:24 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:25.286147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-80d6f934-73bb-4810-96f3-b01810d71f66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:25.287412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-80d6f934-73bb-4810-96f3-b01810d71f66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:25.291270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b76e4dc6-9a6f-48d9-8ce7-37fd54275e9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:25.296898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b76e4dc6-9a6f-48d9-8ce7-37fd54275e9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:25.297081 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80d6f934-73bb-4810-96f3-b01810d71f66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:25.297081 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80d6f934-73bb-4810-96f3-b01810d71f66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:25.297509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:25.297677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80d6f934-73bb-4810-96f3-b01810d71f66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:25.297677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80d6f934-73bb-4810-96f3-b01810d71f66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:25.301705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b76e4dc6-9a6f-48d9-8ce7-37fd54275e9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:25.302478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b76e4dc6-9a6f-48d9-8ce7-37fd54275e9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:25.302967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b76e4dc6-9a6f-48d9-8ce7-37fd54275e9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:25.303403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b76e4dc6-9a6f-48d9-8ce7-37fd54275e9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:25.387241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-80d6f934-73bb-4810-96f3-b01810d71f66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:25.396947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-80d6f934-73bb-4810-96f3-b01810d71f66 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.114724 Aug 01 15:51:25.397802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 879/2089] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:25 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:25.458748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b76e4dc6-9a6f-48d9-8ce7-37fd54275e9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:25.475970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b76e4dc6-9a6f-48d9-8ce7-37fd54275e9b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.188324 Aug 01 15:51:25.476571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1211/2090] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:25 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:26.419071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0d3a385b-83c0-421e-ad5c-5fc84267cee5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:26.419719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0d3a385b-83c0-421e-ad5c-5fc84267cee5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:26.428085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d3a385b-83c0-421e-ad5c-5fc84267cee5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:26.428533 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d3a385b-83c0-421e-ad5c-5fc84267cee5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:26.429777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d3a385b-83c0-421e-ad5c-5fc84267cee5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:26.430194 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d3a385b-83c0-421e-ad5c-5fc84267cee5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:26.496535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0d3a385b-83c0-421e-ad5c-5fc84267cee5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:26.500351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-36bc4f6b-f6dd-4e77-845c-c02bb795780d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:26.501181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-36bc4f6b-f6dd-4e77-845c-c02bb795780d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:26.508196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0d3a385b-83c0-421e-ad5c-5fc84267cee5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.091938 Aug 01 15:51:26.509254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 880/2091] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:26 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:26.521610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-36bc4f6b-f6dd-4e77-845c-c02bb795780d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:26.521610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-36bc4f6b-f6dd-4e77-845c-c02bb795780d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:26.523609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-36bc4f6b-f6dd-4e77-845c-c02bb795780d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:26.524268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-36bc4f6b-f6dd-4e77-845c-c02bb795780d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:26.790472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-36bc4f6b-f6dd-4e77-845c-c02bb795780d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:26.799260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-36bc4f6b-f6dd-4e77-845c-c02bb795780d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.304295 Aug 01 15:51:26.799840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1212/2092] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:26 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:27.530771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e1b454f6-6dc2-4254-82c9-12264af60275 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:27.531493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e1b454f6-6dc2-4254-82c9-12264af60275 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:27.538044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e1b454f6-6dc2-4254-82c9-12264af60275 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:27.538487 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e1b454f6-6dc2-4254-82c9-12264af60275 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:27.539447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e1b454f6-6dc2-4254-82c9-12264af60275 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:27.539877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e1b454f6-6dc2-4254-82c9-12264af60275 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:27.610472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e1b454f6-6dc2-4254-82c9-12264af60275 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:27.618837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e1b454f6-6dc2-4254-82c9-12264af60275 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.092113 Aug 01 15:51:27.619500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 881/2093] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:27 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:27.821079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a9969ec2-1bdf-4ee2-8f91-496cc539c938 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:27.821697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a9969ec2-1bdf-4ee2-8f91-496cc539c938 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:27.829603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a9969ec2-1bdf-4ee2-8f91-496cc539c938 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:27.830103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a9969ec2-1bdf-4ee2-8f91-496cc539c938 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:27.830941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a9969ec2-1bdf-4ee2-8f91-496cc539c938 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:27.831500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a9969ec2-1bdf-4ee2-8f91-496cc539c938 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:27.981014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a9969ec2-1bdf-4ee2-8f91-496cc539c938 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:27.990817 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a9969ec2-1bdf-4ee2-8f91-496cc539c938 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.173879 Aug 01 15:51:27.991425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1213/2094] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:27 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:28.641473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9ed3c724-923c-482d-a447-e71e8db1af96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:28.642219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9ed3c724-923c-482d-a447-e71e8db1af96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:28.649210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ed3c724-923c-482d-a447-e71e8db1af96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:28.649739 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ed3c724-923c-482d-a447-e71e8db1af96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:28.650764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ed3c724-923c-482d-a447-e71e8db1af96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:28.651122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ed3c724-923c-482d-a447-e71e8db1af96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:28.718559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9ed3c724-923c-482d-a447-e71e8db1af96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:28.727677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9ed3c724-923c-482d-a447-e71e8db1af96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.090496 Aug 01 15:51:28.728257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 882/2095] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:28 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:29.012755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-badf7c02-ec87-4be6-8cb0-5cb31a0d145c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:29.013671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-badf7c02-ec87-4be6-8cb0-5cb31a0d145c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:29.021564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-badf7c02-ec87-4be6-8cb0-5cb31a0d145c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:29.022199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-badf7c02-ec87-4be6-8cb0-5cb31a0d145c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:29.023122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-badf7c02-ec87-4be6-8cb0-5cb31a0d145c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:29.023711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-badf7c02-ec87-4be6-8cb0-5cb31a0d145c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:29.211493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-badf7c02-ec87-4be6-8cb0-5cb31a0d145c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:29.220285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-badf7c02-ec87-4be6-8cb0-5cb31a0d145c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.211585 Aug 01 15:51:29.235120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1214/2096] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:29 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:29.749259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b2695eb0-5b55-4a46-a395-7a91bdc0b6ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:29.750524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b2695eb0-5b55-4a46-a395-7a91bdc0b6ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:29.757468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b2695eb0-5b55-4a46-a395-7a91bdc0b6ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:29.757997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b2695eb0-5b55-4a46-a395-7a91bdc0b6ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:29.758788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b2695eb0-5b55-4a46-a395-7a91bdc0b6ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:29.759384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b2695eb0-5b55-4a46-a395-7a91bdc0b6ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:29.832394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b2695eb0-5b55-4a46-a395-7a91bdc0b6ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:29.841019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b2695eb0-5b55-4a46-a395-7a91bdc0b6ff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.095791 Aug 01 15:51:29.842202 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 883/2097] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:29 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:30.245295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-181d7736-ba03-4823-97fc-0a08a68a5cc9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:30.246044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-181d7736-ba03-4823-97fc-0a08a68a5cc9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:30.253664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-181d7736-ba03-4823-97fc-0a08a68a5cc9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:30.254159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-181d7736-ba03-4823-97fc-0a08a68a5cc9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:30.254948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-181d7736-ba03-4823-97fc-0a08a68a5cc9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:30.255392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-181d7736-ba03-4823-97fc-0a08a68a5cc9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:30.455733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-181d7736-ba03-4823-97fc-0a08a68a5cc9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:30.466316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-181d7736-ba03-4823-97fc-0a08a68a5cc9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.225729 Aug 01 15:51:30.473434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1215/2098] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:30.867191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-063bfb4b-cd67-49dc-98eb-e8077ceb4b50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:30.868086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-063bfb4b-cd67-49dc-98eb-e8077ceb4b50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:30.877072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-063bfb4b-cd67-49dc-98eb-e8077ceb4b50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:30.877727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-063bfb4b-cd67-49dc-98eb-e8077ceb4b50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:30.878540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-063bfb4b-cd67-49dc-98eb-e8077ceb4b50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:30.878973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-063bfb4b-cd67-49dc-98eb-e8077ceb4b50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:30.969529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-063bfb4b-cd67-49dc-98eb-e8077ceb4b50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:30.980274 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-063bfb4b-cd67-49dc-98eb-e8077ceb4b50 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.118364 Aug 01 15:51:30.990045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 884/2099] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:30 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:31.492189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0933cdec-aa33-4444-9f61-a73ff8f0fa05 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:31.492929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0933cdec-aa33-4444-9f61-a73ff8f0fa05 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:31.500743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0933cdec-aa33-4444-9f61-a73ff8f0fa05 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:31.500743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0933cdec-aa33-4444-9f61-a73ff8f0fa05 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:31.501238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0933cdec-aa33-4444-9f61-a73ff8f0fa05 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:31.503032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0933cdec-aa33-4444-9f61-a73ff8f0fa05 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:31.665559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0933cdec-aa33-4444-9f61-a73ff8f0fa05 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:31.673805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0933cdec-aa33-4444-9f61-a73ff8f0fa05 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.185570 Aug 01 15:51:31.674423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1216/2100] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:31 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:32.003266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e896c4dd-0ac0-4658-b85b-8e27a65c4722 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:32.003994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e896c4dd-0ac0-4658-b85b-8e27a65c4722 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:32.010995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e896c4dd-0ac0-4658-b85b-8e27a65c4722 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:32.011439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e896c4dd-0ac0-4658-b85b-8e27a65c4722 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:32.012203 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e896c4dd-0ac0-4658-b85b-8e27a65c4722 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:32.012635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e896c4dd-0ac0-4658-b85b-8e27a65c4722 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:32.088482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e896c4dd-0ac0-4658-b85b-8e27a65c4722 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:32.097024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e896c4dd-0ac0-4658-b85b-8e27a65c4722 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.097991 Aug 01 15:51:32.097629 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 885/2101] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:31 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:32.698599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e5bdbabe-2fb2-4ef3-a4d2-86af48b8941e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:32.699232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e5bdbabe-2fb2-4ef3-a4d2-86af48b8941e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:32.706008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e5bdbabe-2fb2-4ef3-a4d2-86af48b8941e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:32.706455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e5bdbabe-2fb2-4ef3-a4d2-86af48b8941e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:32.707215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e5bdbabe-2fb2-4ef3-a4d2-86af48b8941e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:32.707645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e5bdbabe-2fb2-4ef3-a4d2-86af48b8941e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:32.727342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:32.843830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e5bdbabe-2fb2-4ef3-a4d2-86af48b8941e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:32.852261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e5bdbabe-2fb2-4ef3-a4d2-86af48b8941e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.157493 Aug 01 15:51:32.852835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1217/2102] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:32 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:33.119460 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a3f542a1-765b-479d-aa18-4ddc9ce5f6e0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:33.120099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a3f542a1-765b-479d-aa18-4ddc9ce5f6e0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:33.126973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a3f542a1-765b-479d-aa18-4ddc9ce5f6e0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:33.127949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a3f542a1-765b-479d-aa18-4ddc9ce5f6e0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:33.128391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a3f542a1-765b-479d-aa18-4ddc9ce5f6e0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:33.128825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a3f542a1-765b-479d-aa18-4ddc9ce5f6e0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:33.191912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a3f542a1-765b-479d-aa18-4ddc9ce5f6e0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:33.199489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a3f542a1-765b-479d-aa18-4ddc9ce5f6e0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.083969 Aug 01 15:51:33.200044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 886/2103] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:33 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:33.874716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-115aa63a-1200-4efa-b072-1814a6fa84d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:33.875333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-115aa63a-1200-4efa-b072-1814a6fa84d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:33.881880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-115aa63a-1200-4efa-b072-1814a6fa84d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:33.882351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-115aa63a-1200-4efa-b072-1814a6fa84d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:33.883120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-115aa63a-1200-4efa-b072-1814a6fa84d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:33.883553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-115aa63a-1200-4efa-b072-1814a6fa84d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:34.026802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-115aa63a-1200-4efa-b072-1814a6fa84d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:34.035508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-115aa63a-1200-4efa-b072-1814a6fa84d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.165353 Aug 01 15:51:34.035962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1218/2104] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:33 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:34.222261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b97cb586-07d0-4b46-a07e-64f659f63507 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:34.222790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b97cb586-07d0-4b46-a07e-64f659f63507 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:34.229431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b97cb586-07d0-4b46-a07e-64f659f63507 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:34.229878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b97cb586-07d0-4b46-a07e-64f659f63507 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:34.230713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b97cb586-07d0-4b46-a07e-64f659f63507 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:34.231158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b97cb586-07d0-4b46-a07e-64f659f63507 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:34.297794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b97cb586-07d0-4b46-a07e-64f659f63507 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:34.301400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:34.308343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b97cb586-07d0-4b46-a07e-64f659f63507 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.090683 Aug 01 15:51:34.309014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 887/2105] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:34 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:35.058524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e8706224-e117-4ad1-a361-6727bd9eaaf4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:35.059138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e8706224-e117-4ad1-a361-6727bd9eaaf4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:35.066628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8706224-e117-4ad1-a361-6727bd9eaaf4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:35.067066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8706224-e117-4ad1-a361-6727bd9eaaf4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:35.067832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8706224-e117-4ad1-a361-6727bd9eaaf4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:35.068262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8706224-e117-4ad1-a361-6727bd9eaaf4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:35.205430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e8706224-e117-4ad1-a361-6727bd9eaaf4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:35.213503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e8706224-e117-4ad1-a361-6727bd9eaaf4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.159643 Aug 01 15:51:35.214133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1219/2106] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:35 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:35.330223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a05408de-63e7-428d-8d52-6510470b51c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:35.331260 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a05408de-63e7-428d-8d52-6510470b51c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:35.340958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a05408de-63e7-428d-8d52-6510470b51c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:35.341407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a05408de-63e7-428d-8d52-6510470b51c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:35.342286 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a05408de-63e7-428d-8d52-6510470b51c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:35.342734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a05408de-63e7-428d-8d52-6510470b51c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:35.411016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a05408de-63e7-428d-8d52-6510470b51c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:35.419319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a05408de-63e7-428d-8d52-6510470b51c3 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.093566 Aug 01 15:51:35.419908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 888/2107] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:35 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:36.234800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e197413e-dd01-4e48-8a1f-cd4fda7299c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:36.235503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e197413e-dd01-4e48-8a1f-cd4fda7299c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:36.242180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e197413e-dd01-4e48-8a1f-cd4fda7299c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:36.242635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e197413e-dd01-4e48-8a1f-cd4fda7299c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:36.243512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e197413e-dd01-4e48-8a1f-cd4fda7299c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:36.243952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e197413e-dd01-4e48-8a1f-cd4fda7299c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:36.395703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e197413e-dd01-4e48-8a1f-cd4fda7299c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:36.403845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e197413e-dd01-4e48-8a1f-cd4fda7299c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.172991 Aug 01 15:51:36.404434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1220/2108] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:36 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:36.441341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9ccfa3c1-3228-46ca-9557-f175f144d7e1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:36.442136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9ccfa3c1-3228-46ca-9557-f175f144d7e1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:36.448650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ccfa3c1-3228-46ca-9557-f175f144d7e1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:36.449106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ccfa3c1-3228-46ca-9557-f175f144d7e1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:36.449878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ccfa3c1-3228-46ca-9557-f175f144d7e1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:36.450342 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ccfa3c1-3228-46ca-9557-f175f144d7e1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:36.512425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9ccfa3c1-3228-46ca-9557-f175f144d7e1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:36.520730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9ccfa3c1-3228-46ca-9557-f175f144d7e1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.083288 Aug 01 15:51:36.521293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 889/2109] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:36 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:37.424965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-15e08259-c799-46e8-bb66-254fd4257974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:37.425559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-15e08259-c799-46e8-bb66-254fd4257974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:37.432191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15e08259-c799-46e8-bb66-254fd4257974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:37.432633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15e08259-c799-46e8-bb66-254fd4257974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:37.433410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15e08259-c799-46e8-bb66-254fd4257974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:37.433839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15e08259-c799-46e8-bb66-254fd4257974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:37.541794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b22cad8d-e207-4ee3-9b67-3dc7c9d69003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:37.542752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b22cad8d-e207-4ee3-9b67-3dc7c9d69003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:37.549468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b22cad8d-e207-4ee3-9b67-3dc7c9d69003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:37.549964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b22cad8d-e207-4ee3-9b67-3dc7c9d69003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:37.551137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b22cad8d-e207-4ee3-9b67-3dc7c9d69003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:37.551676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b22cad8d-e207-4ee3-9b67-3dc7c9d69003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:37.575874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-15e08259-c799-46e8-bb66-254fd4257974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:37.584584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-15e08259-c799-46e8-bb66-254fd4257974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.163395 Aug 01 15:51:37.585160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1221/2110] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:37 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:37.619117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b22cad8d-e207-4ee3-9b67-3dc7c9d69003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:37.628139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b22cad8d-e207-4ee3-9b67-3dc7c9d69003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.090231 Aug 01 15:51:37.628713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 890/2111] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:37 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:38.608466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-623765bf-75b1-46fe-8fc6-f0cbc613591e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:38.609172 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-623765bf-75b1-46fe-8fc6-f0cbc613591e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:38.616000 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-623765bf-75b1-46fe-8fc6-f0cbc613591e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:38.616543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-623765bf-75b1-46fe-8fc6-f0cbc613591e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:38.617326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-623765bf-75b1-46fe-8fc6-f0cbc613591e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:38.617756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-623765bf-75b1-46fe-8fc6-f0cbc613591e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:38.650016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d2f404d4-24b2-436d-845c-73752eb2acf9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:38.650738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d2f404d4-24b2-436d-845c-73752eb2acf9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:38.659237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d2f404d4-24b2-436d-845c-73752eb2acf9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:38.660047 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d2f404d4-24b2-436d-845c-73752eb2acf9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:38.661411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d2f404d4-24b2-436d-845c-73752eb2acf9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:38.662213 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d2f404d4-24b2-436d-845c-73752eb2acf9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:38.749962 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d2f404d4-24b2-436d-845c-73752eb2acf9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:38.757918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d2f404d4-24b2-436d-845c-73752eb2acf9 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.111832 Aug 01 15:51:38.758516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 891/2112] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:38 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:38.785468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-623765bf-75b1-46fe-8fc6-f0cbc613591e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:38.793830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-623765bf-75b1-46fe-8fc6-f0cbc613591e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.189986 Aug 01 15:51:38.794443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1222/2113] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:38 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:39.781582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-570901b1-9b8b-442d-92ad-cf0116d38aba tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:39.782175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-570901b1-9b8b-442d-92ad-cf0116d38aba tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:39.788713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-570901b1-9b8b-442d-92ad-cf0116d38aba tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:39.789158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-570901b1-9b8b-442d-92ad-cf0116d38aba tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:39.789955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-570901b1-9b8b-442d-92ad-cf0116d38aba tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:39.790392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-570901b1-9b8b-442d-92ad-cf0116d38aba tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:39.816462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-05119eac-b8cf-4376-a5e9-9e268fc14079 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:39.817087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-05119eac-b8cf-4376-a5e9-9e268fc14079 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:39.824166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05119eac-b8cf-4376-a5e9-9e268fc14079 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:39.824624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05119eac-b8cf-4376-a5e9-9e268fc14079 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:39.825500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05119eac-b8cf-4376-a5e9-9e268fc14079 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:39.825969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05119eac-b8cf-4376-a5e9-9e268fc14079 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:39.866570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-570901b1-9b8b-442d-92ad-cf0116d38aba tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:39.875102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-570901b1-9b8b-442d-92ad-cf0116d38aba tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.097411 Aug 01 15:51:39.875886 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 892/2114] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:39 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:39.984863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-05119eac-b8cf-4376-a5e9-9e268fc14079 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:39.993770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-05119eac-b8cf-4376-a5e9-9e268fc14079 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.181019 Aug 01 15:51:39.994492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1223/2115] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:39 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:40.897318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3a59bba6-4413-440d-9aa4-10c190cf694b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:40.897952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3a59bba6-4413-440d-9aa4-10c190cf694b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:40.900413 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:40.906539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a59bba6-4413-440d-9aa4-10c190cf694b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:40.907001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a59bba6-4413-440d-9aa4-10c190cf694b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:40.907771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a59bba6-4413-440d-9aa4-10c190cf694b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:40.908199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a59bba6-4413-440d-9aa4-10c190cf694b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:40.976248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3a59bba6-4413-440d-9aa4-10c190cf694b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:40.984908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3a59bba6-4413-440d-9aa4-10c190cf694b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.091820 Aug 01 15:51:40.985488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 893/2116] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:40 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:41.016846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-afd2799a-fdd3-4de4-b400-6905ffbe099c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:41.017453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-afd2799a-fdd3-4de4-b400-6905ffbe099c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:41.023615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-afd2799a-fdd3-4de4-b400-6905ffbe099c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:41.024080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-afd2799a-fdd3-4de4-b400-6905ffbe099c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:41.024892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-afd2799a-fdd3-4de4-b400-6905ffbe099c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:41.025690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-afd2799a-fdd3-4de4-b400-6905ffbe099c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:41.155246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-afd2799a-fdd3-4de4-b400-6905ffbe099c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:41.163196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-afd2799a-fdd3-4de4-b400-6905ffbe099c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.151458 Aug 01 15:51:41.163760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1224/2117] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:42.006715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-79587f56-bed3-48d3-8f8d-ae8fc2e47b7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:42.007345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-79587f56-bed3-48d3-8f8d-ae8fc2e47b7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:42.014566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79587f56-bed3-48d3-8f8d-ae8fc2e47b7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:42.015024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79587f56-bed3-48d3-8f8d-ae8fc2e47b7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:42.015879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79587f56-bed3-48d3-8f8d-ae8fc2e47b7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:42.016243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79587f56-bed3-48d3-8f8d-ae8fc2e47b7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:42.082271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-79587f56-bed3-48d3-8f8d-ae8fc2e47b7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:42.090247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-79587f56-bed3-48d3-8f8d-ae8fc2e47b7a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.087351 Aug 01 15:51:42.090913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 894/2118] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:42 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:42.185229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f98ba8e8-a8c5-46de-8795-3f12ecba1207 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:42.186426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f98ba8e8-a8c5-46de-8795-3f12ecba1207 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:42.193255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f98ba8e8-a8c5-46de-8795-3f12ecba1207 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:42.193703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f98ba8e8-a8c5-46de-8795-3f12ecba1207 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:42.194561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f98ba8e8-a8c5-46de-8795-3f12ecba1207 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:42.195052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f98ba8e8-a8c5-46de-8795-3f12ecba1207 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:42.335458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f98ba8e8-a8c5-46de-8795-3f12ecba1207 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:42.343842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f98ba8e8-a8c5-46de-8795-3f12ecba1207 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.162748 Aug 01 15:51:42.344588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1225/2119] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:42 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:43.113631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-820b9789-5ee6-466e-b33c-ec725ad8099c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:43.114288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-820b9789-5ee6-466e-b33c-ec725ad8099c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:43.120754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-820b9789-5ee6-466e-b33c-ec725ad8099c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:43.121195 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-820b9789-5ee6-466e-b33c-ec725ad8099c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:43.121982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-820b9789-5ee6-466e-b33c-ec725ad8099c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:43.122416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-820b9789-5ee6-466e-b33c-ec725ad8099c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:43.183393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-820b9789-5ee6-466e-b33c-ec725ad8099c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:43.190845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-820b9789-5ee6-466e-b33c-ec725ad8099c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.081165 Aug 01 15:51:43.191399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 895/2120] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:43 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:43.366511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3fd2ee6c-7068-429e-833c-bc458c78e537 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:43.367122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3fd2ee6c-7068-429e-833c-bc458c78e537 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:43.373668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3fd2ee6c-7068-429e-833c-bc458c78e537 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:43.374137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3fd2ee6c-7068-429e-833c-bc458c78e537 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:43.374889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3fd2ee6c-7068-429e-833c-bc458c78e537 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:43.375317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3fd2ee6c-7068-429e-833c-bc458c78e537 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:43.506725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3fd2ee6c-7068-429e-833c-bc458c78e537 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:43.515709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3fd2ee6c-7068-429e-833c-bc458c78e537 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.152881 Aug 01 15:51:43.516281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1226/2121] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:43 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:44.211860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ab56200c-f4c8-47a4-a8ba-271e0b0677c6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:44.212472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ab56200c-f4c8-47a4-a8ba-271e0b0677c6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:44.219036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ab56200c-f4c8-47a4-a8ba-271e0b0677c6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:44.219484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ab56200c-f4c8-47a4-a8ba-271e0b0677c6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:44.220242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ab56200c-f4c8-47a4-a8ba-271e0b0677c6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:44.220676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ab56200c-f4c8-47a4-a8ba-271e0b0677c6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:44.291250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ab56200c-f4c8-47a4-a8ba-271e0b0677c6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:44.299503 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ab56200c-f4c8-47a4-a8ba-271e0b0677c6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.091482 Aug 01 15:51:44.300067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 896/2122] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:44 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:44.537143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4637b269-3012-430b-a35b-b126c3aeebe1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:44.537757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4637b269-3012-430b-a35b-b126c3aeebe1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:44.544533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4637b269-3012-430b-a35b-b126c3aeebe1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:44.544991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4637b269-3012-430b-a35b-b126c3aeebe1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:44.546461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4637b269-3012-430b-a35b-b126c3aeebe1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:44.546904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4637b269-3012-430b-a35b-b126c3aeebe1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:44.673757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4637b269-3012-430b-a35b-b126c3aeebe1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:44.681824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4637b269-3012-430b-a35b-b126c3aeebe1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.148551 Aug 01 15:51:44.682431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1227/2123] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:44 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:45.322866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a7f5cb11-79e1-4f85-bc90-5a8fe6132f9c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:45.323389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a7f5cb11-79e1-4f85-bc90-5a8fe6132f9c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:45.330285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7f5cb11-79e1-4f85-bc90-5a8fe6132f9c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:45.330735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7f5cb11-79e1-4f85-bc90-5a8fe6132f9c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:45.331499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7f5cb11-79e1-4f85-bc90-5a8fe6132f9c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:45.331935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7f5cb11-79e1-4f85-bc90-5a8fe6132f9c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:45.392806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a7f5cb11-79e1-4f85-bc90-5a8fe6132f9c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:45.400343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a7f5cb11-79e1-4f85-bc90-5a8fe6132f9c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.081442 Aug 01 15:51:45.400900 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 897/2124] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:45 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:45.703448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-38f1688d-3fdc-4b2a-a96b-abaff9ed952b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:45.704063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-38f1688d-3fdc-4b2a-a96b-abaff9ed952b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:45.710706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38f1688d-3fdc-4b2a-a96b-abaff9ed952b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:45.711162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38f1688d-3fdc-4b2a-a96b-abaff9ed952b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:45.711927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38f1688d-3fdc-4b2a-a96b-abaff9ed952b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:45.712364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38f1688d-3fdc-4b2a-a96b-abaff9ed952b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:45.863713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-38f1688d-3fdc-4b2a-a96b-abaff9ed952b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:45.872104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-38f1688d-3fdc-4b2a-a96b-abaff9ed952b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.172664 Aug 01 15:51:45.872691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1228/2125] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:45 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:46.421098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1d6237aa-2637-489a-a5d6-bc8e64e7b785 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:46.421706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1d6237aa-2637-489a-a5d6-bc8e64e7b785 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:46.428493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d6237aa-2637-489a-a5d6-bc8e64e7b785 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:46.428948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d6237aa-2637-489a-a5d6-bc8e64e7b785 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:46.429819 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d6237aa-2637-489a-a5d6-bc8e64e7b785 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:46.430216 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d6237aa-2637-489a-a5d6-bc8e64e7b785 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:46.492392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1d6237aa-2637-489a-a5d6-bc8e64e7b785 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:46.500499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1d6237aa-2637-489a-a5d6-bc8e64e7b785 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.083323 Aug 01 15:51:46.501057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 898/2126] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:46 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:46.894730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e77f204a-5b7f-48e9-b299-9c2e0aa28c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:46.895331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e77f204a-5b7f-48e9-b299-9c2e0aa28c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:46.902032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e77f204a-5b7f-48e9-b299-9c2e0aa28c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:46.902480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e77f204a-5b7f-48e9-b299-9c2e0aa28c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:46.903253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e77f204a-5b7f-48e9-b299-9c2e0aa28c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:46.903685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e77f204a-5b7f-48e9-b299-9c2e0aa28c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:47.036406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e77f204a-5b7f-48e9-b299-9c2e0aa28c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:47.044701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e77f204a-5b7f-48e9-b299-9c2e0aa28c72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.153832 Aug 01 15:51:47.045265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1229/2127] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:46 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:47.521626 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0335cbba-be9c-4f6b-b7a3-9002faf99a82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:47.522293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0335cbba-be9c-4f6b-b7a3-9002faf99a82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:47.528890 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0335cbba-be9c-4f6b-b7a3-9002faf99a82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:47.529343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0335cbba-be9c-4f6b-b7a3-9002faf99a82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:47.530221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0335cbba-be9c-4f6b-b7a3-9002faf99a82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:47.530661 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0335cbba-be9c-4f6b-b7a3-9002faf99a82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:47.596391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0335cbba-be9c-4f6b-b7a3-9002faf99a82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:47.603948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0335cbba-be9c-4f6b-b7a3-9002faf99a82 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.086277 Aug 01 15:51:47.604509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 899/2128] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:47 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:48.066302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1cbd4947-36ac-4dfb-aa52-321c847d62e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:48.066933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1cbd4947-36ac-4dfb-aa52-321c847d62e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:48.073528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cbd4947-36ac-4dfb-aa52-321c847d62e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:48.074017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cbd4947-36ac-4dfb-aa52-321c847d62e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:48.074791 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cbd4947-36ac-4dfb-aa52-321c847d62e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:48.075355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cbd4947-36ac-4dfb-aa52-321c847d62e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:48.205159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1cbd4947-36ac-4dfb-aa52-321c847d62e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:48.214476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1cbd4947-36ac-4dfb-aa52-321c847d62e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.151956 Aug 01 15:51:48.215050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1230/2129] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:48 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:48.624574 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fec72b48-7194-40c7-a5c9-c80f9aa29b61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:48.625773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fec72b48-7194-40c7-a5c9-c80f9aa29b61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:48.632336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fec72b48-7194-40c7-a5c9-c80f9aa29b61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:48.632788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fec72b48-7194-40c7-a5c9-c80f9aa29b61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:48.633556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fec72b48-7194-40c7-a5c9-c80f9aa29b61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:48.634128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fec72b48-7194-40c7-a5c9-c80f9aa29b61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:48.696308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fec72b48-7194-40c7-a5c9-c80f9aa29b61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:48.705814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fec72b48-7194-40c7-a5c9-c80f9aa29b61 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.085074 Aug 01 15:51:48.706409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 900/2130] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:48 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:49.236660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-67dad358-9ef2-4351-9fe3-b7076edf14b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:49.237280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-67dad358-9ef2-4351-9fe3-b7076edf14b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:49.243554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67dad358-9ef2-4351-9fe3-b7076edf14b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:49.244006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67dad358-9ef2-4351-9fe3-b7076edf14b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:49.244774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67dad358-9ef2-4351-9fe3-b7076edf14b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:49.245211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67dad358-9ef2-4351-9fe3-b7076edf14b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:49.382372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-67dad358-9ef2-4351-9fe3-b7076edf14b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:49.390564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-67dad358-9ef2-4351-9fe3-b7076edf14b3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.157880 Aug 01 15:51:49.391132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1231/2131] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:49.727761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-43e73f7a-e5c3-4ac4-84cc-9acc15848a09 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:49.728379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-43e73f7a-e5c3-4ac4-84cc-9acc15848a09 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:49.735628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43e73f7a-e5c3-4ac4-84cc-9acc15848a09 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:49.736079 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43e73f7a-e5c3-4ac4-84cc-9acc15848a09 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:49.736847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43e73f7a-e5c3-4ac4-84cc-9acc15848a09 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:49.737417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43e73f7a-e5c3-4ac4-84cc-9acc15848a09 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:49.798635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-43e73f7a-e5c3-4ac4-84cc-9acc15848a09 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:49.806246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-43e73f7a-e5c3-4ac4-84cc-9acc15848a09 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.082394 Aug 01 15:51:49.806812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 901/2132] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:49 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:50.412031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f7970776-1012-4ec3-bcf8-cde28c098c83 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:50.412638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f7970776-1012-4ec3-bcf8-cde28c098c83 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:50.419147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7970776-1012-4ec3-bcf8-cde28c098c83 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:50.419585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7970776-1012-4ec3-bcf8-cde28c098c83 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:50.420332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7970776-1012-4ec3-bcf8-cde28c098c83 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:50.420759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7970776-1012-4ec3-bcf8-cde28c098c83 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:50.549649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f7970776-1012-4ec3-bcf8-cde28c098c83 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:50.557601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f7970776-1012-4ec3-bcf8-cde28c098c83 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.149466 Aug 01 15:51:50.558198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1232/2133] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:50 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:50.827712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6425b7f6-bbb5-47ac-b778-616fcefcf140 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:50.828774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6425b7f6-bbb5-47ac-b778-616fcefcf140 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:50.835398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6425b7f6-bbb5-47ac-b778-616fcefcf140 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:50.835837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6425b7f6-bbb5-47ac-b778-616fcefcf140 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:50.836591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6425b7f6-bbb5-47ac-b778-616fcefcf140 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:50.837017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6425b7f6-bbb5-47ac-b778-616fcefcf140 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:50.903510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6425b7f6-bbb5-47ac-b778-616fcefcf140 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:50.911833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6425b7f6-bbb5-47ac-b778-616fcefcf140 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.088241 Aug 01 15:51:50.912430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 902/2134] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:50 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:51.579388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4b31ca77-bc7a-494c-94b2-bba0ce1635f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:51.580008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4b31ca77-bc7a-494c-94b2-bba0ce1635f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:51.586726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b31ca77-bc7a-494c-94b2-bba0ce1635f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:51.587181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b31ca77-bc7a-494c-94b2-bba0ce1635f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:51.587948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b31ca77-bc7a-494c-94b2-bba0ce1635f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:51.588387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b31ca77-bc7a-494c-94b2-bba0ce1635f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:51.718190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4b31ca77-bc7a-494c-94b2-bba0ce1635f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:51.726387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4b31ca77-bc7a-494c-94b2-bba0ce1635f4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.150847 Aug 01 15:51:51.726956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1233/2135] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:51 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:51.931809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fc18c2f0-e1d8-45a8-a146-f5e7a89e7ce0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:51.932420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fc18c2f0-e1d8-45a8-a146-f5e7a89e7ce0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:51.943647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc18c2f0-e1d8-45a8-a146-f5e7a89e7ce0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:51.944100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc18c2f0-e1d8-45a8-a146-f5e7a89e7ce0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:51.944877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc18c2f0-e1d8-45a8-a146-f5e7a89e7ce0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:51.949550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc18c2f0-e1d8-45a8-a146-f5e7a89e7ce0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:52.019084 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fc18c2f0-e1d8-45a8-a146-f5e7a89e7ce0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:52.026645 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fc18c2f0-e1d8-45a8-a146-f5e7a89e7ce0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.098777 Aug 01 15:51:52.027221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 903/2136] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:51 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:52.747728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f68bfda8-8c0a-4299-9ed2-1fb57b7916d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:52.748352 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f68bfda8-8c0a-4299-9ed2-1fb57b7916d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:52.754958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f68bfda8-8c0a-4299-9ed2-1fb57b7916d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:52.755400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f68bfda8-8c0a-4299-9ed2-1fb57b7916d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:52.756152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f68bfda8-8c0a-4299-9ed2-1fb57b7916d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:52.756581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f68bfda8-8c0a-4299-9ed2-1fb57b7916d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:52.760454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:52.888103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f68bfda8-8c0a-4299-9ed2-1fb57b7916d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:52.896554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f68bfda8-8c0a-4299-9ed2-1fb57b7916d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.152686 Aug 01 15:51:52.897137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1234/2137] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:52 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:53.048337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6d98b697-bdf8-4d32-a65c-e10bcceb1003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:53.049078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6d98b697-bdf8-4d32-a65c-e10bcceb1003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:53.055805 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d98b697-bdf8-4d32-a65c-e10bcceb1003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:53.056261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d98b697-bdf8-4d32-a65c-e10bcceb1003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:53.057039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d98b697-bdf8-4d32-a65c-e10bcceb1003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:53.057479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d98b697-bdf8-4d32-a65c-e10bcceb1003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:53.075909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:53.120502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6d98b697-bdf8-4d32-a65c-e10bcceb1003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:53.128098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6d98b697-bdf8-4d32-a65c-e10bcceb1003 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.083901 Aug 01 15:51:53.128660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 904/2138] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:53 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:53.918971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-35239b7a-2ba5-44ea-9550-51ae376a28de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:53.919589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-35239b7a-2ba5-44ea-9550-51ae376a28de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:53.926676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35239b7a-2ba5-44ea-9550-51ae376a28de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:53.927129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35239b7a-2ba5-44ea-9550-51ae376a28de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:53.927891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35239b7a-2ba5-44ea-9550-51ae376a28de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:53.928332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-35239b7a-2ba5-44ea-9550-51ae376a28de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:54.057233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-35239b7a-2ba5-44ea-9550-51ae376a28de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:54.066262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-35239b7a-2ba5-44ea-9550-51ae376a28de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.151163 Aug 01 15:51:54.066851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1235/2139] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:53 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:54.149762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1e2228fc-f818-4d02-bf74-678bbc637519 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:54.150483 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1e2228fc-f818-4d02-bf74-678bbc637519 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:54.157534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e2228fc-f818-4d02-bf74-678bbc637519 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:54.158020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e2228fc-f818-4d02-bf74-678bbc637519 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:54.158793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e2228fc-f818-4d02-bf74-678bbc637519 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:54.159233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e2228fc-f818-4d02-bf74-678bbc637519 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:54.222841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1e2228fc-f818-4d02-bf74-678bbc637519 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:54.230396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1e2228fc-f818-4d02-bf74-678bbc637519 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.084533 Aug 01 15:51:54.230956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 905/2140] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:54 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:55.087921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-faffc3ba-18c6-45c8-9c7f-6cd4e260bb64 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:55.088546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-faffc3ba-18c6-45c8-9c7f-6cd4e260bb64 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:55.095343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-faffc3ba-18c6-45c8-9c7f-6cd4e260bb64 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:55.095795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-faffc3ba-18c6-45c8-9c7f-6cd4e260bb64 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:55.096903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-faffc3ba-18c6-45c8-9c7f-6cd4e260bb64 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:55.097350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-faffc3ba-18c6-45c8-9c7f-6cd4e260bb64 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:55.223809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-faffc3ba-18c6-45c8-9c7f-6cd4e260bb64 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:55.231729 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-faffc3ba-18c6-45c8-9c7f-6cd4e260bb64 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.147696 Aug 01 15:51:55.232289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1236/2141] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:55 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:55.252359 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-65f3e1c8-4fb5-4ba4-a49a-90704ccdc5e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:55.252992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-65f3e1c8-4fb5-4ba4-a49a-90704ccdc5e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:55.259436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f3e1c8-4fb5-4ba4-a49a-90704ccdc5e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:55.259876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f3e1c8-4fb5-4ba4-a49a-90704ccdc5e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:55.260626 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f3e1c8-4fb5-4ba4-a49a-90704ccdc5e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:55.261054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f3e1c8-4fb5-4ba4-a49a-90704ccdc5e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:55.332656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-65f3e1c8-4fb5-4ba4-a49a-90704ccdc5e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:55.340365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-65f3e1c8-4fb5-4ba4-a49a-90704ccdc5e2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.092352 Aug 01 15:51:55.340926 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 906/2142] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:55 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:56.253611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dc34ed48-7e17-45da-a4b6-35be00b43501 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:56.254242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dc34ed48-7e17-45da-a4b6-35be00b43501 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:56.256672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=51 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:51:56.263262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc34ed48-7e17-45da-a4b6-35be00b43501 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:56.263718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc34ed48-7e17-45da-a4b6-35be00b43501 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:56.264539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc34ed48-7e17-45da-a4b6-35be00b43501 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:56.264983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc34ed48-7e17-45da-a4b6-35be00b43501 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:56.360580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-56f0f885-5a9b-49e6-b719-c38d813dd2d7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:56.361198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-56f0f885-5a9b-49e6-b719-c38d813dd2d7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:56.368545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56f0f885-5a9b-49e6-b719-c38d813dd2d7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:56.369000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56f0f885-5a9b-49e6-b719-c38d813dd2d7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:56.369772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56f0f885-5a9b-49e6-b719-c38d813dd2d7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:56.370242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56f0f885-5a9b-49e6-b719-c38d813dd2d7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:56.398683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dc34ed48-7e17-45da-a4b6-35be00b43501 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:56.408517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dc34ed48-7e17-45da-a4b6-35be00b43501 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.159217 Aug 01 15:51:56.409101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1237/2143] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:56 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:56.432911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-56f0f885-5a9b-49e6-b719-c38d813dd2d7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:56.441772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-56f0f885-5a9b-49e6-b719-c38d813dd2d7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.085010 Aug 01 15:51:56.442372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 907/2144] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:56 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:57.430989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3280630c-4aa2-4c11-b73d-d83d18cfb6c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:57.431602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3280630c-4aa2-4c11-b73d-d83d18cfb6c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:57.438366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3280630c-4aa2-4c11-b73d-d83d18cfb6c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:57.439002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3280630c-4aa2-4c11-b73d-d83d18cfb6c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:57.439693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3280630c-4aa2-4c11-b73d-d83d18cfb6c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:57.440042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3280630c-4aa2-4c11-b73d-d83d18cfb6c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:57.463391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0de012e1-4fbe-4e21-81f3-271e7ee56ecd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:57.464010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0de012e1-4fbe-4e21-81f3-271e7ee56ecd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:57.471559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0de012e1-4fbe-4e21-81f3-271e7ee56ecd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:57.472006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0de012e1-4fbe-4e21-81f3-271e7ee56ecd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:57.472778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0de012e1-4fbe-4e21-81f3-271e7ee56ecd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:57.473215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0de012e1-4fbe-4e21-81f3-271e7ee56ecd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:57.540519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0de012e1-4fbe-4e21-81f3-271e7ee56ecd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:57.548225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0de012e1-4fbe-4e21-81f3-271e7ee56ecd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.089321 Aug 01 15:51:57.548796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 908/2145] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:57 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:57.601705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3280630c-4aa2-4c11-b73d-d83d18cfb6c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:57.609822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3280630c-4aa2-4c11-b73d-d83d18cfb6c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.182741 Aug 01 15:51:57.610419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1238/2146] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:57 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:58.631716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-339ffbf6-1491-433e-9c9a-963d4fa754c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:58.632390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-339ffbf6-1491-433e-9c9a-963d4fa754c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:58.639181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-339ffbf6-1491-433e-9c9a-963d4fa754c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:58.639635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-339ffbf6-1491-433e-9c9a-963d4fa754c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:58.640888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-339ffbf6-1491-433e-9c9a-963d4fa754c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:58.641324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-339ffbf6-1491-433e-9c9a-963d4fa754c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:58.774908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-339ffbf6-1491-433e-9c9a-963d4fa754c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:58.783462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-339ffbf6-1491-433e-9c9a-963d4fa754c2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.155676 Aug 01 15:51:58.784032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1239/2147] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:58 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:51:58.845931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7a54730c-8377-4024-94ac-1f8dc365930c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:58.846817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7a54730c-8377-4024-94ac-1f8dc365930c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:58.852837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7a54730c-8377-4024-94ac-1f8dc365930c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:58.853284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7a54730c-8377-4024-94ac-1f8dc365930c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:58.854076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7a54730c-8377-4024-94ac-1f8dc365930c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:58.854517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7a54730c-8377-4024-94ac-1f8dc365930c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:58.917982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7a54730c-8377-4024-94ac-1f8dc365930c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:58.925571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7a54730c-8377-4024-94ac-1f8dc365930c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.360757 Aug 01 15:51:58.926163 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 909/2148] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:58 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:51:59.805379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-773b5892-e490-43e6-995f-b30d2a68ffd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:59.806046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-773b5892-e490-43e6-995f-b30d2a68ffd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:59.812614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-773b5892-e490-43e6-995f-b30d2a68ffd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:59.813059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-773b5892-e490-43e6-995f-b30d2a68ffd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:59.813848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-773b5892-e490-43e6-995f-b30d2a68ffd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:59.814306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-773b5892-e490-43e6-995f-b30d2a68ffd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:59.946419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b15a6968-1790-4a62-b3f8-5fa0de4b5ced tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:51:59.947021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b15a6968-1790-4a62-b3f8-5fa0de4b5ced tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:51:59.950548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-773b5892-e490-43e6-995f-b30d2a68ffd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:51:59.954204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b15a6968-1790-4a62-b3f8-5fa0de4b5ced tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:59.954662 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b15a6968-1790-4a62-b3f8-5fa0de4b5ced tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:59.955452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b15a6968-1790-4a62-b3f8-5fa0de4b5ced tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:51:59.955892 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b15a6968-1790-4a62-b3f8-5fa0de4b5ced tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:51:59.958765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-773b5892-e490-43e6-995f-b30d2a68ffd7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.157088 Aug 01 15:51:59.959362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1240/2149] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:59 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:00.019811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b15a6968-1790-4a62-b3f8-5fa0de4b5ced tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:00.027497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b15a6968-1790-4a62-b3f8-5fa0de4b5ced tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.084933 Aug 01 15:52:00.028060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 910/2150] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:51:59 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:00.981972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8d047068-5eaa-4906-93ba-10c82fab2f36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:00.982795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8d047068-5eaa-4906-93ba-10c82fab2f36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:00.989838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d047068-5eaa-4906-93ba-10c82fab2f36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:00.990397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d047068-5eaa-4906-93ba-10c82fab2f36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:00.991272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d047068-5eaa-4906-93ba-10c82fab2f36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:00.991782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d047068-5eaa-4906-93ba-10c82fab2f36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:01.050590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-25401426-925e-4967-9f43-4acf72fd74c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:01.051968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-25401426-925e-4967-9f43-4acf72fd74c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:01.059095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25401426-925e-4967-9f43-4acf72fd74c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:01.059587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25401426-925e-4967-9f43-4acf72fd74c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:01.060379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25401426-925e-4967-9f43-4acf72fd74c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:01.060852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25401426-925e-4967-9f43-4acf72fd74c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:01.133293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-25401426-925e-4967-9f43-4acf72fd74c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:01.140946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-25401426-925e-4967-9f43-4acf72fd74c4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.094915 Aug 01 15:52:01.141520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 911/2151] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:01 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:01.149513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8d047068-5eaa-4906-93ba-10c82fab2f36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:01.157690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8d047068-5eaa-4906-93ba-10c82fab2f36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.180146 Aug 01 15:52:01.158228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1241/2152] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:00 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:02.163251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6d0bce95-92ad-49b7-8ced-3749ba8053ac tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:02.163870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6d0bce95-92ad-49b7-8ced-3749ba8053ac tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:02.170451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d0bce95-92ad-49b7-8ced-3749ba8053ac tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:02.170906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d0bce95-92ad-49b7-8ced-3749ba8053ac tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:02.171676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d0bce95-92ad-49b7-8ced-3749ba8053ac tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:02.172112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d0bce95-92ad-49b7-8ced-3749ba8053ac tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:02.180509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f9bc60ce-8d25-4b83-b448-fc34fbd6453d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:02.181129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f9bc60ce-8d25-4b83-b448-fc34fbd6453d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:02.187707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9bc60ce-8d25-4b83-b448-fc34fbd6453d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:02.188162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9bc60ce-8d25-4b83-b448-fc34fbd6453d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:02.189430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9bc60ce-8d25-4b83-b448-fc34fbd6453d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:02.189985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9bc60ce-8d25-4b83-b448-fc34fbd6453d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:02.242439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6d0bce95-92ad-49b7-8ced-3749ba8053ac tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:02.250234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6d0bce95-92ad-49b7-8ced-3749ba8053ac tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.091577 Aug 01 15:52:02.250811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 912/2153] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:02 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:02.328286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f9bc60ce-8d25-4b83-b448-fc34fbd6453d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:02.337857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f9bc60ce-8d25-4b83-b448-fc34fbd6453d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.161216 Aug 01 15:52:02.338459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1242/2154] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:02 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:03.272179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f31fadfc-17be-449b-989f-ac985d1a8933 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:03.272795 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f31fadfc-17be-449b-989f-ac985d1a8933 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:03.279619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f31fadfc-17be-449b-989f-ac985d1a8933 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:03.280070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f31fadfc-17be-449b-989f-ac985d1a8933 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:03.280842 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f31fadfc-17be-449b-989f-ac985d1a8933 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:03.281280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f31fadfc-17be-449b-989f-ac985d1a8933 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:03.345264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f31fadfc-17be-449b-989f-ac985d1a8933 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:03.353094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f31fadfc-17be-449b-989f-ac985d1a8933 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.084785 Aug 01 15:52:03.353691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 913/2155] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:03 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:03.360022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ac8e0fa9-2b6d-459b-8705-09fd0af6ce0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:03.360647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ac8e0fa9-2b6d-459b-8705-09fd0af6ce0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:03.367175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac8e0fa9-2b6d-459b-8705-09fd0af6ce0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:03.367655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac8e0fa9-2b6d-459b-8705-09fd0af6ce0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:03.368432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac8e0fa9-2b6d-459b-8705-09fd0af6ce0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:03.368870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac8e0fa9-2b6d-459b-8705-09fd0af6ce0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:03.504556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ac8e0fa9-2b6d-459b-8705-09fd0af6ce0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:03.512662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ac8e0fa9-2b6d-459b-8705-09fd0af6ce0b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.156549 Aug 01 15:52:03.513240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1243/2156] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:03 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:04.374557 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1f53cb4d-fce0-417b-b875-003e03d79bf4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:04.375168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1f53cb4d-fce0-417b-b875-003e03d79bf4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:04.382237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1f53cb4d-fce0-417b-b875-003e03d79bf4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:04.382711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1f53cb4d-fce0-417b-b875-003e03d79bf4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:04.383467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1f53cb4d-fce0-417b-b875-003e03d79bf4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:04.383896 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1f53cb4d-fce0-417b-b875-003e03d79bf4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:04.445465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1f53cb4d-fce0-417b-b875-003e03d79bf4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:04.452983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1f53cb4d-fce0-417b-b875-003e03d79bf4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.082323 Aug 01 15:52:04.453545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 914/2157] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:04 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:04.535900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e5254673-3909-46a4-9f88-496733fd2132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:04.536522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e5254673-3909-46a4-9f88-496733fd2132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:04.543154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e5254673-3909-46a4-9f88-496733fd2132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:04.543601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e5254673-3909-46a4-9f88-496733fd2132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:04.544361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e5254673-3909-46a4-9f88-496733fd2132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:04.544798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e5254673-3909-46a4-9f88-496733fd2132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:04.679617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e5254673-3909-46a4-9f88-496733fd2132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:04.687761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e5254673-3909-46a4-9f88-496733fd2132 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.156136 Aug 01 15:52:04.688346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1244/2158] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:04 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:05.474406 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8c5c7ad0-6865-4ec4-b640-1cab220b6219 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:05.474999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8c5c7ad0-6865-4ec4-b640-1cab220b6219 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:05.481800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8c5c7ad0-6865-4ec4-b640-1cab220b6219 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:05.482272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8c5c7ad0-6865-4ec4-b640-1cab220b6219 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:05.483027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8c5c7ad0-6865-4ec4-b640-1cab220b6219 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:05.483455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8c5c7ad0-6865-4ec4-b640-1cab220b6219 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:05.544177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8c5c7ad0-6865-4ec4-b640-1cab220b6219 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:05.552241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8c5c7ad0-6865-4ec4-b640-1cab220b6219 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.082014 Aug 01 15:52:05.552799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 915/2159] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:05 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:05.708836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-87f05110-e5c0-408d-8caa-e1ba44721b8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:05.709512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-87f05110-e5c0-408d-8caa-e1ba44721b8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:05.716110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87f05110-e5c0-408d-8caa-e1ba44721b8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:05.716590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87f05110-e5c0-408d-8caa-e1ba44721b8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:05.717368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87f05110-e5c0-408d-8caa-e1ba44721b8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:05.717804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87f05110-e5c0-408d-8caa-e1ba44721b8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:05.846000 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-87f05110-e5c0-408d-8caa-e1ba44721b8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:05.856054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-87f05110-e5c0-408d-8caa-e1ba44721b8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.150975 Aug 01 15:52:05.856784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1245/2160] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:05 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:06.573055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b69b56a3-a063-436e-86f9-1029efd02f4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:06.573648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b69b56a3-a063-436e-86f9-1029efd02f4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:06.580835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b69b56a3-a063-436e-86f9-1029efd02f4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:06.581283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b69b56a3-a063-436e-86f9-1029efd02f4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:06.582084 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b69b56a3-a063-436e-86f9-1029efd02f4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:06.582522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b69b56a3-a063-436e-86f9-1029efd02f4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:06.647970 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b69b56a3-a063-436e-86f9-1029efd02f4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:06.655552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b69b56a3-a063-436e-86f9-1029efd02f4d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.086470 Aug 01 15:52:06.656111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 916/2161] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:06 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:06.879389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-66565b67-c270-47b8-9abe-e009bd926aa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:06.880002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-66565b67-c270-47b8-9abe-e009bd926aa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:06.886519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-66565b67-c270-47b8-9abe-e009bd926aa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:06.886962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-66565b67-c270-47b8-9abe-e009bd926aa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:06.887710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-66565b67-c270-47b8-9abe-e009bd926aa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:06.888138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-66565b67-c270-47b8-9abe-e009bd926aa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:07.018594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-66565b67-c270-47b8-9abe-e009bd926aa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:07.026463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-66565b67-c270-47b8-9abe-e009bd926aa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.151464 Aug 01 15:52:07.027026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1246/2162] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:06 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:07.676996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6f2e2738-4752-4edb-92f8-c442b6b5796a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:07.677612 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6f2e2738-4752-4edb-92f8-c442b6b5796a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:07.684209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f2e2738-4752-4edb-92f8-c442b6b5796a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:07.684658 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f2e2738-4752-4edb-92f8-c442b6b5796a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:07.685667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f2e2738-4752-4edb-92f8-c442b6b5796a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:07.686344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f2e2738-4752-4edb-92f8-c442b6b5796a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:07.758295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6f2e2738-4752-4edb-92f8-c442b6b5796a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:07.767043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6f2e2738-4752-4edb-92f8-c442b6b5796a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.093674 Aug 01 15:52:07.767616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 917/2163] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:07 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:08.047928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bb8f551e-f4fe-4266-8c70-d61f98e40092 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:08.048586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bb8f551e-f4fe-4266-8c70-d61f98e40092 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:08.055697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb8f551e-f4fe-4266-8c70-d61f98e40092 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:08.056150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb8f551e-f4fe-4266-8c70-d61f98e40092 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:08.056925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb8f551e-f4fe-4266-8c70-d61f98e40092 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:08.057363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb8f551e-f4fe-4266-8c70-d61f98e40092 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:08.202815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bb8f551e-f4fe-4266-8c70-d61f98e40092 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:08.211428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bb8f551e-f4fe-4266-8c70-d61f98e40092 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.167458 Aug 01 15:52:08.211987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1247/2164] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:08 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:08.788758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-87dae0c1-d1f7-402b-86ab-94e4da83c1a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:08.789349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-87dae0c1-d1f7-402b-86ab-94e4da83c1a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:08.796008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87dae0c1-d1f7-402b-86ab-94e4da83c1a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:08.796447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87dae0c1-d1f7-402b-86ab-94e4da83c1a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:08.797198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87dae0c1-d1f7-402b-86ab-94e4da83c1a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:08.798343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87dae0c1-d1f7-402b-86ab-94e4da83c1a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:08.858622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-87dae0c1-d1f7-402b-86ab-94e4da83c1a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:08.866777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-87dae0c1-d1f7-402b-86ab-94e4da83c1a6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.081841 Aug 01 15:52:08.867339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 918/2165] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:08 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:09.232666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6af7cbb6-9a9a-4951-8a84-7980c0d60c7d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:09.233316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6af7cbb6-9a9a-4951-8a84-7980c0d60c7d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:09.240108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6af7cbb6-9a9a-4951-8a84-7980c0d60c7d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:09.240564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6af7cbb6-9a9a-4951-8a84-7980c0d60c7d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:09.241364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6af7cbb6-9a9a-4951-8a84-7980c0d60c7d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:09.241870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6af7cbb6-9a9a-4951-8a84-7980c0d60c7d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:09.370068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6af7cbb6-9a9a-4951-8a84-7980c0d60c7d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:09.378054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6af7cbb6-9a9a-4951-8a84-7980c0d60c7d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.149244 Aug 01 15:52:09.378624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1248/2166] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:09 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:09.886776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-32b28037-bb3a-4e81-a14e-9dc525c98144 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:09.887397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-32b28037-bb3a-4e81-a14e-9dc525c98144 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:09.893876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-32b28037-bb3a-4e81-a14e-9dc525c98144 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:09.894355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-32b28037-bb3a-4e81-a14e-9dc525c98144 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:09.895113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-32b28037-bb3a-4e81-a14e-9dc525c98144 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:09.895551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-32b28037-bb3a-4e81-a14e-9dc525c98144 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:09.959982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-32b28037-bb3a-4e81-a14e-9dc525c98144 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:09.967546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-32b28037-bb3a-4e81-a14e-9dc525c98144 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.084609 Aug 01 15:52:09.968107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 919/2167] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:09 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:10.399374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ea593ea9-d7f8-4c5d-a86b-c6315c590a5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:10.400017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ea593ea9-d7f8-4c5d-a86b-c6315c590a5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:10.406910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea593ea9-d7f8-4c5d-a86b-c6315c590a5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:10.407367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea593ea9-d7f8-4c5d-a86b-c6315c590a5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:10.408150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea593ea9-d7f8-4c5d-a86b-c6315c590a5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:10.408586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea593ea9-d7f8-4c5d-a86b-c6315c590a5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:10.537325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ea593ea9-d7f8-4c5d-a86b-c6315c590a5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:10.545645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ea593ea9-d7f8-4c5d-a86b-c6315c590a5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.150145 Aug 01 15:52:10.546243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1249/2168] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:10 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:10.989147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d16cb966-6f39-4675-835e-c40c8b5fab92 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:10.989764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d16cb966-6f39-4675-835e-c40c8b5fab92 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:10.992366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=54 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:10.998254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d16cb966-6f39-4675-835e-c40c8b5fab92 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:10.998704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d16cb966-6f39-4675-835e-c40c8b5fab92 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:10.999474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d16cb966-6f39-4675-835e-c40c8b5fab92 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:10.999914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d16cb966-6f39-4675-835e-c40c8b5fab92 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:11.062490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d16cb966-6f39-4675-835e-c40c8b5fab92 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:11.070178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d16cb966-6f39-4675-835e-c40c8b5fab92 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.085321 Aug 01 15:52:11.070749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 920/2169] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:10 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:11.567918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bc221571-7dd4-4772-a6d3-6c213ea903eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:11.568530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bc221571-7dd4-4772-a6d3-6c213ea903eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:11.575239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc221571-7dd4-4772-a6d3-6c213ea903eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:11.575683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc221571-7dd4-4772-a6d3-6c213ea903eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:11.576443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc221571-7dd4-4772-a6d3-6c213ea903eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:11.576873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc221571-7dd4-4772-a6d3-6c213ea903eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:11.708196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bc221571-7dd4-4772-a6d3-6c213ea903eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:11.711606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:11.716974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bc221571-7dd4-4772-a6d3-6c213ea903eb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.153605 Aug 01 15:52:11.717539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1250/2170] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:11 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:12.090910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3539fa8f-c8ea-4559-a924-20a16aeb2d0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:12.091527 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3539fa8f-c8ea-4559-a924-20a16aeb2d0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:12.098875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3539fa8f-c8ea-4559-a924-20a16aeb2d0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:12.099325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3539fa8f-c8ea-4559-a924-20a16aeb2d0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:12.100097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3539fa8f-c8ea-4559-a924-20a16aeb2d0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:12.100535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3539fa8f-c8ea-4559-a924-20a16aeb2d0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:12.104558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:12.163137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3539fa8f-c8ea-4559-a924-20a16aeb2d0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:12.170707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3539fa8f-c8ea-4559-a924-20a16aeb2d0f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.083622 Aug 01 15:52:12.171270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 921/2171] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:12 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:12.739006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-30048532-385c-4c24-a4d9-dcbcd3ff9956 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:12.739837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-30048532-385c-4c24-a4d9-dcbcd3ff9956 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:12.747162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30048532-385c-4c24-a4d9-dcbcd3ff9956 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:12.747610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30048532-385c-4c24-a4d9-dcbcd3ff9956 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:12.748467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30048532-385c-4c24-a4d9-dcbcd3ff9956 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:12.748817 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30048532-385c-4c24-a4d9-dcbcd3ff9956 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:12.883845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-30048532-385c-4c24-a4d9-dcbcd3ff9956 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:12.892193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-30048532-385c-4c24-a4d9-dcbcd3ff9956 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.157101 Aug 01 15:52:12.892856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1251/2172] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:12 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:13.192774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2dcfe246-153b-49a5-b3e7-6d0d7132462d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:13.193314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2dcfe246-153b-49a5-b3e7-6d0d7132462d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:13.199943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dcfe246-153b-49a5-b3e7-6d0d7132462d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:13.200389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dcfe246-153b-49a5-b3e7-6d0d7132462d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:13.201152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dcfe246-153b-49a5-b3e7-6d0d7132462d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:13.201587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dcfe246-153b-49a5-b3e7-6d0d7132462d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:13.274629 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2dcfe246-153b-49a5-b3e7-6d0d7132462d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:13.282723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2dcfe246-153b-49a5-b3e7-6d0d7132462d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.094003 Aug 01 15:52:13.283285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 922/2173] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:13 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:13.916677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aa1ce098-6045-4d4f-b707-752473530dff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:13.917276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aa1ce098-6045-4d4f-b707-752473530dff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:13.924015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa1ce098-6045-4d4f-b707-752473530dff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:13.924448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa1ce098-6045-4d4f-b707-752473530dff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:13.925215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa1ce098-6045-4d4f-b707-752473530dff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:13.925647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa1ce098-6045-4d4f-b707-752473530dff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:14.056572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aa1ce098-6045-4d4f-b707-752473530dff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:14.065337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aa1ce098-6045-4d4f-b707-752473530dff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.152558 Aug 01 15:52:14.066007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1252/2174] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:13 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:14.306748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d0e03330-689f-45c1-a82f-1dfec2eedae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:14.307398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d0e03330-689f-45c1-a82f-1dfec2eedae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:14.314521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d0e03330-689f-45c1-a82f-1dfec2eedae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:14.314977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d0e03330-689f-45c1-a82f-1dfec2eedae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:14.315734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d0e03330-689f-45c1-a82f-1dfec2eedae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:14.316166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d0e03330-689f-45c1-a82f-1dfec2eedae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:14.377070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d0e03330-689f-45c1-a82f-1dfec2eedae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:14.384709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d0e03330-689f-45c1-a82f-1dfec2eedae2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.082100 Aug 01 15:52:14.385278 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 923/2175] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:14 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:15.088005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e54c862b-2c79-4478-a18c-d15fce91466d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:15.088621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e54c862b-2c79-4478-a18c-d15fce91466d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:15.095692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e54c862b-2c79-4478-a18c-d15fce91466d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:15.096146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e54c862b-2c79-4478-a18c-d15fce91466d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:15.097183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e54c862b-2c79-4478-a18c-d15fce91466d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:15.097618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e54c862b-2c79-4478-a18c-d15fce91466d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:15.227048 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e54c862b-2c79-4478-a18c-d15fce91466d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:15.234926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e54c862b-2c79-4478-a18c-d15fce91466d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.150772 Aug 01 15:52:15.235489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1253/2176] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:15 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:15.405586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4ccded56-c74d-4cc8-93d0-4354448823c8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:15.406205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4ccded56-c74d-4cc8-93d0-4354448823c8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:15.413326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4ccded56-c74d-4cc8-93d0-4354448823c8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:15.413785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4ccded56-c74d-4cc8-93d0-4354448823c8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:15.414553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4ccded56-c74d-4cc8-93d0-4354448823c8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:15.415010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4ccded56-c74d-4cc8-93d0-4354448823c8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:15.475699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4ccded56-c74d-4cc8-93d0-4354448823c8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:15.483286 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4ccded56-c74d-4cc8-93d0-4354448823c8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.081694 Aug 01 15:52:15.483851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 924/2177] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:15 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:16.257163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-368c484c-94ca-49e6-bb8a-3c75d1797854 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:16.257816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-368c484c-94ca-49e6-bb8a-3c75d1797854 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:16.264391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-368c484c-94ca-49e6-bb8a-3c75d1797854 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:16.264843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-368c484c-94ca-49e6-bb8a-3c75d1797854 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:16.265590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-368c484c-94ca-49e6-bb8a-3c75d1797854 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:16.266068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-368c484c-94ca-49e6-bb8a-3c75d1797854 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:16.394228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-368c484c-94ca-49e6-bb8a-3c75d1797854 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:16.402211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-368c484c-94ca-49e6-bb8a-3c75d1797854 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.148940 Aug 01 15:52:16.402762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1254/2178] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:16 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:16.504367 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-45627622-358c-4499-ad43-32911c7ab202 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:16.504984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-45627622-358c-4499-ad43-32911c7ab202 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:16.511650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45627622-358c-4499-ad43-32911c7ab202 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:16.512209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45627622-358c-4499-ad43-32911c7ab202 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:16.512865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45627622-358c-4499-ad43-32911c7ab202 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:16.513297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45627622-358c-4499-ad43-32911c7ab202 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:16.580253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-45627622-358c-4499-ad43-32911c7ab202 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:16.587834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-45627622-358c-4499-ad43-32911c7ab202 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.087411 Aug 01 15:52:16.588407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 925/2179] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:16 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:17.425293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b3c20aec-9065-437c-9e27-144f90310daa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:17.425952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b3c20aec-9065-437c-9e27-144f90310daa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:17.432597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b3c20aec-9065-437c-9e27-144f90310daa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:17.433048 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b3c20aec-9065-437c-9e27-144f90310daa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:17.433812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b3c20aec-9065-437c-9e27-144f90310daa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:17.434280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b3c20aec-9065-437c-9e27-144f90310daa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:17.573225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b3c20aec-9065-437c-9e27-144f90310daa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:17.581824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b3c20aec-9065-437c-9e27-144f90310daa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.161110 Aug 01 15:52:17.582438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1255/2180] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:17 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:17.608459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8f6d9f60-312b-4572-bd8f-224cc4e1020c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:17.609158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8f6d9f60-312b-4572-bd8f-224cc4e1020c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:17.616130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f6d9f60-312b-4572-bd8f-224cc4e1020c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:17.616581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f6d9f60-312b-4572-bd8f-224cc4e1020c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:17.617340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f6d9f60-312b-4572-bd8f-224cc4e1020c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:17.617778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f6d9f60-312b-4572-bd8f-224cc4e1020c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:17.679121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8f6d9f60-312b-4572-bd8f-224cc4e1020c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:17.686673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8f6d9f60-312b-4572-bd8f-224cc4e1020c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.082044 Aug 01 15:52:17.687237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 926/2181] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:17 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:18.603196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-263f2fed-450b-4d51-a9d9-23dccca76c28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:18.603909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-263f2fed-450b-4d51-a9d9-23dccca76c28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:18.611137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-263f2fed-450b-4d51-a9d9-23dccca76c28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:18.611579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-263f2fed-450b-4d51-a9d9-23dccca76c28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:18.612333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-263f2fed-450b-4d51-a9d9-23dccca76c28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:18.612761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-263f2fed-450b-4d51-a9d9-23dccca76c28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:18.709594 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ecfc9823-b3dd-4dc0-8fcb-4d55245f7311 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:18.710306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ecfc9823-b3dd-4dc0-8fcb-4d55245f7311 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:18.716852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ecfc9823-b3dd-4dc0-8fcb-4d55245f7311 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:18.717308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ecfc9823-b3dd-4dc0-8fcb-4d55245f7311 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:18.718111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ecfc9823-b3dd-4dc0-8fcb-4d55245f7311 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:18.718554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ecfc9823-b3dd-4dc0-8fcb-4d55245f7311 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:18.747980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-263f2fed-450b-4d51-a9d9-23dccca76c28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:18.756118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-263f2fed-450b-4d51-a9d9-23dccca76c28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.156741 Aug 01 15:52:18.756702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1256/2182] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:18 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:18.780277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ecfc9823-b3dd-4dc0-8fcb-4d55245f7311 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:18.788237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ecfc9823-b3dd-4dc0-8fcb-4d55245f7311 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.082988 Aug 01 15:52:18.788800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 927/2183] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:18 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:19.221872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:52:19.222165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:52:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:52:19.778259 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fc185de3-2829-40f7-8341-2391eea764f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:19.778905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fc185de3-2829-40f7-8341-2391eea764f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:19.785099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fc185de3-2829-40f7-8341-2391eea764f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:19.785555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fc185de3-2829-40f7-8341-2391eea764f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:19.786394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fc185de3-2829-40f7-8341-2391eea764f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:19.786833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fc185de3-2829-40f7-8341-2391eea764f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:19.809845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f543f9c2-05ec-4f1a-a888-1f73f961d093 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:19.810486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f543f9c2-05ec-4f1a-a888-1f73f961d093 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:19.817746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f543f9c2-05ec-4f1a-a888-1f73f961d093 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:19.818224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f543f9c2-05ec-4f1a-a888-1f73f961d093 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:19.818980 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f543f9c2-05ec-4f1a-a888-1f73f961d093 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:19.819433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f543f9c2-05ec-4f1a-a888-1f73f961d093 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:19.892084 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f543f9c2-05ec-4f1a-a888-1f73f961d093 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:19.909652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f543f9c2-05ec-4f1a-a888-1f73f961d093 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.103430 Aug 01 15:52:19.910320 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 928/2184] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:19 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:19.953690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fc185de3-2829-40f7-8341-2391eea764f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:19.961755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fc185de3-2829-40f7-8341-2391eea764f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.187583 Aug 01 15:52:19.962349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1257/2185] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:19 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:20.931434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-73e9e22d-3fd5-48a5-a06c-5f2505f3f27b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:20.932040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-73e9e22d-3fd5-48a5-a06c-5f2505f3f27b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:20.939680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73e9e22d-3fd5-48a5-a06c-5f2505f3f27b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:20.940135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73e9e22d-3fd5-48a5-a06c-5f2505f3f27b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:20.940917 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73e9e22d-3fd5-48a5-a06c-5f2505f3f27b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:20.941356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73e9e22d-3fd5-48a5-a06c-5f2505f3f27b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:20.983638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fb9b7930-d15f-4d39-984e-adcdbb2fabab tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:20.984338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fb9b7930-d15f-4d39-984e-adcdbb2fabab tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:20.991989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb9b7930-d15f-4d39-984e-adcdbb2fabab tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:20.992558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb9b7930-d15f-4d39-984e-adcdbb2fabab tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:20.993319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb9b7930-d15f-4d39-984e-adcdbb2fabab tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:20.993775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb9b7930-d15f-4d39-984e-adcdbb2fabab tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:21.006581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-73e9e22d-3fd5-48a5-a06c-5f2505f3f27b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:21.014392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-73e9e22d-3fd5-48a5-a06c-5f2505f3f27b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.086768 Aug 01 15:52:21.014991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 929/2186] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:20 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:21.123555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fb9b7930-d15f-4d39-984e-adcdbb2fabab tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:21.131789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fb9b7930-d15f-4d39-984e-adcdbb2fabab tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.151995 Aug 01 15:52:21.132362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1258/2187] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:20 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:22.035843 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-78ad6eb7-2d47-45fc-9086-edc937ed9665 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:22.036387 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-78ad6eb7-2d47-45fc-9086-edc937ed9665 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:22.042961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-78ad6eb7-2d47-45fc-9086-edc937ed9665 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:22.043402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-78ad6eb7-2d47-45fc-9086-edc937ed9665 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:22.044155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-78ad6eb7-2d47-45fc-9086-edc937ed9665 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:22.044586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-78ad6eb7-2d47-45fc-9086-edc937ed9665 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:22.154461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-39bcf102-59f3-4c11-a948-abf369f994d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:22.155147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-39bcf102-59f3-4c11-a948-abf369f994d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:22.162225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39bcf102-59f3-4c11-a948-abf369f994d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:22.162665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39bcf102-59f3-4c11-a948-abf369f994d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:22.163441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39bcf102-59f3-4c11-a948-abf369f994d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:22.163870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-39bcf102-59f3-4c11-a948-abf369f994d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:22.263988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-78ad6eb7-2d47-45fc-9086-edc937ed9665 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:22.271648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-78ad6eb7-2d47-45fc-9086-edc937ed9665 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.239746 Aug 01 15:52:22.272220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 930/2188] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:22 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:22.321858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-39bcf102-59f3-4c11-a948-abf369f994d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:22.329932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-39bcf102-59f3-4c11-a948-abf369f994d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.179412 Aug 01 15:52:22.330501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1259/2189] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:22 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:23.292784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-80f8dcda-cfd9-4bea-bb81-3093d281bd47 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:23.293531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-80f8dcda-cfd9-4bea-bb81-3093d281bd47 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:23.300409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80f8dcda-cfd9-4bea-bb81-3093d281bd47 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:23.300860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80f8dcda-cfd9-4bea-bb81-3093d281bd47 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:23.301635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80f8dcda-cfd9-4bea-bb81-3093d281bd47 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:23.302111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80f8dcda-cfd9-4bea-bb81-3093d281bd47 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:23.354088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7fd844ad-811d-4b4d-9b11-29db31f2986e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:23.355505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7fd844ad-811d-4b4d-9b11-29db31f2986e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:23.367912 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fd844ad-811d-4b4d-9b11-29db31f2986e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:23.368360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fd844ad-811d-4b4d-9b11-29db31f2986e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:23.369156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fd844ad-811d-4b4d-9b11-29db31f2986e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:23.369588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fd844ad-811d-4b4d-9b11-29db31f2986e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:23.377036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-80f8dcda-cfd9-4bea-bb81-3093d281bd47 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:23.384407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-80f8dcda-cfd9-4bea-bb81-3093d281bd47 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.095628 Aug 01 15:52:23.384948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 931/2190] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:23 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:23.501001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7fd844ad-811d-4b4d-9b11-29db31f2986e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:23.509001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7fd844ad-811d-4b4d-9b11-29db31f2986e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.158903 Aug 01 15:52:23.509568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1260/2191] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:23 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:24.405588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-560322b3-6f9c-4280-8417-4d8d648156ec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:24.406232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-560322b3-6f9c-4280-8417-4d8d648156ec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:24.412797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-560322b3-6f9c-4280-8417-4d8d648156ec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:24.413250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-560322b3-6f9c-4280-8417-4d8d648156ec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:24.414041 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-560322b3-6f9c-4280-8417-4d8d648156ec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:24.414488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-560322b3-6f9c-4280-8417-4d8d648156ec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:24.475548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-560322b3-6f9c-4280-8417-4d8d648156ec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:24.483257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-560322b3-6f9c-4280-8417-4d8d648156ec tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.081589 Aug 01 15:52:24.483814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 932/2192] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:24 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:24.531194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a2d3a2c0-adc0-4020-89cf-a6f21cacea4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:24.532338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a2d3a2c0-adc0-4020-89cf-a6f21cacea4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:24.539318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2d3a2c0-adc0-4020-89cf-a6f21cacea4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:24.539773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2d3a2c0-adc0-4020-89cf-a6f21cacea4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:24.540557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2d3a2c0-adc0-4020-89cf-a6f21cacea4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:24.541120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2d3a2c0-adc0-4020-89cf-a6f21cacea4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:24.668950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a2d3a2c0-adc0-4020-89cf-a6f21cacea4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:24.677524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a2d3a2c0-adc0-4020-89cf-a6f21cacea4d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.150280 Aug 01 15:52:24.678126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1261/2193] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:24 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:25.503984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5571be27-979e-4500-94ee-104a005ef253 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:25.504602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5571be27-979e-4500-94ee-104a005ef253 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:25.511393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5571be27-979e-4500-94ee-104a005ef253 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:25.511931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5571be27-979e-4500-94ee-104a005ef253 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:25.512865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5571be27-979e-4500-94ee-104a005ef253 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:25.513365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5571be27-979e-4500-94ee-104a005ef253 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:25.577448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5571be27-979e-4500-94ee-104a005ef253 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:25.585155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5571be27-979e-4500-94ee-104a005ef253 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.085031 Aug 01 15:52:25.585699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 933/2194] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:25 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:25.699042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7b04ba2c-2656-4e25-aa42-ee5a95f81668 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:25.699657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7b04ba2c-2656-4e25-aa42-ee5a95f81668 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:25.706857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b04ba2c-2656-4e25-aa42-ee5a95f81668 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:25.707306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b04ba2c-2656-4e25-aa42-ee5a95f81668 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:25.708072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b04ba2c-2656-4e25-aa42-ee5a95f81668 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:25.708529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b04ba2c-2656-4e25-aa42-ee5a95f81668 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:25.841255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7b04ba2c-2656-4e25-aa42-ee5a95f81668 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:25.850236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7b04ba2c-2656-4e25-aa42-ee5a95f81668 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.155051 Aug 01 15:52:25.850822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1262/2195] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:25 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:26.213607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:52:26.213834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:52:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:52:26.606652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1ab05161-7472-4b98-b785-90a76b74fdd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:26.607298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1ab05161-7472-4b98-b785-90a76b74fdd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:26.614316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ab05161-7472-4b98-b785-90a76b74fdd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:26.614763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ab05161-7472-4b98-b785-90a76b74fdd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:26.615525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ab05161-7472-4b98-b785-90a76b74fdd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:26.615967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ab05161-7472-4b98-b785-90a76b74fdd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:26.676801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1ab05161-7472-4b98-b785-90a76b74fdd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:26.684452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1ab05161-7472-4b98-b785-90a76b74fdd0 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.081677 Aug 01 15:52:26.684949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 934/2196] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:26 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:26.872826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cc3b23d1-ef67-4595-92ea-f41bdd9b4893 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:26.873473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cc3b23d1-ef67-4595-92ea-f41bdd9b4893 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:26.876001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=52 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:26.881386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc3b23d1-ef67-4595-92ea-f41bdd9b4893 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:26.881836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc3b23d1-ef67-4595-92ea-f41bdd9b4893 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:26.882632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc3b23d1-ef67-4595-92ea-f41bdd9b4893 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:26.883069 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc3b23d1-ef67-4595-92ea-f41bdd9b4893 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:27.015384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cc3b23d1-ef67-4595-92ea-f41bdd9b4893 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:27.023669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cc3b23d1-ef67-4595-92ea-f41bdd9b4893 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.154697 Aug 01 15:52:27.024264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1263/2197] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:26 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:27.710114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-37f7bc07-6c88-45b3-9959-581d09c7cdfd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:27.710740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-37f7bc07-6c88-45b3-9959-581d09c7cdfd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:27.718056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37f7bc07-6c88-45b3-9959-581d09c7cdfd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:27.718587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37f7bc07-6c88-45b3-9959-581d09c7cdfd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:27.719620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37f7bc07-6c88-45b3-9959-581d09c7cdfd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:27.720113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37f7bc07-6c88-45b3-9959-581d09c7cdfd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:27.784719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-37f7bc07-6c88-45b3-9959-581d09c7cdfd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:27.792287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-37f7bc07-6c88-45b3-9959-581d09c7cdfd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.086357 Aug 01 15:52:27.792845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 935/2198] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:27 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:28.045832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-be1c3eb8-6b4d-4bf1-a26c-be66c8b68bac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:28.046401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-be1c3eb8-6b4d-4bf1-a26c-be66c8b68bac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:28.053584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be1c3eb8-6b4d-4bf1-a26c-be66c8b68bac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:28.054078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be1c3eb8-6b4d-4bf1-a26c-be66c8b68bac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:28.054846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be1c3eb8-6b4d-4bf1-a26c-be66c8b68bac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:28.055284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be1c3eb8-6b4d-4bf1-a26c-be66c8b68bac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:28.187429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-be1c3eb8-6b4d-4bf1-a26c-be66c8b68bac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:28.196015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-be1c3eb8-6b4d-4bf1-a26c-be66c8b68bac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.154163 Aug 01 15:52:28.196580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1264/2199] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:28 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:28.813422 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3d227165-6b7d-46dd-bafb-4d96bf86831d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:28.814076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3d227165-6b7d-46dd-bafb-4d96bf86831d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:28.820636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d227165-6b7d-46dd-bafb-4d96bf86831d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:28.821084 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d227165-6b7d-46dd-bafb-4d96bf86831d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:28.821851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d227165-6b7d-46dd-bafb-4d96bf86831d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:28.822312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d227165-6b7d-46dd-bafb-4d96bf86831d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:28.887364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3d227165-6b7d-46dd-bafb-4d96bf86831d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:28.895436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3d227165-6b7d-46dd-bafb-4d96bf86831d tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.085978 Aug 01 15:52:28.895981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 936/2200] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:28 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:29.217512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c3c22924-1e9b-41b6-a53f-2d75be87440f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:29.218143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c3c22924-1e9b-41b6-a53f-2d75be87440f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:29.225881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3c22924-1e9b-41b6-a53f-2d75be87440f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:29.226419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3c22924-1e9b-41b6-a53f-2d75be87440f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:29.227172 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3c22924-1e9b-41b6-a53f-2d75be87440f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:29.227601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3c22924-1e9b-41b6-a53f-2d75be87440f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:29.354927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c3c22924-1e9b-41b6-a53f-2d75be87440f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:29.363547 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c3c22924-1e9b-41b6-a53f-2d75be87440f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.149873 Aug 01 15:52:29.364121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1265/2201] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:29 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:29.916780 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0854545a-922d-489c-8733-5a9c2c0f5a4e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:29.917357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0854545a-922d-489c-8733-5a9c2c0f5a4e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:29.924923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0854545a-922d-489c-8733-5a9c2c0f5a4e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:29.925375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0854545a-922d-489c-8733-5a9c2c0f5a4e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:29.926183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0854545a-922d-489c-8733-5a9c2c0f5a4e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:29.926624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0854545a-922d-489c-8733-5a9c2c0f5a4e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:29.995512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0854545a-922d-489c-8733-5a9c2c0f5a4e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:29.999299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:30.004320 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0854545a-922d-489c-8733-5a9c2c0f5a4e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.091498 Aug 01 15:52:30.004895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 937/2202] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:29 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:30.385245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cb4b39e4-dd8b-4d49-98f6-c9412f2a05cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:30.385844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cb4b39e4-dd8b-4d49-98f6-c9412f2a05cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:30.392895 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cb4b39e4-dd8b-4d49-98f6-c9412f2a05cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:30.393332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cb4b39e4-dd8b-4d49-98f6-c9412f2a05cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:30.394114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cb4b39e4-dd8b-4d49-98f6-c9412f2a05cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:30.394546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cb4b39e4-dd8b-4d49-98f6-c9412f2a05cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:30.523696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cb4b39e4-dd8b-4d49-98f6-c9412f2a05cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:30.531615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cb4b39e4-dd8b-4d49-98f6-c9412f2a05cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.150183 Aug 01 15:52:30.532184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1266/2203] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:31.024618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4117234f-9044-4ea7-bd39-216508004fbc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:31.025312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4117234f-9044-4ea7-bd39-216508004fbc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:31.032089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4117234f-9044-4ea7-bd39-216508004fbc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:31.033155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4117234f-9044-4ea7-bd39-216508004fbc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:31.033957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4117234f-9044-4ea7-bd39-216508004fbc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:31.034404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4117234f-9044-4ea7-bd39-216508004fbc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:31.108001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4117234f-9044-4ea7-bd39-216508004fbc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:31.115774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4117234f-9044-4ea7-bd39-216508004fbc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.095018 Aug 01 15:52:31.116333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 938/2204] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:31 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:31.553155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-13bf3fc8-7188-4a05-a6b3-5125bcf7e6d7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:31.553748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-13bf3fc8-7188-4a05-a6b3-5125bcf7e6d7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:31.560417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13bf3fc8-7188-4a05-a6b3-5125bcf7e6d7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:31.560858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13bf3fc8-7188-4a05-a6b3-5125bcf7e6d7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:31.561607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13bf3fc8-7188-4a05-a6b3-5125bcf7e6d7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:31.562071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13bf3fc8-7188-4a05-a6b3-5125bcf7e6d7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:31.580602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:31.693731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-13bf3fc8-7188-4a05-a6b3-5125bcf7e6d7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:31.701830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-13bf3fc8-7188-4a05-a6b3-5125bcf7e6d7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.152517 Aug 01 15:52:31.702431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1267/2205] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:31 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:32.136486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a65aeca2-ff5c-4edd-915d-ee3bbae10360 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:32.137185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a65aeca2-ff5c-4edd-915d-ee3bbae10360 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:32.143654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a65aeca2-ff5c-4edd-915d-ee3bbae10360 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:32.144105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a65aeca2-ff5c-4edd-915d-ee3bbae10360 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:32.144873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a65aeca2-ff5c-4edd-915d-ee3bbae10360 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:32.145311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a65aeca2-ff5c-4edd-915d-ee3bbae10360 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:32.209232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a65aeca2-ff5c-4edd-915d-ee3bbae10360 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:32.216901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a65aeca2-ff5c-4edd-915d-ee3bbae10360 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.084308 Aug 01 15:52:32.217460 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 939/2206] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:32 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:32.724175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-db12c6b5-3197-46c6-9af0-4d75a7f80c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:32.724776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-db12c6b5-3197-46c6-9af0-4d75a7f80c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:32.731603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db12c6b5-3197-46c6-9af0-4d75a7f80c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:32.732059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db12c6b5-3197-46c6-9af0-4d75a7f80c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:32.732840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db12c6b5-3197-46c6-9af0-4d75a7f80c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:32.733280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db12c6b5-3197-46c6-9af0-4d75a7f80c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:32.863127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-db12c6b5-3197-46c6-9af0-4d75a7f80c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:32.871138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-db12c6b5-3197-46c6-9af0-4d75a7f80c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.151693 Aug 01 15:52:32.871712 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1268/2207] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:32 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:33.238116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2def90a0-c7e2-4dee-8bb6-b6efb93b8c96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:33.238741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2def90a0-c7e2-4dee-8bb6-b6efb93b8c96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:33.245292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2def90a0-c7e2-4dee-8bb6-b6efb93b8c96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:33.245742 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2def90a0-c7e2-4dee-8bb6-b6efb93b8c96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:33.246554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2def90a0-c7e2-4dee-8bb6-b6efb93b8c96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:33.246994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2def90a0-c7e2-4dee-8bb6-b6efb93b8c96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:33.306945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2def90a0-c7e2-4dee-8bb6-b6efb93b8c96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:33.315076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2def90a0-c7e2-4dee-8bb6-b6efb93b8c96 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.081443 Aug 01 15:52:33.315635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 940/2208] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:33 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:33.894359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ea4038d1-6c6e-4739-9c14-f3fce26745c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:33.894964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ea4038d1-6c6e-4739-9c14-f3fce26745c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:33.901729 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea4038d1-6c6e-4739-9c14-f3fce26745c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:33.902199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea4038d1-6c6e-4739-9c14-f3fce26745c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:33.902963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea4038d1-6c6e-4739-9c14-f3fce26745c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:33.903392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ea4038d1-6c6e-4739-9c14-f3fce26745c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:34.038989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ea4038d1-6c6e-4739-9c14-f3fce26745c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:34.047061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ea4038d1-6c6e-4739-9c14-f3fce26745c9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.157062 Aug 01 15:52:34.047630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1269/2209] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:33 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:34.336340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-62fcd707-cf5e-47ff-9044-a4ab100c0546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:34.336982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-62fcd707-cf5e-47ff-9044-a4ab100c0546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:34.343494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62fcd707-cf5e-47ff-9044-a4ab100c0546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:34.343935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62fcd707-cf5e-47ff-9044-a4ab100c0546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:34.344688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62fcd707-cf5e-47ff-9044-a4ab100c0546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:34.345120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-62fcd707-cf5e-47ff-9044-a4ab100c0546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:34.405100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-62fcd707-cf5e-47ff-9044-a4ab100c0546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:34.412627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-62fcd707-cf5e-47ff-9044-a4ab100c0546 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.080220 Aug 01 15:52:34.413176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 941/2210] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:34 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:35.068728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-98edb3d3-7872-4fbc-8f10-debc0167641b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:35.069431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-98edb3d3-7872-4fbc-8f10-debc0167641b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:35.075901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98edb3d3-7872-4fbc-8f10-debc0167641b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:35.076407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98edb3d3-7872-4fbc-8f10-debc0167641b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:35.077116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98edb3d3-7872-4fbc-8f10-debc0167641b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:35.077559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98edb3d3-7872-4fbc-8f10-debc0167641b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:35.208791 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-98edb3d3-7872-4fbc-8f10-debc0167641b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:35.216683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-98edb3d3-7872-4fbc-8f10-debc0167641b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.151872 Aug 01 15:52:35.217264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1270/2211] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:35 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:35.433824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-910e487a-d8e4-487b-8b58-f5fa93ad4146 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:35.434457 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-910e487a-d8e4-487b-8b58-f5fa93ad4146 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:35.441021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-910e487a-d8e4-487b-8b58-f5fa93ad4146 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:35.441475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-910e487a-d8e4-487b-8b58-f5fa93ad4146 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:35.442277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-910e487a-d8e4-487b-8b58-f5fa93ad4146 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:35.442718 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-910e487a-d8e4-487b-8b58-f5fa93ad4146 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:35.508704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-910e487a-d8e4-487b-8b58-f5fa93ad4146 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:35.516742 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-910e487a-d8e4-487b-8b58-f5fa93ad4146 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.086806 Aug 01 15:52:35.517293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 942/2212] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:35 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:36.238964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-008d04dd-e6bd-4c09-987f-c964abf5158d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:36.239584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-008d04dd-e6bd-4c09-987f-c964abf5158d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:36.246908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-008d04dd-e6bd-4c09-987f-c964abf5158d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:36.247710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-008d04dd-e6bd-4c09-987f-c964abf5158d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:36.249037 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-008d04dd-e6bd-4c09-987f-c964abf5158d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:36.249843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-008d04dd-e6bd-4c09-987f-c964abf5158d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:36.376065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-008d04dd-e6bd-4c09-987f-c964abf5158d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:36.384030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-008d04dd-e6bd-4c09-987f-c964abf5158d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.148968 Aug 01 15:52:36.384602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1271/2213] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:36 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:36.536763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-35d86f49-12d4-4144-bf06-4d78003ff3c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:36.537403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-35d86f49-12d4-4144-bf06-4d78003ff3c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:36.544013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-35d86f49-12d4-4144-bf06-4d78003ff3c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:36.544462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-35d86f49-12d4-4144-bf06-4d78003ff3c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:36.545220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-35d86f49-12d4-4144-bf06-4d78003ff3c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:36.545655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-35d86f49-12d4-4144-bf06-4d78003ff3c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:36.605879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-35d86f49-12d4-4144-bf06-4d78003ff3c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:36.613310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-35d86f49-12d4-4144-bf06-4d78003ff3c2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.080481 Aug 01 15:52:36.613870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 943/2214] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:36 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:37.406229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-06e1ca36-8a32-4a4a-b3bf-2479cc1860e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:37.406839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-06e1ca36-8a32-4a4a-b3bf-2479cc1860e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:37.413852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06e1ca36-8a32-4a4a-b3bf-2479cc1860e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:37.414334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06e1ca36-8a32-4a4a-b3bf-2479cc1860e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:37.415092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06e1ca36-8a32-4a4a-b3bf-2479cc1860e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:37.415528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06e1ca36-8a32-4a4a-b3bf-2479cc1860e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:37.634074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2023d299-18b6-4556-876c-57080ee12f99 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:37.634699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2023d299-18b6-4556-876c-57080ee12f99 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:37.641604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2023d299-18b6-4556-876c-57080ee12f99 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:37.642175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2023d299-18b6-4556-876c-57080ee12f99 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:37.642969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2023d299-18b6-4556-876c-57080ee12f99 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:37.643407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2023d299-18b6-4556-876c-57080ee12f99 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:37.796467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-06e1ca36-8a32-4a4a-b3bf-2479cc1860e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:37.805152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-06e1ca36-8a32-4a4a-b3bf-2479cc1860e1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.402723 Aug 01 15:52:37.805733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1272/2215] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:37 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:37.812615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2023d299-18b6-4556-876c-57080ee12f99 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:37.820300 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2023d299-18b6-4556-876c-57080ee12f99 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.190212 Aug 01 15:52:37.820857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 944/2216] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:37 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:38.832988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-19fac128-c2db-42dc-bc5e-8c392ed0247e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:38.833574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-19fac128-c2db-42dc-bc5e-8c392ed0247e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:38.840656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19fac128-c2db-42dc-bc5e-8c392ed0247e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:38.841099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19fac128-c2db-42dc-bc5e-8c392ed0247e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:38.841399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-dcfb90ea-7302-423b-bf30-0854f2ea2e88 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:38.841866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19fac128-c2db-42dc-bc5e-8c392ed0247e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:38.842336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-dcfb90ea-7302-423b-bf30-0854f2ea2e88 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:38.842532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19fac128-c2db-42dc-bc5e-8c392ed0247e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:38.850511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dcfb90ea-7302-423b-bf30-0854f2ea2e88 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:38.850966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dcfb90ea-7302-423b-bf30-0854f2ea2e88 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:38.851748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dcfb90ea-7302-423b-bf30-0854f2ea2e88 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:38.852190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dcfb90ea-7302-423b-bf30-0854f2ea2e88 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:38.934267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dcfb90ea-7302-423b-bf30-0854f2ea2e88 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:38.942411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-dcfb90ea-7302-423b-bf30-0854f2ea2e88 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.104805 Aug 01 15:52:38.943272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 945/2217] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:38 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:39.000951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-19fac128-c2db-42dc-bc5e-8c392ed0247e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:39.009506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-19fac128-c2db-42dc-bc5e-8c392ed0247e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.181105 Aug 01 15:52:39.010104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1273/2218] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:38 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:39.963261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-12f43943-06d0-499d-8bf5-216ec0b6f8e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:39.963892 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-12f43943-06d0-499d-8bf5-216ec0b6f8e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:39.970552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-12f43943-06d0-499d-8bf5-216ec0b6f8e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:39.971111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-12f43943-06d0-499d-8bf5-216ec0b6f8e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:39.972111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-12f43943-06d0-499d-8bf5-216ec0b6f8e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:39.972627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-12f43943-06d0-499d-8bf5-216ec0b6f8e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:40.031195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fca07f5c-7783-495f-aa6d-1e5e836f958c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:40.031845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fca07f5c-7783-495f-aa6d-1e5e836f958c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:40.037421 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-12f43943-06d0-499d-8bf5-216ec0b6f8e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:40.039168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fca07f5c-7783-495f-aa6d-1e5e836f958c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:40.040675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fca07f5c-7783-495f-aa6d-1e5e836f958c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:40.040675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fca07f5c-7783-495f-aa6d-1e5e836f958c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:40.041005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fca07f5c-7783-495f-aa6d-1e5e836f958c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:40.045171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-12f43943-06d0-499d-8bf5-216ec0b6f8e5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.085716 Aug 01 15:52:40.045754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 946/2219] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:39 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:40.171450 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fca07f5c-7783-495f-aa6d-1e5e836f958c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:40.179416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fca07f5c-7783-495f-aa6d-1e5e836f958c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.152076 Aug 01 15:52:40.179970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1274/2220] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:40 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:41.066423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-db3454c6-87cf-401b-83de-ce36bb964af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:41.067033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-db3454c6-87cf-401b-83de-ce36bb964af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:41.069360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=54 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:41.074591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db3454c6-87cf-401b-83de-ce36bb964af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:41.075032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db3454c6-87cf-401b-83de-ce36bb964af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:41.075794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db3454c6-87cf-401b-83de-ce36bb964af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:41.076227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-db3454c6-87cf-401b-83de-ce36bb964af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:41.137851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-db3454c6-87cf-401b-83de-ce36bb964af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:41.145717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-db3454c6-87cf-401b-83de-ce36bb964af1 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.083253 Aug 01 15:52:41.146302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 947/2221] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:41 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:41.200571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3f28297a-ccdd-4d4e-bea4-1b717a8d4345 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:41.201093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3f28297a-ccdd-4d4e-bea4-1b717a8d4345 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:41.207654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f28297a-ccdd-4d4e-bea4-1b717a8d4345 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:41.208104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f28297a-ccdd-4d4e-bea4-1b717a8d4345 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:41.208861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f28297a-ccdd-4d4e-bea4-1b717a8d4345 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:41.209300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f28297a-ccdd-4d4e-bea4-1b717a8d4345 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:41.341052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3f28297a-ccdd-4d4e-bea4-1b717a8d4345 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:41.349874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3f28297a-ccdd-4d4e-bea4-1b717a8d4345 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.153235 Aug 01 15:52:41.350459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1275/2222] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:41.837082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:52:41.837333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:52:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:52:42.166605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-14c6b1a6-e314-49aa-8fd2-b2ade6f31ece tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:42.167999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-14c6b1a6-e314-49aa-8fd2-b2ade6f31ece tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:42.175789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-14c6b1a6-e314-49aa-8fd2-b2ade6f31ece tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:42.176243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-14c6b1a6-e314-49aa-8fd2-b2ade6f31ece tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:42.177009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-14c6b1a6-e314-49aa-8fd2-b2ade6f31ece tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:42.177450 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-14c6b1a6-e314-49aa-8fd2-b2ade6f31ece tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:42.238986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-14c6b1a6-e314-49aa-8fd2-b2ade6f31ece tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:42.246727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-14c6b1a6-e314-49aa-8fd2-b2ade6f31ece tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.084009 Aug 01 15:52:42.247286 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 948/2223] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:42 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:42.371342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f60b692a-12e6-45fe-bf0f-d1a48ac94a18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:42.371946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f60b692a-12e6-45fe-bf0f-d1a48ac94a18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:42.379109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f60b692a-12e6-45fe-bf0f-d1a48ac94a18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:42.379549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f60b692a-12e6-45fe-bf0f-d1a48ac94a18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:42.380299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f60b692a-12e6-45fe-bf0f-d1a48ac94a18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:42.380728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f60b692a-12e6-45fe-bf0f-d1a48ac94a18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:42.506575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f60b692a-12e6-45fe-bf0f-d1a48ac94a18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:42.515102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f60b692a-12e6-45fe-bf0f-d1a48ac94a18 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.147570 Aug 01 15:52:42.515663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1276/2224] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:42 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:43.268530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-22e03c39-a391-443c-b645-244ec32d6adc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:43.269622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-22e03c39-a391-443c-b645-244ec32d6adc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:43.276179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22e03c39-a391-443c-b645-244ec32d6adc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:43.276631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22e03c39-a391-443c-b645-244ec32d6adc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:43.277416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22e03c39-a391-443c-b645-244ec32d6adc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:43.277839 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22e03c39-a391-443c-b645-244ec32d6adc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:43.342490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-22e03c39-a391-443c-b645-244ec32d6adc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:43.350270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-22e03c39-a391-443c-b645-244ec32d6adc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.085768 Aug 01 15:52:43.350817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 949/2225] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:43 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:43.537350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a7925fc6-bfe0-4ad3-9132-11e7c1899544 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:43.537921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a7925fc6-bfe0-4ad3-9132-11e7c1899544 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:43.544462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a7925fc6-bfe0-4ad3-9132-11e7c1899544 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:43.544906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a7925fc6-bfe0-4ad3-9132-11e7c1899544 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:43.545664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a7925fc6-bfe0-4ad3-9132-11e7c1899544 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:43.546133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a7925fc6-bfe0-4ad3-9132-11e7c1899544 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:43.678923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a7925fc6-bfe0-4ad3-9132-11e7c1899544 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:43.686956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a7925fc6-bfe0-4ad3-9132-11e7c1899544 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.153548 Aug 01 15:52:43.687534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1277/2226] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:43 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:44.371118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-81021b5d-2b45-4851-ab6a-02781418bbff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:44.371757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-81021b5d-2b45-4851-ab6a-02781418bbff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:44.378843 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81021b5d-2b45-4851-ab6a-02781418bbff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:44.379286 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81021b5d-2b45-4851-ab6a-02781418bbff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:44.380042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81021b5d-2b45-4851-ab6a-02781418bbff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:44.380473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81021b5d-2b45-4851-ab6a-02781418bbff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:44.441193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-81021b5d-2b45-4851-ab6a-02781418bbff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:44.448794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-81021b5d-2b45-4851-ab6a-02781418bbff tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.081573 Aug 01 15:52:44.449349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 950/2227] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:44 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:44.708775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-22156961-ab64-4f2c-94c9-1eb14fa937b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:44.709344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-22156961-ab64-4f2c-94c9-1eb14fa937b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:44.716031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-22156961-ab64-4f2c-94c9-1eb14fa937b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:44.716484 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-22156961-ab64-4f2c-94c9-1eb14fa937b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:44.717251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-22156961-ab64-4f2c-94c9-1eb14fa937b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:44.717687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-22156961-ab64-4f2c-94c9-1eb14fa937b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:44.850682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-22156961-ab64-4f2c-94c9-1eb14fa937b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:44.858756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-22156961-ab64-4f2c-94c9-1eb14fa937b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.153936 Aug 01 15:52:44.859324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1278/2228] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:44 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:45.469248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fff9703a-06eb-41c4-b18a-3c98244f2eb7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:45.469904 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fff9703a-06eb-41c4-b18a-3c98244f2eb7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:45.476604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fff9703a-06eb-41c4-b18a-3c98244f2eb7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:45.477057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fff9703a-06eb-41c4-b18a-3c98244f2eb7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:45.477827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fff9703a-06eb-41c4-b18a-3c98244f2eb7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:45.478297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fff9703a-06eb-41c4-b18a-3c98244f2eb7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:45.539240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fff9703a-06eb-41c4-b18a-3c98244f2eb7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:45.547055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fff9703a-06eb-41c4-b18a-3c98244f2eb7 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.081664 Aug 01 15:52:45.547620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 951/2229] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:45 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:45.881335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-96bd2e96-8d6c-46e1-8847-da6fdfb47a37 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:45.882011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-96bd2e96-8d6c-46e1-8847-da6fdfb47a37 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:45.888508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-96bd2e96-8d6c-46e1-8847-da6fdfb47a37 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:45.888955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-96bd2e96-8d6c-46e1-8847-da6fdfb47a37 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:45.889749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-96bd2e96-8d6c-46e1-8847-da6fdfb47a37 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:45.890206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-96bd2e96-8d6c-46e1-8847-da6fdfb47a37 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:46.019060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-96bd2e96-8d6c-46e1-8847-da6fdfb47a37 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:46.027386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-96bd2e96-8d6c-46e1-8847-da6fdfb47a37 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.150558 Aug 01 15:52:46.027962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1279/2230] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:45 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:46.572592 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b0c8da55-8ac4-461f-9ad8-74675a058d9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:46.573458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b0c8da55-8ac4-461f-9ad8-74675a058d9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:46.583299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0c8da55-8ac4-461f-9ad8-74675a058d9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:46.583746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0c8da55-8ac4-461f-9ad8-74675a058d9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:46.584514 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0c8da55-8ac4-461f-9ad8-74675a058d9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:46.584951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0c8da55-8ac4-461f-9ad8-74675a058d9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:46.649439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b0c8da55-8ac4-461f-9ad8-74675a058d9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:46.657059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b0c8da55-8ac4-461f-9ad8-74675a058d9e tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.089787 Aug 01 15:52:46.657612 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 952/2231] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:46 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:47.048662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2a97620a-8596-490f-b6c6-0da7a4076c55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:47.049381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2a97620a-8596-490f-b6c6-0da7a4076c55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:47.056343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a97620a-8596-490f-b6c6-0da7a4076c55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:47.056795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a97620a-8596-490f-b6c6-0da7a4076c55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:47.057570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a97620a-8596-490f-b6c6-0da7a4076c55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:47.058049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a97620a-8596-490f-b6c6-0da7a4076c55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:47.187686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2a97620a-8596-490f-b6c6-0da7a4076c55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:47.196197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2a97620a-8596-490f-b6c6-0da7a4076c55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.151476 Aug 01 15:52:47.196772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1280/2232] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:47 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:47.679143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b353cff8-d359-4861-97a0-0337414ec032 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:47.679781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b353cff8-d359-4861-97a0-0337414ec032 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:47.686293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b353cff8-d359-4861-97a0-0337414ec032 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:47.686735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b353cff8-d359-4861-97a0-0337414ec032 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:47.687487 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b353cff8-d359-4861-97a0-0337414ec032 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:47.687914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b353cff8-d359-4861-97a0-0337414ec032 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:47.751098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b353cff8-d359-4861-97a0-0337414ec032 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:47.758696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b353cff8-d359-4861-97a0-0337414ec032 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.083978 Aug 01 15:52:47.759264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 953/2233] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:47 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:48.217471 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-36656824-f3a0-4fe3-bacb-3fbe12e86f92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:48.218125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-36656824-f3a0-4fe3-bacb-3fbe12e86f92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:48.225639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-36656824-f3a0-4fe3-bacb-3fbe12e86f92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:48.226140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-36656824-f3a0-4fe3-bacb-3fbe12e86f92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:48.226913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-36656824-f3a0-4fe3-bacb-3fbe12e86f92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:48.227353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-36656824-f3a0-4fe3-bacb-3fbe12e86f92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:48.360845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-36656824-f3a0-4fe3-bacb-3fbe12e86f92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:48.368895 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-36656824-f3a0-4fe3-bacb-3fbe12e86f92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.155265 Aug 01 15:52:48.369480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1281/2234] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:48 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:48.779542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d3e26fc1-c492-4cbc-ba15-0956d19faed4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:48.780178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d3e26fc1-c492-4cbc-ba15-0956d19faed4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:48.786744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d3e26fc1-c492-4cbc-ba15-0956d19faed4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:48.787193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d3e26fc1-c492-4cbc-ba15-0956d19faed4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:48.787956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d3e26fc1-c492-4cbc-ba15-0956d19faed4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:48.788393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d3e26fc1-c492-4cbc-ba15-0956d19faed4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:48.806419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:48.858937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d3e26fc1-c492-4cbc-ba15-0956d19faed4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:48.867087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d3e26fc1-c492-4cbc-ba15-0956d19faed4 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.091360 Aug 01 15:52:48.867689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 954/2235] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:48 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:49.391023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5f1e216d-4d66-4dc1-ba92-d39497d7e9af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:49.391637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5f1e216d-4d66-4dc1-ba92-d39497d7e9af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:49.398512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f1e216d-4d66-4dc1-ba92-d39497d7e9af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:49.398966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f1e216d-4d66-4dc1-ba92-d39497d7e9af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:49.399730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f1e216d-4d66-4dc1-ba92-d39497d7e9af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:49.400170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f1e216d-4d66-4dc1-ba92-d39497d7e9af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:49.532845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5f1e216d-4d66-4dc1-ba92-d39497d7e9af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:49.541103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5f1e216d-4d66-4dc1-ba92-d39497d7e9af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.154053 Aug 01 15:52:49.541673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1282/2236] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:49.888436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ed0159b1-3589-485b-9a6e-ac2a85eb344c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:49.889091 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ed0159b1-3589-485b-9a6e-ac2a85eb344c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:49.895674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed0159b1-3589-485b-9a6e-ac2a85eb344c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:49.896131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed0159b1-3589-485b-9a6e-ac2a85eb344c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:49.896902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed0159b1-3589-485b-9a6e-ac2a85eb344c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:49.897343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed0159b1-3589-485b-9a6e-ac2a85eb344c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:49.962350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ed0159b1-3589-485b-9a6e-ac2a85eb344c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:49.970051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ed0159b1-3589-485b-9a6e-ac2a85eb344c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.085439 Aug 01 15:52:49.970608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 955/2237] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:49 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:50.563405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1f0f56d2-38c8-4e0f-b17a-98ae1176be09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:50.563945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1f0f56d2-38c8-4e0f-b17a-98ae1176be09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:50.571211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f0f56d2-38c8-4e0f-b17a-98ae1176be09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:50.571658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f0f56d2-38c8-4e0f-b17a-98ae1176be09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:50.572417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f0f56d2-38c8-4e0f-b17a-98ae1176be09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:50.572844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f0f56d2-38c8-4e0f-b17a-98ae1176be09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:50.701008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1f0f56d2-38c8-4e0f-b17a-98ae1176be09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:50.709188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1f0f56d2-38c8-4e0f-b17a-98ae1176be09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.149750 Aug 01 15:52:50.709763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1283/2238] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:50 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:50.991489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-189da169-7b47-4542-9641-fb6defb54b12 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:50.992116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-189da169-7b47-4542-9641-fb6defb54b12 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:50.998821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-189da169-7b47-4542-9641-fb6defb54b12 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:50.999265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-189da169-7b47-4542-9641-fb6defb54b12 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:51.000014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-189da169-7b47-4542-9641-fb6defb54b12 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:51.000447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-189da169-7b47-4542-9641-fb6defb54b12 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:51.062976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-189da169-7b47-4542-9641-fb6defb54b12 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:51.071271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-189da169-7b47-4542-9641-fb6defb54b12 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.084280 Aug 01 15:52:51.071905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 956/2239] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:50 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:51.731640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3755c95d-ee6e-4fe7-bb08-421f83ef03b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:51.732251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3755c95d-ee6e-4fe7-bb08-421f83ef03b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:51.739490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3755c95d-ee6e-4fe7-bb08-421f83ef03b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:51.739959 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3755c95d-ee6e-4fe7-bb08-421f83ef03b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:51.740728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3755c95d-ee6e-4fe7-bb08-421f83ef03b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:51.741162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3755c95d-ee6e-4fe7-bb08-421f83ef03b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:51.745390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:51.877612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3755c95d-ee6e-4fe7-bb08-421f83ef03b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:51.888598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3755c95d-ee6e-4fe7-bb08-421f83ef03b0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.160726 Aug 01 15:52:51.889179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1284/2240] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:51 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:52.091784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-eb484c35-4e8b-4610-94d8-5ce28d2e1db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:52.092404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-eb484c35-4e8b-4610-94d8-5ce28d2e1db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:52.099882 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eb484c35-4e8b-4610-94d8-5ce28d2e1db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:52.100339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eb484c35-4e8b-4610-94d8-5ce28d2e1db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:52.101101 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eb484c35-4e8b-4610-94d8-5ce28d2e1db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:52.101544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eb484c35-4e8b-4610-94d8-5ce28d2e1db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:52.163719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-eb484c35-4e8b-4610-94d8-5ce28d2e1db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:52.171430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-eb484c35-4e8b-4610-94d8-5ce28d2e1db2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.083470 Aug 01 15:52:52.171992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 957/2241] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:52 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:52.916794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-005293aa-d96c-4847-b6c7-f7f3bd2ee623 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:52.917401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-005293aa-d96c-4847-b6c7-f7f3bd2ee623 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:52.924013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-005293aa-d96c-4847-b6c7-f7f3bd2ee623 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:52.924465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-005293aa-d96c-4847-b6c7-f7f3bd2ee623 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:52.925258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-005293aa-d96c-4847-b6c7-f7f3bd2ee623 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:52.925784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-005293aa-d96c-4847-b6c7-f7f3bd2ee623 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:53.055891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-005293aa-d96c-4847-b6c7-f7f3bd2ee623 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:53.064080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-005293aa-d96c-4847-b6c7-f7f3bd2ee623 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.156126 Aug 01 15:52:53.064789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1285/2242] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:52 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:53.195550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5d65338d-f3d7-4862-8a60-f75dbe356ef5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:53.196094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5d65338d-f3d7-4862-8a60-f75dbe356ef5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:53.202661 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d65338d-f3d7-4862-8a60-f75dbe356ef5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:53.203107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d65338d-f3d7-4862-8a60-f75dbe356ef5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:53.203868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d65338d-f3d7-4862-8a60-f75dbe356ef5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:53.204302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d65338d-f3d7-4862-8a60-f75dbe356ef5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:53.269515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d65338d-f3d7-4862-8a60-f75dbe356ef5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:53.277724 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5d65338d-f3d7-4862-8a60-f75dbe356ef5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.086158 Aug 01 15:52:53.278325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 958/2243] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:53 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:54.086225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c6a840f3-76fb-43ec-a2aa-cc92b416983b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:54.086841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c6a840f3-76fb-43ec-a2aa-cc92b416983b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:54.093495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c6a840f3-76fb-43ec-a2aa-cc92b416983b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:54.093981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c6a840f3-76fb-43ec-a2aa-cc92b416983b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:54.094744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c6a840f3-76fb-43ec-a2aa-cc92b416983b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:54.095185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c6a840f3-76fb-43ec-a2aa-cc92b416983b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:54.226594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c6a840f3-76fb-43ec-a2aa-cc92b416983b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:54.234681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c6a840f3-76fb-43ec-a2aa-cc92b416983b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.152829 Aug 01 15:52:54.235251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1286/2244] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:54 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:54.299554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9416dc08-6415-4c05-9db3-fd77c027c7bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:54.300182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9416dc08-6415-4c05-9db3-fd77c027c7bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:54.307143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9416dc08-6415-4c05-9db3-fd77c027c7bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:54.309086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9416dc08-6415-4c05-9db3-fd77c027c7bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:54.309086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9416dc08-6415-4c05-9db3-fd77c027c7bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:54.309086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9416dc08-6415-4c05-9db3-fd77c027c7bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:54.372814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9416dc08-6415-4c05-9db3-fd77c027c7bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:54.381006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9416dc08-6415-4c05-9db3-fd77c027c7bc tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.085465 Aug 01 15:52:54.381573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 959/2245] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:54 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:55.256440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4144cff9-aec2-4f6e-9fb4-b0789c70832c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:55.257048 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4144cff9-aec2-4f6e-9fb4-b0789c70832c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:55.263636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4144cff9-aec2-4f6e-9fb4-b0789c70832c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:55.264119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4144cff9-aec2-4f6e-9fb4-b0789c70832c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:55.264776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4144cff9-aec2-4f6e-9fb4-b0789c70832c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:55.265203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4144cff9-aec2-4f6e-9fb4-b0789c70832c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:55.396572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4144cff9-aec2-4f6e-9fb4-b0789c70832c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:55.402086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-aa58248b-e990-43af-9471-f1bedf4aaf28 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:55.402733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-aa58248b-e990-43af-9471-f1bedf4aaf28 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:55.404545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4144cff9-aec2-4f6e-9fb4-b0789c70832c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.151944 Aug 01 15:52:55.405119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1287/2246] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:55 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:55.409344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aa58248b-e990-43af-9471-f1bedf4aaf28 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:55.409793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aa58248b-e990-43af-9471-f1bedf4aaf28 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:55.411106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aa58248b-e990-43af-9471-f1bedf4aaf28 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:55.411596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aa58248b-e990-43af-9471-f1bedf4aaf28 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:55.472144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-aa58248b-e990-43af-9471-f1bedf4aaf28 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:55.480139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-aa58248b-e990-43af-9471-f1bedf4aaf28 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.082014 Aug 01 15:52:55.480691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 960/2247] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:55 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:56.427656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-621d3f5c-b5f6-4e28-89b6-99bf490197e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:56.428268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-621d3f5c-b5f6-4e28-89b6-99bf490197e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:56.435056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-621d3f5c-b5f6-4e28-89b6-99bf490197e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:56.435502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-621d3f5c-b5f6-4e28-89b6-99bf490197e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:56.436267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-621d3f5c-b5f6-4e28-89b6-99bf490197e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:56.436694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-621d3f5c-b5f6-4e28-89b6-99bf490197e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:56.500858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3091b7cd-7864-4f11-b9f8-795347d4ca00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:56.501492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3091b7cd-7864-4f11-b9f8-795347d4ca00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:56.508953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3091b7cd-7864-4f11-b9f8-795347d4ca00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:56.509495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3091b7cd-7864-4f11-b9f8-795347d4ca00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:56.510430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3091b7cd-7864-4f11-b9f8-795347d4ca00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:56.510874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3091b7cd-7864-4f11-b9f8-795347d4ca00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:56.585407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3091b7cd-7864-4f11-b9f8-795347d4ca00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:56.592951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3091b7cd-7864-4f11-b9f8-795347d4ca00 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.096198 Aug 01 15:52:56.593515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 961/2248] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:56 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:56.600170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-621d3f5c-b5f6-4e28-89b6-99bf490197e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:56.608079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-621d3f5c-b5f6-4e28-89b6-99bf490197e7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.184850 Aug 01 15:52:56.608634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1288/2249] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:56 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:57.614356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1826f2b9-0055-4193-9666-5c0fb94d4901 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:57.615730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1826f2b9-0055-4193-9666-5c0fb94d4901 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:57.621638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1826f2b9-0055-4193-9666-5c0fb94d4901 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:57.622121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1826f2b9-0055-4193-9666-5c0fb94d4901 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:57.622892 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1826f2b9-0055-4193-9666-5c0fb94d4901 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:57.623313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1826f2b9-0055-4193-9666-5c0fb94d4901 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:57.629806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f0ec5d5b-86f3-436c-b943-2b122ea7b350 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:57.630462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f0ec5d5b-86f3-436c-b943-2b122ea7b350 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:57.632936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=52 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:52:57.638423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f0ec5d5b-86f3-436c-b943-2b122ea7b350 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:57.638874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f0ec5d5b-86f3-436c-b943-2b122ea7b350 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:57.639647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f0ec5d5b-86f3-436c-b943-2b122ea7b350 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:57.640088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f0ec5d5b-86f3-436c-b943-2b122ea7b350 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:57.697843 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1826f2b9-0055-4193-9666-5c0fb94d4901 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:57.705654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1826f2b9-0055-4193-9666-5c0fb94d4901 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.095762 Aug 01 15:52:57.706452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 962/2250] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:57 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:57.788255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f0ec5d5b-86f3-436c-b943-2b122ea7b350 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:57.796310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f0ec5d5b-86f3-436c-b943-2b122ea7b350 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.170275 Aug 01 15:52:57.796875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1289/2251] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:57 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:52:58.727086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ba39e6f9-bebd-49e7-a109-d486dab50bc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:58.727707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ba39e6f9-bebd-49e7-a109-d486dab50bc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:58.734293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba39e6f9-bebd-49e7-a109-d486dab50bc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:58.734732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba39e6f9-bebd-49e7-a109-d486dab50bc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:58.735483 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba39e6f9-bebd-49e7-a109-d486dab50bc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:58.735915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba39e6f9-bebd-49e7-a109-d486dab50bc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:58.796610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ba39e6f9-bebd-49e7-a109-d486dab50bc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:58.804760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ba39e6f9-bebd-49e7-a109-d486dab50bc8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.081714 Aug 01 15:52:58.805327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 963/2252] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:58 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:58.820823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4f4bec54-b0a9-4a42-ba85-4ceafa63cf5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:58.821454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4f4bec54-b0a9-4a42-ba85-4ceafa63cf5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:58.828870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f4bec54-b0a9-4a42-ba85-4ceafa63cf5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:58.829322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f4bec54-b0a9-4a42-ba85-4ceafa63cf5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:58.830145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f4bec54-b0a9-4a42-ba85-4ceafa63cf5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:58.830643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4f4bec54-b0a9-4a42-ba85-4ceafa63cf5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:58.966261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4f4bec54-b0a9-4a42-ba85-4ceafa63cf5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:58.975087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4f4bec54-b0a9-4a42-ba85-4ceafa63cf5a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.161885 Aug 01 15:52:58.975652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1290/2253] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:58 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:59.827162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0e97426e-9e38-4d04-a894-a60c23c91304 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:52:59.827731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0e97426e-9e38-4d04-a894-a60c23c91304 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:52:59.834239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e97426e-9e38-4d04-a894-a60c23c91304 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:59.834687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e97426e-9e38-4d04-a894-a60c23c91304 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:59.835449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e97426e-9e38-4d04-a894-a60c23c91304 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:52:59.835888 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e97426e-9e38-4d04-a894-a60c23c91304 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:52:59.898628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0e97426e-9e38-4d04-a894-a60c23c91304 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:52:59.906834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0e97426e-9e38-4d04-a894-a60c23c91304 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.083634 Aug 01 15:52:59.907403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 964/2254] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:59 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:52:59.999561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4bb98bd9-f587-4d90-a48e-6f8b3470c179 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:00.000174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4bb98bd9-f587-4d90-a48e-6f8b3470c179 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:00.006850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4bb98bd9-f587-4d90-a48e-6f8b3470c179 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:00.007308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4bb98bd9-f587-4d90-a48e-6f8b3470c179 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:00.008078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4bb98bd9-f587-4d90-a48e-6f8b3470c179 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:00.008519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4bb98bd9-f587-4d90-a48e-6f8b3470c179 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:00.155946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4bb98bd9-f587-4d90-a48e-6f8b3470c179 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:00.164668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4bb98bd9-f587-4d90-a48e-6f8b3470c179 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.169017 Aug 01 15:53:00.165246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1291/2255] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:52:59 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:00.928089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-454864c3-c6c8-48b0-b115-f30ac334b44b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:00.929380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-454864c3-c6c8-48b0-b115-f30ac334b44b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:00.936510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-454864c3-c6c8-48b0-b115-f30ac334b44b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:00.937043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-454864c3-c6c8-48b0-b115-f30ac334b44b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:00.937918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-454864c3-c6c8-48b0-b115-f30ac334b44b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:00.938422 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-454864c3-c6c8-48b0-b115-f30ac334b44b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:01.002198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-454864c3-c6c8-48b0-b115-f30ac334b44b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:01.010767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-454864c3-c6c8-48b0-b115-f30ac334b44b tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.086509 Aug 01 15:53:01.011326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 965/2256] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:00 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:01.079771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-54580d3d-3ea4-442d-bd3b-a663ea7b9e58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:01.080279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-54580d3d-3ea4-442d-bd3b-a663ea7b9e58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:01.087212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54580d3d-3ea4-442d-bd3b-a663ea7b9e58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:01.087774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54580d3d-3ea4-442d-bd3b-a663ea7b9e58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:01.088550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54580d3d-3ea4-442d-bd3b-a663ea7b9e58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:01.088984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54580d3d-3ea4-442d-bd3b-a663ea7b9e58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:01.115440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-54580d3d-3ea4-442d-bd3b-a663ea7b9e58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:53:01.186348 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f3799f04-b7c8-4727-8a5b-ee4bb82876aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:01.186895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f3799f04-b7c8-4727-8a5b-ee4bb82876aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:01.193995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f3799f04-b7c8-4727-8a5b-ee4bb82876aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:01.194438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f3799f04-b7c8-4727-8a5b-ee4bb82876aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:01.195207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f3799f04-b7c8-4727-8a5b-ee4bb82876aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:01.195838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f3799f04-b7c8-4727-8a5b-ee4bb82876aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:01.197294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-54580d3d-3ea4-442d-bd3b-a663ea7b9e58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 204 len: 0 microversion: 2.20 time: 0.121014 Aug 01 15:53:01.198129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1292/2257] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 1 15:53:01 2022] DELETE /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 15:53:01.207222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d796b0f9-96c8-4c0f-9494-8a86eab55b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:01.208547 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d796b0f9-96c8-4c0f-9494-8a86eab55b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:01.214789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d796b0f9-96c8-4c0f-9494-8a86eab55b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:01.215242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d796b0f9-96c8-4c0f-9494-8a86eab55b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:01.216022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d796b0f9-96c8-4c0f-9494-8a86eab55b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:01.216453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d796b0f9-96c8-4c0f-9494-8a86eab55b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:01.428300 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f3799f04-b7c8-4727-8a5b-ee4bb82876aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:01.437217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f3799f04-b7c8-4727-8a5b-ee4bb82876aa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.254870 Aug 01 15:53:01.437801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 966/2258] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:01 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:53:01.443594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d796b0f9-96c8-4c0f-9494-8a86eab55b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:01.452033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d796b0f9-96c8-4c0f-9494-8a86eab55b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:01.453527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d796b0f9-96c8-4c0f-9494-8a86eab55b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:01.454782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d796b0f9-96c8-4c0f-9494-8a86eab55b11 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.252213 Aug 01 15:53:01.455526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1293/2259] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:53:02.034213 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f0ca8956-d519-48ef-9632-aaf818f6cab5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:02.034994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f0ca8956-d519-48ef-9632-aaf818f6cab5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:02.042384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f0ca8956-d519-48ef-9632-aaf818f6cab5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:02.042837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f0ca8956-d519-48ef-9632-aaf818f6cab5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:02.043617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f0ca8956-d519-48ef-9632-aaf818f6cab5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:02.044061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f0ca8956-d519-48ef-9632-aaf818f6cab5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:02.113053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f0ca8956-d519-48ef-9632-aaf818f6cab5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:02.121132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f0ca8956-d519-48ef-9632-aaf818f6cab5 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.092153 Aug 01 15:53:02.121707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 967/2260] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:02 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:02.468526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a8089697-5b42-49ff-aff3-6ae33b2d21ae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:02.469135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a8089697-5b42-49ff-aff3-6ae33b2d21ae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:02.476347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8089697-5b42-49ff-aff3-6ae33b2d21ae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:02.476786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8089697-5b42-49ff-aff3-6ae33b2d21ae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:02.477545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8089697-5b42-49ff-aff3-6ae33b2d21ae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:02.478012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8089697-5b42-49ff-aff3-6ae33b2d21ae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:02.478131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fca28afd-f811-41a0-b896-4a86cb632462 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:02.478756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fca28afd-f811-41a0-b896-4a86cb632462 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:02.484877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fca28afd-f811-41a0-b896-4a86cb632462 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:02.485330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fca28afd-f811-41a0-b896-4a86cb632462 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:02.486226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fca28afd-f811-41a0-b896-4a86cb632462 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:02.486666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fca28afd-f811-41a0-b896-4a86cb632462 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:02.675317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a8089697-5b42-49ff-aff3-6ae33b2d21ae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:02.678953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fca28afd-f811-41a0-b896-4a86cb632462 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:02.684824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a8089697-5b42-49ff-aff3-6ae33b2d21ae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.220079 Aug 01 15:53:02.685595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1294/2261] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:02 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:02.688802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fca28afd-f811-41a0-b896-4a86cb632462 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:02.690808 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fca28afd-f811-41a0-b896-4a86cb632462 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:02.692027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fca28afd-f811-41a0-b896-4a86cb632462 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.218064 Aug 01 15:53:02.692566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 968/2262] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:03.144526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ce5cb751-f059-4921-874e-cc34cccf98dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:03.145612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ce5cb751-f059-4921-874e-cc34cccf98dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:03.151672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce5cb751-f059-4921-874e-cc34cccf98dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:03.152122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce5cb751-f059-4921-874e-cc34cccf98dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:03.152881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce5cb751-f059-4921-874e-cc34cccf98dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:03.153318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce5cb751-f059-4921-874e-cc34cccf98dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:03.216753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ce5cb751-f059-4921-874e-cc34cccf98dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:03.225271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ce5cb751-f059-4921-874e-cc34cccf98dd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.084666 Aug 01 15:53:03.225845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1295/2263] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:03 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:03.706723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ddc18a71-4850-49eb-bb1f-9947cb63e843 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:03.707684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ddc18a71-4850-49eb-bb1f-9947cb63e843 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:03.715571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-42e5044a-d41a-4e56-8a0e-9ce0011efefa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:03.716229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-42e5044a-d41a-4e56-8a0e-9ce0011efefa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:03.723772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddc18a71-4850-49eb-bb1f-9947cb63e843 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:03.724065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42e5044a-d41a-4e56-8a0e-9ce0011efefa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:03.724523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42e5044a-d41a-4e56-8a0e-9ce0011efefa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:03.724633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddc18a71-4850-49eb-bb1f-9947cb63e843 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:03.725307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42e5044a-d41a-4e56-8a0e-9ce0011efefa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:03.725744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-42e5044a-d41a-4e56-8a0e-9ce0011efefa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:03.725873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddc18a71-4850-49eb-bb1f-9947cb63e843 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:03.726268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddc18a71-4850-49eb-bb1f-9947cb63e843 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:03.926184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ddc18a71-4850-49eb-bb1f-9947cb63e843 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:03.930288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-42e5044a-d41a-4e56-8a0e-9ce0011efefa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:03.934279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ddc18a71-4850-49eb-bb1f-9947cb63e843 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.231591 Aug 01 15:53:03.934855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 969/2264] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:03 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:03.939211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-42e5044a-d41a-4e56-8a0e-9ce0011efefa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:03.940705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-42e5044a-d41a-4e56-8a0e-9ce0011efefa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:03.941864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-42e5044a-d41a-4e56-8a0e-9ce0011efefa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.230291 Aug 01 15:53:03.942431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1296/2265] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:53:04.246120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9e9b6bfa-333a-4da5-8969-6af134b67338 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:04.246732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9e9b6bfa-333a-4da5-8969-6af134b67338 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:04.252863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e9b6bfa-333a-4da5-8969-6af134b67338 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:04.253312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e9b6bfa-333a-4da5-8969-6af134b67338 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:04.254123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e9b6bfa-333a-4da5-8969-6af134b67338 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:04.254566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e9b6bfa-333a-4da5-8969-6af134b67338 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:04.318318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9e9b6bfa-333a-4da5-8969-6af134b67338 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:04.326035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9e9b6bfa-333a-4da5-8969-6af134b67338 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.083787 Aug 01 15:53:04.326592 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 970/2266] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:04 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:04.955227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d316d74f-5773-4d8f-a96e-37d03612dfa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:04.955838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d316d74f-5773-4d8f-a96e-37d03612dfa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:04.962513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d316d74f-5773-4d8f-a96e-37d03612dfa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:04.962960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d316d74f-5773-4d8f-a96e-37d03612dfa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:04.963727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d316d74f-5773-4d8f-a96e-37d03612dfa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:04.964161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d316d74f-5773-4d8f-a96e-37d03612dfa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:04.964428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6d4570b9-3f6f-486d-b8d7-8ae0bc336ce1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:04.965043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6d4570b9-3f6f-486d-b8d7-8ae0bc336ce1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:04.972062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d4570b9-3f6f-486d-b8d7-8ae0bc336ce1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:04.972509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d4570b9-3f6f-486d-b8d7-8ae0bc336ce1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:04.973810 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d4570b9-3f6f-486d-b8d7-8ae0bc336ce1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:04.974279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d4570b9-3f6f-486d-b8d7-8ae0bc336ce1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:04.978596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:05.164438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d316d74f-5773-4d8f-a96e-37d03612dfa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:05.167890 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6d4570b9-3f6f-486d-b8d7-8ae0bc336ce1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:05.172563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d316d74f-5773-4d8f-a96e-37d03612dfa5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.221228 Aug 01 15:53:05.173230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1297/2267] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:04 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:05.176599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6d4570b9-3f6f-486d-b8d7-8ae0bc336ce1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:05.178119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6d4570b9-3f6f-486d-b8d7-8ae0bc336ce1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:05.179283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6d4570b9-3f6f-486d-b8d7-8ae0bc336ce1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.218671 Aug 01 15:53:05.179826 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 971/2268] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:04 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:05.346480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ecc93c65-42bb-42ea-9f44-f8bdf9536753 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:05.347263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ecc93c65-42bb-42ea-9f44-f8bdf9536753 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:05.353329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecc93c65-42bb-42ea-9f44-f8bdf9536753 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:05.353770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecc93c65-42bb-42ea-9f44-f8bdf9536753 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:05.354757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecc93c65-42bb-42ea-9f44-f8bdf9536753 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:05.355297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecc93c65-42bb-42ea-9f44-f8bdf9536753 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:05.419532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ecc93c65-42bb-42ea-9f44-f8bdf9536753 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:05.427826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ecc93c65-42bb-42ea-9f44-f8bdf9536753 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.085245 Aug 01 15:53:05.428392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1298/2269] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:05 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:06.195013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d772e982-f7d9-4a19-8a50-7f1d2e2e654e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:06.195633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d772e982-f7d9-4a19-8a50-7f1d2e2e654e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:06.202198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1e9cb894-0d1b-4d9a-b3ba-d5feb86da84c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:06.202736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d772e982-f7d9-4a19-8a50-7f1d2e2e654e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:06.202888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1e9cb894-0d1b-4d9a-b3ba-d5feb86da84c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:06.203194 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d772e982-f7d9-4a19-8a50-7f1d2e2e654e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:06.203966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d772e982-f7d9-4a19-8a50-7f1d2e2e654e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:06.204409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d772e982-f7d9-4a19-8a50-7f1d2e2e654e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:06.209273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e9cb894-0d1b-4d9a-b3ba-d5feb86da84c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:06.209724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e9cb894-0d1b-4d9a-b3ba-d5feb86da84c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:06.210514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e9cb894-0d1b-4d9a-b3ba-d5feb86da84c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:06.210950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e9cb894-0d1b-4d9a-b3ba-d5feb86da84c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:06.215361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:06.401116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d772e982-f7d9-4a19-8a50-7f1d2e2e654e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:06.404406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1e9cb894-0d1b-4d9a-b3ba-d5feb86da84c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:06.409274 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d772e982-f7d9-4a19-8a50-7f1d2e2e654e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.218705 Aug 01 15:53:06.409841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 972/2270] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:06 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:06.413329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1e9cb894-0d1b-4d9a-b3ba-d5feb86da84c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:06.414869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1e9cb894-0d1b-4d9a-b3ba-d5feb86da84c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:06.416037 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1e9cb894-0d1b-4d9a-b3ba-d5feb86da84c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.217804 Aug 01 15:53:06.416588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1299/2271] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:06.448708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7b20bbfd-cbb7-4f94-bd4e-6fd3b245a92f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:06.449319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7b20bbfd-cbb7-4f94-bd4e-6fd3b245a92f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:06.455315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7b20bbfd-cbb7-4f94-bd4e-6fd3b245a92f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:06.455761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7b20bbfd-cbb7-4f94-bd4e-6fd3b245a92f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:06.456517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7b20bbfd-cbb7-4f94-bd4e-6fd3b245a92f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:06.456975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7b20bbfd-cbb7-4f94-bd4e-6fd3b245a92f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:06.517538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7b20bbfd-cbb7-4f94-bd4e-6fd3b245a92f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:06.525411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7b20bbfd-cbb7-4f94-bd4e-6fd3b245a92f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.080564 Aug 01 15:53:06.525990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 973/2272] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:06 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:07.431630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-49b08271-6dde-4b1a-8d15-e5c7dda058e8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:07.432236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-49b08271-6dde-4b1a-8d15-e5c7dda058e8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:07.438890 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49b08271-6dde-4b1a-8d15-e5c7dda058e8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:07.439335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49b08271-6dde-4b1a-8d15-e5c7dda058e8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:07.440108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49b08271-6dde-4b1a-8d15-e5c7dda058e8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:07.440222 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6f7a79c5-0996-487f-9037-aa0906a9597e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:07.440627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49b08271-6dde-4b1a-8d15-e5c7dda058e8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:07.440771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6f7a79c5-0996-487f-9037-aa0906a9597e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:07.449609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f7a79c5-0996-487f-9037-aa0906a9597e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:07.450373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f7a79c5-0996-487f-9037-aa0906a9597e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:07.451262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f7a79c5-0996-487f-9037-aa0906a9597e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:07.451773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f7a79c5-0996-487f-9037-aa0906a9597e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:07.638144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-49b08271-6dde-4b1a-8d15-e5c7dda058e8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:07.644927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6f7a79c5-0996-487f-9037-aa0906a9597e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:07.646159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-49b08271-6dde-4b1a-8d15-e5c7dda058e8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.218340 Aug 01 15:53:07.646751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1300/2273] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:07 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:53:07.651666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-806f2ba4-8558-4878-b23a-627ea4d92a07 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:07.652274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-806f2ba4-8558-4878-b23a-627ea4d92a07 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:07.653971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6f7a79c5-0996-487f-9037-aa0906a9597e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:07.655490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6f7a79c5-0996-487f-9037-aa0906a9597e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:07.657036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6f7a79c5-0996-487f-9037-aa0906a9597e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.220585 Aug 01 15:53:07.662758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 974/2274] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:07 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:07.662927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-806f2ba4-8558-4878-b23a-627ea4d92a07 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:07.662927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-806f2ba4-8558-4878-b23a-627ea4d92a07 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:07.662927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-806f2ba4-8558-4878-b23a-627ea4d92a07 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:07.662927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-806f2ba4-8558-4878-b23a-627ea4d92a07 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:07.727131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-806f2ba4-8558-4878-b23a-627ea4d92a07 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:07.736542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-806f2ba4-8558-4878-b23a-627ea4d92a07 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.088821 Aug 01 15:53:07.737113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1301/2275] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:07 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:08.668147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ed1a3508-a6a5-40a3-a9aa-49348652cf27 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:08.668745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ed1a3508-a6a5-40a3-a9aa-49348652cf27 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:08.675507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed1a3508-a6a5-40a3-a9aa-49348652cf27 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:08.675958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed1a3508-a6a5-40a3-a9aa-49348652cf27 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:08.676729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed1a3508-a6a5-40a3-a9aa-49348652cf27 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:08.677168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed1a3508-a6a5-40a3-a9aa-49348652cf27 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:08.679938 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eacc157e-b40e-4c8a-ab9a-bf95267572a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:08.680577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eacc157e-b40e-4c8a-ab9a-bf95267572a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:08.687016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eacc157e-b40e-4c8a-ab9a-bf95267572a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:08.687466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eacc157e-b40e-4c8a-ab9a-bf95267572a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:08.688227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eacc157e-b40e-4c8a-ab9a-bf95267572a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:08.688659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eacc157e-b40e-4c8a-ab9a-bf95267572a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:08.869347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ed1a3508-a6a5-40a3-a9aa-49348652cf27 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:08.878089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ed1a3508-a6a5-40a3-a9aa-49348652cf27 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.213639 Aug 01 15:53:08.878734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 975/2276] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:08 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:08.880831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eacc157e-b40e-4c8a-ab9a-bf95267572a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:08.884587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-523b9ebb-6ddf-4c98-8fdf-d2c2f2d45fda tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:08.885197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-523b9ebb-6ddf-4c98-8fdf-d2c2f2d45fda tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:08.890195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eacc157e-b40e-4c8a-ab9a-bf95267572a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:08.890991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-523b9ebb-6ddf-4c98-8fdf-d2c2f2d45fda tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:08.891436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-523b9ebb-6ddf-4c98-8fdf-d2c2f2d45fda tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:08.892068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eacc157e-b40e-4c8a-ab9a-bf95267572a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:08.892198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-523b9ebb-6ddf-4c98-8fdf-d2c2f2d45fda tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:08.892613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-523b9ebb-6ddf-4c98-8fdf-d2c2f2d45fda tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:08.893395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eacc157e-b40e-4c8a-ab9a-bf95267572a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.217301 Aug 01 15:53:08.893981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1302/2277] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:08.960613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-523b9ebb-6ddf-4c98-8fdf-d2c2f2d45fda tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:08.968166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-523b9ebb-6ddf-4c98-8fdf-d2c2f2d45fda tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.087534 Aug 01 15:53:08.968735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 976/2278] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:08 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:09.903459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e698365a-f131-43d8-be6f-fb53051fa4f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:09.904075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e698365a-f131-43d8-be6f-fb53051fa4f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:09.911310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e698365a-f131-43d8-be6f-fb53051fa4f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:09.911760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e698365a-f131-43d8-be6f-fb53051fa4f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:09.913253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e698365a-f131-43d8-be6f-fb53051fa4f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:09.913717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e698365a-f131-43d8-be6f-fb53051fa4f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:09.917385 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-91713638-c945-471c-80fc-9dc0038913e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:09.918044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-91713638-c945-471c-80fc-9dc0038913e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:09.924576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91713638-c945-471c-80fc-9dc0038913e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:09.925089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91713638-c945-471c-80fc-9dc0038913e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:09.925866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91713638-c945-471c-80fc-9dc0038913e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:09.926337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-91713638-c945-471c-80fc-9dc0038913e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:10.112791 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e698365a-f131-43d8-be6f-fb53051fa4f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:10.121218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e698365a-f131-43d8-be6f-fb53051fa4f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.221546 Aug 01 15:53:10.122071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1303/2279] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:09 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:10.124360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-91713638-c945-471c-80fc-9dc0038913e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:10.126817 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a3a65bf1-4542-410c-b728-c5be9b66c7e8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:10.127428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a3a65bf1-4542-410c-b728-c5be9b66c7e8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:10.133552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-91713638-c945-471c-80fc-9dc0038913e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:10.134786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a3a65bf1-4542-410c-b728-c5be9b66c7e8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:10.135056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-91713638-c945-471c-80fc-9dc0038913e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:10.135261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a3a65bf1-4542-410c-b728-c5be9b66c7e8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:10.136048 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a3a65bf1-4542-410c-b728-c5be9b66c7e8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:10.136218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-91713638-c945-471c-80fc-9dc0038913e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.222957 Aug 01 15:53:10.136492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a3a65bf1-4542-410c-b728-c5be9b66c7e8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:10.140021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 977/2280] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:10.202819 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a3a65bf1-4542-410c-b728-c5be9b66c7e8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:10.211463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a3a65bf1-4542-410c-b728-c5be9b66c7e8 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.088392 Aug 01 15:53:10.212045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1304/2281] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:10 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:11.142449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7e024fb6-0f65-4dad-a556-23bba8347be0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:11.143011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7e024fb6-0f65-4dad-a556-23bba8347be0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:11.145987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=62 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:11.151176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7e024fb6-0f65-4dad-a556-23bba8347be0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:11.151619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7e024fb6-0f65-4dad-a556-23bba8347be0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:11.152366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7e024fb6-0f65-4dad-a556-23bba8347be0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:11.152801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7e024fb6-0f65-4dad-a556-23bba8347be0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:11.159326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-236d6f93-2266-449a-b0ca-2cc0e502fba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:11.159992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-236d6f93-2266-449a-b0ca-2cc0e502fba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:11.166785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-236d6f93-2266-449a-b0ca-2cc0e502fba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:11.167239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-236d6f93-2266-449a-b0ca-2cc0e502fba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:11.168036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-236d6f93-2266-449a-b0ca-2cc0e502fba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:11.168476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-236d6f93-2266-449a-b0ca-2cc0e502fba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:11.349416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7e024fb6-0f65-4dad-a556-23bba8347be0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:11.357320 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7e024fb6-0f65-4dad-a556-23bba8347be0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.218770 Aug 01 15:53:11.358289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 978/2282] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:11 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:11.360914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-236d6f93-2266-449a-b0ca-2cc0e502fba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:11.362818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ab312829-7bda-4704-93f4-9d3891cda30c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:11.363928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ab312829-7bda-4704-93f4-9d3891cda30c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:11.370025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ab312829-7bda-4704-93f4-9d3891cda30c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:11.370467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ab312829-7bda-4704-93f4-9d3891cda30c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:11.371238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ab312829-7bda-4704-93f4-9d3891cda30c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:11.371668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ab312829-7bda-4704-93f4-9d3891cda30c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:11.373229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-236d6f93-2266-449a-b0ca-2cc0e502fba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:11.374865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-236d6f93-2266-449a-b0ca-2cc0e502fba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:11.376097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-236d6f93-2266-449a-b0ca-2cc0e502fba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.220634 Aug 01 15:53:11.376764 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1305/2283] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:11 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:11.436260 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ab312829-7bda-4704-93f4-9d3891cda30c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:11.444522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ab312829-7bda-4704-93f4-9d3891cda30c tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.085191 Aug 01 15:53:11.445077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 979/2284] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:11 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:12.379630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b2619f22-0519-410f-9a8f-c8693516de9d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:12.380253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b2619f22-0519-410f-9a8f-c8693516de9d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:12.386747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2619f22-0519-410f-9a8f-c8693516de9d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:12.387194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2619f22-0519-410f-9a8f-c8693516de9d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:12.387946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2619f22-0519-410f-9a8f-c8693516de9d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:12.388378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2619f22-0519-410f-9a8f-c8693516de9d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:12.399330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a34fcaf7-e546-4cd4-8a9d-f777e525106b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:12.400095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a34fcaf7-e546-4cd4-8a9d-f777e525106b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:12.407030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a34fcaf7-e546-4cd4-8a9d-f777e525106b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:12.407478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a34fcaf7-e546-4cd4-8a9d-f777e525106b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:12.408239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a34fcaf7-e546-4cd4-8a9d-f777e525106b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:12.408674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a34fcaf7-e546-4cd4-8a9d-f777e525106b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:12.588248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b2619f22-0519-410f-9a8f-c8693516de9d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:12.592129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a34fcaf7-e546-4cd4-8a9d-f777e525106b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:12.599726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b2619f22-0519-410f-9a8f-c8693516de9d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.224535 Aug 01 15:53:12.600602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1306/2285] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:12 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:12.605207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-31809169-1957-4900-95a5-2b47bdabe498 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:12.606066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-31809169-1957-4900-95a5-2b47bdabe498 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:12.613066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31809169-1957-4900-95a5-2b47bdabe498 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:12.614088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31809169-1957-4900-95a5-2b47bdabe498 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:12.614857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31809169-1957-4900-95a5-2b47bdabe498 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:12.615464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31809169-1957-4900-95a5-2b47bdabe498 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:12.616793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a34fcaf7-e546-4cd4-8a9d-f777e525106b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:12.618403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a34fcaf7-e546-4cd4-8a9d-f777e525106b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:12.619620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a34fcaf7-e546-4cd4-8a9d-f777e525106b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.224171 Aug 01 15:53:12.620173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 980/2286] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:12.680578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-31809169-1957-4900-95a5-2b47bdabe498 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:12.688192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-31809169-1957-4900-95a5-2b47bdabe498 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.086766 Aug 01 15:53:12.688757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1307/2287] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:12 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:13.622611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ddc39393-67e4-4fcd-951c-1a7a039ef741 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:13.623226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ddc39393-67e4-4fcd-951c-1a7a039ef741 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:13.629478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddc39393-67e4-4fcd-951c-1a7a039ef741 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:13.629952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddc39393-67e4-4fcd-951c-1a7a039ef741 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:13.631392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddc39393-67e4-4fcd-951c-1a7a039ef741 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:13.631831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddc39393-67e4-4fcd-951c-1a7a039ef741 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:13.642733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c30d18d9-64af-4175-8421-f7c28dfa66a7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:13.643352 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c30d18d9-64af-4175-8421-f7c28dfa66a7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:13.649935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c30d18d9-64af-4175-8421-f7c28dfa66a7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:13.650391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c30d18d9-64af-4175-8421-f7c28dfa66a7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:13.651169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c30d18d9-64af-4175-8421-f7c28dfa66a7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:13.651607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c30d18d9-64af-4175-8421-f7c28dfa66a7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:13.830042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ddc39393-67e4-4fcd-951c-1a7a039ef741 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:13.833329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c30d18d9-64af-4175-8421-f7c28dfa66a7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:13.838848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ddc39393-67e4-4fcd-951c-1a7a039ef741 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.220039 Aug 01 15:53:13.839423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 981/2288] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:13 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:13.841972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c30d18d9-64af-4175-8421-f7c28dfa66a7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:13.843471 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c30d18d9-64af-4175-8421-f7c28dfa66a7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:13.843925 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-00ee0927-4aee-4a17-acda-1b786af5725f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:13.844536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-00ee0927-4aee-4a17-acda-1b786af5725f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:13.844660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c30d18d9-64af-4175-8421-f7c28dfa66a7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.205753 Aug 01 15:53:13.845314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1308/2289] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:53:13.851176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00ee0927-4aee-4a17-acda-1b786af5725f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:13.851630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00ee0927-4aee-4a17-acda-1b786af5725f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:13.852406 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00ee0927-4aee-4a17-acda-1b786af5725f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:13.852845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00ee0927-4aee-4a17-acda-1b786af5725f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:13.917051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-00ee0927-4aee-4a17-acda-1b786af5725f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:13.924893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-00ee0927-4aee-4a17-acda-1b786af5725f tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.084516 Aug 01 15:53:13.925450 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 982/2290] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:13 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:14.860328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-555d5c7c-af74-47a8-89e1-c7cd71ad263c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:14.860938 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-555d5c7c-af74-47a8-89e1-c7cd71ad263c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:14.868669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-555d5c7c-af74-47a8-89e1-c7cd71ad263c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:14.868913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-53f9152e-3d37-48c0-99d4-292399363908 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:14.869621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-53f9152e-3d37-48c0-99d4-292399363908 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:14.869816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-555d5c7c-af74-47a8-89e1-c7cd71ad263c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:14.870727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-555d5c7c-af74-47a8-89e1-c7cd71ad263c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:14.871275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-555d5c7c-af74-47a8-89e1-c7cd71ad263c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:14.875618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-53f9152e-3d37-48c0-99d4-292399363908 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:14.876067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-53f9152e-3d37-48c0-99d4-292399363908 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:14.876833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-53f9152e-3d37-48c0-99d4-292399363908 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:14.877272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-53f9152e-3d37-48c0-99d4-292399363908 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:15.071932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-53f9152e-3d37-48c0-99d4-292399363908 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:15.074738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-555d5c7c-af74-47a8-89e1-c7cd71ad263c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:15.080709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-53f9152e-3d37-48c0-99d4-292399363908 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:15.082364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-53f9152e-3d37-48c0-99d4-292399363908 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:15.082746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-555d5c7c-af74-47a8-89e1-c7cd71ad263c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.226338 Aug 01 15:53:15.083322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1309/2291] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:14 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:15.083542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-53f9152e-3d37-48c0-99d4-292399363908 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.219297 Aug 01 15:53:15.085177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 983/2292] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:15.088260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-050b7f9a-2d3e-4f74-9b29-5079ea0551bd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:15.088874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-050b7f9a-2d3e-4f74-9b29-5079ea0551bd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:15.095019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-050b7f9a-2d3e-4f74-9b29-5079ea0551bd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:15.095476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-050b7f9a-2d3e-4f74-9b29-5079ea0551bd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:15.096249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-050b7f9a-2d3e-4f74-9b29-5079ea0551bd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:15.096684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-050b7f9a-2d3e-4f74-9b29-5079ea0551bd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:15.160530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-050b7f9a-2d3e-4f74-9b29-5079ea0551bd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:15.168792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-050b7f9a-2d3e-4f74-9b29-5079ea0551bd tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.084016 Aug 01 15:53:15.169368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1310/2293] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:15 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:16.106584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-141d04c0-fedf-4599-af8d-643919a75d2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:16.107208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-141d04c0-fedf-4599-af8d-643919a75d2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:16.108111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d0804dca-de9a-4bdd-a75d-420083996690 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:16.108725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d0804dca-de9a-4bdd-a75d-420083996690 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:16.113522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-141d04c0-fedf-4599-af8d-643919a75d2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:16.114003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-141d04c0-fedf-4599-af8d-643919a75d2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:16.114782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-141d04c0-fedf-4599-af8d-643919a75d2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:16.115790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-141d04c0-fedf-4599-af8d-643919a75d2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:16.116077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0804dca-de9a-4bdd-a75d-420083996690 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:16.116530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0804dca-de9a-4bdd-a75d-420083996690 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:16.117298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0804dca-de9a-4bdd-a75d-420083996690 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:16.117743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0804dca-de9a-4bdd-a75d-420083996690 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:16.310265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-141d04c0-fedf-4599-af8d-643919a75d2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:16.311563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d0804dca-de9a-4bdd-a75d-420083996690 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:16.319067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-141d04c0-fedf-4599-af8d-643919a75d2e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.216955 Aug 01 15:53:16.319637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 984/2294] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:16 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:16.320084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d0804dca-de9a-4bdd-a75d-420083996690 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:16.321650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d0804dca-de9a-4bdd-a75d-420083996690 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:16.322801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d0804dca-de9a-4bdd-a75d-420083996690 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.218517 Aug 01 15:53:16.323604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1311/2295] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:16 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:16.324096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8297b0b0-851f-4257-b87c-72741846298a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:16.324839 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8297b0b0-851f-4257-b87c-72741846298a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:16.331012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8297b0b0-851f-4257-b87c-72741846298a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:16.331463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8297b0b0-851f-4257-b87c-72741846298a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:16.332231 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8297b0b0-851f-4257-b87c-72741846298a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:16.332667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8297b0b0-851f-4257-b87c-72741846298a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:16.395293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8297b0b0-851f-4257-b87c-72741846298a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:16.403145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8297b0b0-851f-4257-b87c-72741846298a tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.082557 Aug 01 15:53:16.403701 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 985/2296] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:16 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:17.340758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4c5d198f-7b7e-422b-bdc6-85ef3536398e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:17.341375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4c5d198f-7b7e-422b-bdc6-85ef3536398e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:17.345805 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3ff3bc69-d131-4365-b249-4c77f2ff5944 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:17.346581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3ff3bc69-d131-4365-b249-4c77f2ff5944 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:17.348331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c5d198f-7b7e-422b-bdc6-85ef3536398e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:17.348785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c5d198f-7b7e-422b-bdc6-85ef3536398e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:17.349719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c5d198f-7b7e-422b-bdc6-85ef3536398e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:17.350119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c5d198f-7b7e-422b-bdc6-85ef3536398e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:17.353473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3ff3bc69-d131-4365-b249-4c77f2ff5944 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:17.353938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3ff3bc69-d131-4365-b249-4c77f2ff5944 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:17.354701 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3ff3bc69-d131-4365-b249-4c77f2ff5944 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:17.355131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3ff3bc69-d131-4365-b249-4c77f2ff5944 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:17.550221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4c5d198f-7b7e-422b-bdc6-85ef3536398e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:17.553679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3ff3bc69-d131-4365-b249-4c77f2ff5944 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:17.559169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4c5d198f-7b7e-422b-bdc6-85ef3536398e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.222431 Aug 01 15:53:17.559751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1312/2297] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:17 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:17.562368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3ff3bc69-d131-4365-b249-4c77f2ff5944 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:17.563857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3ff3bc69-d131-4365-b249-4c77f2ff5944 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:17.564158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2a81f1a6-b9d7-4617-9995-8f6fbcd30be6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:17.564770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2a81f1a6-b9d7-4617-9995-8f6fbcd30be6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:17.565018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3ff3bc69-d131-4365-b249-4c77f2ff5944 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.223021 Aug 01 15:53:17.565748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 986/2298] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:17.571686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a81f1a6-b9d7-4617-9995-8f6fbcd30be6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:17.572140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a81f1a6-b9d7-4617-9995-8f6fbcd30be6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:17.573088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a81f1a6-b9d7-4617-9995-8f6fbcd30be6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:17.573529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a81f1a6-b9d7-4617-9995-8f6fbcd30be6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:17.639332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2a81f1a6-b9d7-4617-9995-8f6fbcd30be6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:17.647025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2a81f1a6-b9d7-4617-9995-8f6fbcd30be6 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.086325 Aug 01 15:53:17.647592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1313/2299] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:17 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:18.581575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-540a8dec-c095-46c7-9903-e5e31c05b1fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:18.582246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-540a8dec-c095-46c7-9903-e5e31c05b1fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:18.588790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9b385269-f02d-42a7-b6b9-0e6183ccb784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:18.589436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-540a8dec-c095-46c7-9903-e5e31c05b1fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:18.589549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9b385269-f02d-42a7-b6b9-0e6183ccb784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:18.589907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-540a8dec-c095-46c7-9903-e5e31c05b1fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:18.590698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-540a8dec-c095-46c7-9903-e5e31c05b1fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:18.591143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-540a8dec-c095-46c7-9903-e5e31c05b1fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:18.596131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b385269-f02d-42a7-b6b9-0e6183ccb784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:18.596579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b385269-f02d-42a7-b6b9-0e6183ccb784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:18.597600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b385269-f02d-42a7-b6b9-0e6183ccb784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:18.598060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9b385269-f02d-42a7-b6b9-0e6183ccb784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:18.785628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-540a8dec-c095-46c7-9903-e5e31c05b1fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:18.789195 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:18.792872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9b385269-f02d-42a7-b6b9-0e6183ccb784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:18.794858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-540a8dec-c095-46c7-9903-e5e31c05b1fc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.217142 Aug 01 15:53:18.795666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 987/2300] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:18 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:18.800265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1e64dcd4-b62d-4d8b-a615-7ff902b5a5f2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:18.800877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1e64dcd4-b62d-4d8b-a615-7ff902b5a5f2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:18.805241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9b385269-f02d-42a7-b6b9-0e6183ccb784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:18.806782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9b385269-f02d-42a7-b6b9-0e6183ccb784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:18.807365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e64dcd4-b62d-4d8b-a615-7ff902b5a5f2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:18.807819 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e64dcd4-b62d-4d8b-a615-7ff902b5a5f2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:18.807945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9b385269-f02d-42a7-b6b9-0e6183ccb784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.223045 Aug 01 15:53:18.808500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1314/2301] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:18.811466 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e64dcd4-b62d-4d8b-a615-7ff902b5a5f2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:18.811466 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e64dcd4-b62d-4d8b-a615-7ff902b5a5f2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:18.870604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1e64dcd4-b62d-4d8b-a615-7ff902b5a5f2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:18.877974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1e64dcd4-b62d-4d8b-a615-7ff902b5a5f2 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.081446 Aug 01 15:53:18.878527 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 988/2302] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:18 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:19.816624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-97e98f49-5f43-450c-86ef-6c6514867882 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:19.817235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-97e98f49-5f43-450c-86ef-6c6514867882 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:19.824124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-97e98f49-5f43-450c-86ef-6c6514867882 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:19.824579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-97e98f49-5f43-450c-86ef-6c6514867882 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:19.825372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-97e98f49-5f43-450c-86ef-6c6514867882 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:19.825812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-97e98f49-5f43-450c-86ef-6c6514867882 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:19.831883 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d9945515-a922-45e0-9ea7-b501ffa1a761 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:19.832490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d9945515-a922-45e0-9ea7-b501ffa1a761 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:19.840121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9945515-a922-45e0-9ea7-b501ffa1a761 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:19.840563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9945515-a922-45e0-9ea7-b501ffa1a761 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:19.841326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9945515-a922-45e0-9ea7-b501ffa1a761 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:19.841761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d9945515-a922-45e0-9ea7-b501ffa1a761 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:20.030529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-97e98f49-5f43-450c-86ef-6c6514867882 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:20.034165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:20.039639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-97e98f49-5f43-450c-86ef-6c6514867882 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.226880 Aug 01 15:53:20.040239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1315/2303] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:19 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:20.044792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2b3f27dc-6631-4944-9aa1-8e424dd1c0be tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:20.045585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2b3f27dc-6631-4944-9aa1-8e424dd1c0be tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:20.052774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2b3f27dc-6631-4944-9aa1-8e424dd1c0be tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:20.052774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2b3f27dc-6631-4944-9aa1-8e424dd1c0be tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:20.052774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2b3f27dc-6631-4944-9aa1-8e424dd1c0be tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:20.053094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d9945515-a922-45e0-9ea7-b501ffa1a761 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:20.053222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2b3f27dc-6631-4944-9aa1-8e424dd1c0be tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:20.061632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d9945515-a922-45e0-9ea7-b501ffa1a761 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:20.063161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d9945515-a922-45e0-9ea7-b501ffa1a761 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:20.064337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d9945515-a922-45e0-9ea7-b501ffa1a761 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.236322 Aug 01 15:53:20.067346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 989/2304] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:20.116926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2b3f27dc-6631-4944-9aa1-8e424dd1c0be tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:20.124563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2b3f27dc-6631-4944-9aa1-8e424dd1c0be tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.083369 Aug 01 15:53:20.125244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1316/2305] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:20 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:21.060657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-dc3f7e0c-cb93-4c09-8687-0419cd744d92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:21.061285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-dc3f7e0c-cb93-4c09-8687-0419cd744d92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:21.068272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dc3f7e0c-cb93-4c09-8687-0419cd744d92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:21.068730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dc3f7e0c-cb93-4c09-8687-0419cd744d92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:21.069525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dc3f7e0c-cb93-4c09-8687-0419cd744d92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:21.070000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dc3f7e0c-cb93-4c09-8687-0419cd744d92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:21.087928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a837912b-1ed6-43b5-b6af-cc65aaa6b662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:21.088643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a837912b-1ed6-43b5-b6af-cc65aaa6b662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:21.095517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a837912b-1ed6-43b5-b6af-cc65aaa6b662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:21.095970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a837912b-1ed6-43b5-b6af-cc65aaa6b662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:21.096753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a837912b-1ed6-43b5-b6af-cc65aaa6b662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:21.097444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a837912b-1ed6-43b5-b6af-cc65aaa6b662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:21.267712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dc3f7e0c-cb93-4c09-8687-0419cd744d92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:21.275216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a837912b-1ed6-43b5-b6af-cc65aaa6b662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:21.278717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-dc3f7e0c-cb93-4c09-8687-0419cd744d92 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.221423 Aug 01 15:53:21.289913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 990/2306] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:21 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:21.289913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6067cb07-7135-4666-ada8-f9ab15d65914 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:21.289913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6067cb07-7135-4666-ada8-f9ab15d65914 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] [instance: 58f0755f-45c5-4c98-96b7-9c4b6415d331] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:21.291279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6067cb07-7135-4666-ada8-f9ab15d65914 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:21.291731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6067cb07-7135-4666-ada8-f9ab15d65914 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:21.292498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6067cb07-7135-4666-ada8-f9ab15d65914 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:21.292929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6067cb07-7135-4666-ada8-f9ab15d65914 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:21.294726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a837912b-1ed6-43b5-b6af-cc65aaa6b662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:21.296296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a837912b-1ed6-43b5-b6af-cc65aaa6b662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:21.297596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a837912b-1ed6-43b5-b6af-cc65aaa6b662 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.214071 Aug 01 15:53:21.298345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1317/2307] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:21.376569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6067cb07-7135-4666-ada8-f9ab15d65914 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d903b4429664fceaa1344f1b99791dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63125418cd9949cdbf76099952b31950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:21.385039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6067cb07-7135-4666-ada8-f9ab15d65914 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331" status: 200 len: 1214 microversion: 2.1 time: 0.104600 Aug 01 15:53:21.385844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 991/2308] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:21 2022] GET /compute/v2.1/servers/58f0755f-45c5-4c98-96b7-9c4b6415d331 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:21.568650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-24018a6d-3a86-494a-b7df-ed97bf7ffb53 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] Calling method '.version_select at 0x7feb16131ca0>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:21.588991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-24018a6d-3a86-494a-b7df-ed97bf7ffb53 tempest-TestShelveInstance-1405497668 tempest-TestShelveInstance-1405497668-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1101178689" status: 202 len: 0 microversion: 2.1 time: 0.024670 Aug 01 15:53:21.595675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1318/2309] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 1 15:53:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1101178689 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:53:22.303126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-450f3a1b-3be8-4576-835e-3e11965527f5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:22.303754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-450f3a1b-3be8-4576-835e-3e11965527f5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:22.310458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-450f3a1b-3be8-4576-835e-3e11965527f5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:22.310911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-450f3a1b-3be8-4576-835e-3e11965527f5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:22.312002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-450f3a1b-3be8-4576-835e-3e11965527f5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:22.312448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-450f3a1b-3be8-4576-835e-3e11965527f5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:22.321825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fb638500-0631-4f76-9f82-068b393a716c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:22.323052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fb638500-0631-4f76-9f82-068b393a716c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:22.329361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb638500-0631-4f76-9f82-068b393a716c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:22.329814 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb638500-0631-4f76-9f82-068b393a716c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:22.330624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb638500-0631-4f76-9f82-068b393a716c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:22.331089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb638500-0631-4f76-9f82-068b393a716c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:22.608509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fb638500-0631-4f76-9f82-068b393a716c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:22.611297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-450f3a1b-3be8-4576-835e-3e11965527f5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:22.618201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fb638500-0631-4f76-9f82-068b393a716c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:22.619834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fb638500-0631-4f76-9f82-068b393a716c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:22.619997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-450f3a1b-3be8-4576-835e-3e11965527f5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.321332 Aug 01 15:53:22.620614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 992/2310] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:22 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:22.621012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fb638500-0631-4f76-9f82-068b393a716c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.303799 Aug 01 15:53:22.621569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1319/2311] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:22 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:23.641783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-09873d58-885e-4a2e-8df5-ba912389b390 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:23.642432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-09873d58-885e-4a2e-8df5-ba912389b390 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:23.644149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-41091466-8330-46a3-a9bc-e20ad439b0c8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:23.645309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-41091466-8330-46a3-a9bc-e20ad439b0c8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:23.649394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09873d58-885e-4a2e-8df5-ba912389b390 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:23.649749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09873d58-885e-4a2e-8df5-ba912389b390 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:23.651308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09873d58-885e-4a2e-8df5-ba912389b390 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:23.651893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09873d58-885e-4a2e-8df5-ba912389b390 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:23.653073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41091466-8330-46a3-a9bc-e20ad439b0c8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:23.653564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41091466-8330-46a3-a9bc-e20ad439b0c8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:23.654553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41091466-8330-46a3-a9bc-e20ad439b0c8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:23.654995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41091466-8330-46a3-a9bc-e20ad439b0c8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:23.880726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-41091466-8330-46a3-a9bc-e20ad439b0c8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:23.883973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-09873d58-885e-4a2e-8df5-ba912389b390 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:23.894218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-09873d58-885e-4a2e-8df5-ba912389b390 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.256321 Aug 01 15:53:23.895468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 993/2312] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:23 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:23.899311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-41091466-8330-46a3-a9bc-e20ad439b0c8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:23.901611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-41091466-8330-46a3-a9bc-e20ad439b0c8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:23.903175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-41091466-8330-46a3-a9bc-e20ad439b0c8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.263094 Aug 01 15:53:23.904331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1320/2313] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:24.916690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-162eb05d-9751-4790-94c7-2fc0772cb965 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:24.917919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-162eb05d-9751-4790-94c7-2fc0772cb965 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:24.924930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-162eb05d-9751-4790-94c7-2fc0772cb965 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:24.925570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-162eb05d-9751-4790-94c7-2fc0772cb965 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:24.927914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-162eb05d-9751-4790-94c7-2fc0772cb965 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:24.928702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-162eb05d-9751-4790-94c7-2fc0772cb965 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:24.928948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-49b0295f-f2aa-44f6-8ccd-e3cc3570138c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:24.929679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-49b0295f-f2aa-44f6-8ccd-e3cc3570138c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:24.942340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49b0295f-f2aa-44f6-8ccd-e3cc3570138c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:24.943064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49b0295f-f2aa-44f6-8ccd-e3cc3570138c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:24.944380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49b0295f-f2aa-44f6-8ccd-e3cc3570138c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:24.944891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-49b0295f-f2aa-44f6-8ccd-e3cc3570138c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:25.190965 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-162eb05d-9751-4790-94c7-2fc0772cb965 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:25.195809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-49b0295f-f2aa-44f6-8ccd-e3cc3570138c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:25.205695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-162eb05d-9751-4790-94c7-2fc0772cb965 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.291864 Aug 01 15:53:25.206053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-49b0295f-f2aa-44f6-8ccd-e3cc3570138c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:25.207985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-49b0295f-f2aa-44f6-8ccd-e3cc3570138c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:25.209702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-49b0295f-f2aa-44f6-8ccd-e3cc3570138c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.286760 Aug 01 15:53:25.221264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 994/2314] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:24 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:25.229986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1321/2315] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:26.232206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0da3e2e0-3b43-4986-b196-177148564276 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:26.232206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0da3e2e0-3b43-4986-b196-177148564276 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:26.237659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0da3e2e0-3b43-4986-b196-177148564276 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:26.238144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0da3e2e0-3b43-4986-b196-177148564276 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:26.238506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c8206c58-7385-4643-b9b7-668218d8cbc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:26.238970 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0da3e2e0-3b43-4986-b196-177148564276 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:26.239120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c8206c58-7385-4643-b9b7-668218d8cbc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:26.239339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0da3e2e0-3b43-4986-b196-177148564276 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:26.246092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c8206c58-7385-4643-b9b7-668218d8cbc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:26.246598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c8206c58-7385-4643-b9b7-668218d8cbc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:26.247659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c8206c58-7385-4643-b9b7-668218d8cbc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:26.248292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c8206c58-7385-4643-b9b7-668218d8cbc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:26.530850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0da3e2e0-3b43-4986-b196-177148564276 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:26.541655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0da3e2e0-3b43-4986-b196-177148564276 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.315080 Aug 01 15:53:26.553922 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 995/2316] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:26 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:26.581681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c8206c58-7385-4643-b9b7-668218d8cbc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:26.591639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c8206c58-7385-4643-b9b7-668218d8cbc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:26.593351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c8206c58-7385-4643-b9b7-668218d8cbc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:26.594689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c8206c58-7385-4643-b9b7-668218d8cbc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.360020 Aug 01 15:53:26.595282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1322/2317] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:27.564848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a56faeeb-3690-4506-839d-a8b9eb1249c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:27.565508 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a56faeeb-3690-4506-839d-a8b9eb1249c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:27.572585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a56faeeb-3690-4506-839d-a8b9eb1249c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:27.573047 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a56faeeb-3690-4506-839d-a8b9eb1249c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:27.574217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a56faeeb-3690-4506-839d-a8b9eb1249c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:27.574654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a56faeeb-3690-4506-839d-a8b9eb1249c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:27.618552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4572e32c-cffa-4da1-a8c5-68169e7b9994 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:27.619893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4572e32c-cffa-4da1-a8c5-68169e7b9994 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:27.627609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4572e32c-cffa-4da1-a8c5-68169e7b9994 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:27.628061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4572e32c-cffa-4da1-a8c5-68169e7b9994 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:27.628835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4572e32c-cffa-4da1-a8c5-68169e7b9994 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:27.631427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4572e32c-cffa-4da1-a8c5-68169e7b9994 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:27.860977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a56faeeb-3690-4506-839d-a8b9eb1249c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:27.870768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a56faeeb-3690-4506-839d-a8b9eb1249c0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.310205 Aug 01 15:53:27.871419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 996/2318] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:27 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:27.890234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4572e32c-cffa-4da1-a8c5-68169e7b9994 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:27.899591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4572e32c-cffa-4da1-a8c5-68169e7b9994 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:27.901195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4572e32c-cffa-4da1-a8c5-68169e7b9994 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:27.902493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4572e32c-cffa-4da1-a8c5-68169e7b9994 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.288407 Aug 01 15:53:27.903074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1323/2319] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:28.892702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b77b5f32-38e3-4579-aa61-8d64b32c5756 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:28.893327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b77b5f32-38e3-4579-aa61-8d64b32c5756 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:28.900894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b77b5f32-38e3-4579-aa61-8d64b32c5756 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:28.901077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b77b5f32-38e3-4579-aa61-8d64b32c5756 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:28.901875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b77b5f32-38e3-4579-aa61-8d64b32c5756 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:28.902344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b77b5f32-38e3-4579-aa61-8d64b32c5756 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:28.941470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-57ed730b-6115-4200-b868-970d069f953d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:28.946695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-57ed730b-6115-4200-b868-970d069f953d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:28.949153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:28.956246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-57ed730b-6115-4200-b868-970d069f953d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:28.956704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-57ed730b-6115-4200-b868-970d069f953d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:28.957483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-57ed730b-6115-4200-b868-970d069f953d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:28.958042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-57ed730b-6115-4200-b868-970d069f953d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:29.181144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b77b5f32-38e3-4579-aa61-8d64b32c5756 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:29.189459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b77b5f32-38e3-4579-aa61-8d64b32c5756 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.300655 Aug 01 15:53:29.190313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 997/2320] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:28 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:29.195284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-57ed730b-6115-4200-b868-970d069f953d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:29.210085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-57ed730b-6115-4200-b868-970d069f953d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:29.211631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-57ed730b-6115-4200-b868-970d069f953d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:29.212806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-57ed730b-6115-4200-b868-970d069f953d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.287793 Aug 01 15:53:29.213371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1324/2321] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:30.212236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-504b65c6-b3d5-4208-8b74-a4fa571d3197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:30.212828 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-504b65c6-b3d5-4208-8b74-a4fa571d3197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:30.219610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-504b65c6-b3d5-4208-8b74-a4fa571d3197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:30.220062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-504b65c6-b3d5-4208-8b74-a4fa571d3197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:30.220872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-504b65c6-b3d5-4208-8b74-a4fa571d3197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:30.221316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-504b65c6-b3d5-4208-8b74-a4fa571d3197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:30.237044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6f6928af-68f4-452d-b34a-77d620f5b7d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:30.237583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6f6928af-68f4-452d-b34a-77d620f5b7d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:30.245052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6f6928af-68f4-452d-b34a-77d620f5b7d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:30.245410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6f6928af-68f4-452d-b34a-77d620f5b7d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:30.246471 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6f6928af-68f4-452d-b34a-77d620f5b7d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:30.246965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6f6928af-68f4-452d-b34a-77d620f5b7d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:30.434752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-504b65c6-b3d5-4208-8b74-a4fa571d3197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:30.437406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6f6928af-68f4-452d-b34a-77d620f5b7d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:30.443308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-504b65c6-b3d5-4208-8b74-a4fa571d3197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.235154 Aug 01 15:53:30.445497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 998/2322] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:30.446800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6f6928af-68f4-452d-b34a-77d620f5b7d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:30.448301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6f6928af-68f4-452d-b34a-77d620f5b7d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:30.449493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6f6928af-68f4-452d-b34a-77d620f5b7d1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.216537 Aug 01 15:53:30.450098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1325/2323] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:31.465642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-058c8e0d-2c82-4add-bc0e-1a6493e1e452 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:31.466351 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-058c8e0d-2c82-4add-bc0e-1a6493e1e452 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:31.472804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9ac039cd-68d7-4df2-b2b0-a5f9d2d2b562 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:31.473417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9ac039cd-68d7-4df2-b2b0-a5f9d2d2b562 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:31.473548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-058c8e0d-2c82-4add-bc0e-1a6493e1e452 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:31.474033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-058c8e0d-2c82-4add-bc0e-1a6493e1e452 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:31.474817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-058c8e0d-2c82-4add-bc0e-1a6493e1e452 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:31.475254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-058c8e0d-2c82-4add-bc0e-1a6493e1e452 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:31.479693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ac039cd-68d7-4df2-b2b0-a5f9d2d2b562 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:31.480326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ac039cd-68d7-4df2-b2b0-a5f9d2d2b562 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:31.480909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ac039cd-68d7-4df2-b2b0-a5f9d2d2b562 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:31.481347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9ac039cd-68d7-4df2-b2b0-a5f9d2d2b562 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:31.671796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-058c8e0d-2c82-4add-bc0e-1a6493e1e452 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:31.675821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9ac039cd-68d7-4df2-b2b0-a5f9d2d2b562 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:31.680676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-058c8e0d-2c82-4add-bc0e-1a6493e1e452 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.218761 Aug 01 15:53:31.681191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 999/2324] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:31 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:31.684990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9ac039cd-68d7-4df2-b2b0-a5f9d2d2b562 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:31.686503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9ac039cd-68d7-4df2-b2b0-a5f9d2d2b562 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:31.687659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9ac039cd-68d7-4df2-b2b0-a5f9d2d2b562 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.219159 Aug 01 15:53:31.688215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1326/2325] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:32.703683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-04306b90-b6bc-461e-b28a-bd675d87b12b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:32.704295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-04306b90-b6bc-461e-b28a-bd675d87b12b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:32.711710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04306b90-b6bc-461e-b28a-bd675d87b12b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:32.711889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-566b4b50-4722-48c4-903c-0fcd511a84a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:32.712293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04306b90-b6bc-461e-b28a-bd675d87b12b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:32.712409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-566b4b50-4722-48c4-903c-0fcd511a84a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:32.712899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04306b90-b6bc-461e-b28a-bd675d87b12b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:32.713328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04306b90-b6bc-461e-b28a-bd675d87b12b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:32.718936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-566b4b50-4722-48c4-903c-0fcd511a84a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:32.719391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-566b4b50-4722-48c4-903c-0fcd511a84a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:32.720169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-566b4b50-4722-48c4-903c-0fcd511a84a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:32.720613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-566b4b50-4722-48c4-903c-0fcd511a84a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:32.904785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-04306b90-b6bc-461e-b28a-bd675d87b12b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:32.909685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-566b4b50-4722-48c4-903c-0fcd511a84a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:32.913245 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-04306b90-b6bc-461e-b28a-bd675d87b12b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.213475 Aug 01 15:53:32.913940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1000/2326] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:32 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:53:32.918532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-566b4b50-4722-48c4-903c-0fcd511a84a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:32.920031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-566b4b50-4722-48c4-903c-0fcd511a84a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:32.921194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-566b4b50-4722-48c4-903c-0fcd511a84a8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.214132 Aug 01 15:53:32.921739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1327/2327] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:33.937442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-af2e55bc-5a85-4cc3-8780-5b552d643742 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:33.938080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-af2e55bc-5a85-4cc3-8780-5b552d643742 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:33.944856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af2e55bc-5a85-4cc3-8780-5b552d643742 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:33.945308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af2e55bc-5a85-4cc3-8780-5b552d643742 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:33.946113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af2e55bc-5a85-4cc3-8780-5b552d643742 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:33.946547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af2e55bc-5a85-4cc3-8780-5b552d643742 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:33.948989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3f755213-2fe3-40b7-86d6-dbc4bba8f784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:33.949605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3f755213-2fe3-40b7-86d6-dbc4bba8f784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:33.956097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f755213-2fe3-40b7-86d6-dbc4bba8f784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:33.956575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f755213-2fe3-40b7-86d6-dbc4bba8f784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:33.957343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f755213-2fe3-40b7-86d6-dbc4bba8f784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:33.957777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f755213-2fe3-40b7-86d6-dbc4bba8f784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:34.154794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-af2e55bc-5a85-4cc3-8780-5b552d643742 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:34.161653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3f755213-2fe3-40b7-86d6-dbc4bba8f784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:34.162953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-af2e55bc-5a85-4cc3-8780-5b552d643742 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.229529 Aug 01 15:53:34.163870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1001/2328] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:33 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:34.171648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3f755213-2fe3-40b7-86d6-dbc4bba8f784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:34.173291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3f755213-2fe3-40b7-86d6-dbc4bba8f784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:34.174351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3f755213-2fe3-40b7-86d6-dbc4bba8f784 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.229308 Aug 01 15:53:34.174907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1328/2329] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:53:35.185064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cceaaa1b-b411-46cc-a298-f2617bc4a5e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:35.185859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cceaaa1b-b411-46cc-a298-f2617bc4a5e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:35.193315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cceaaa1b-b411-46cc-a298-f2617bc4a5e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:35.193767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cceaaa1b-b411-46cc-a298-f2617bc4a5e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:35.194570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cceaaa1b-b411-46cc-a298-f2617bc4a5e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:35.195014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cceaaa1b-b411-46cc-a298-f2617bc4a5e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:35.201693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3aed6799-4216-4450-8561-56ce058bdccd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:35.202332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3aed6799-4216-4450-8561-56ce058bdccd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:35.209539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3aed6799-4216-4450-8561-56ce058bdccd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:35.210011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3aed6799-4216-4450-8561-56ce058bdccd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:35.210781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3aed6799-4216-4450-8561-56ce058bdccd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:35.211220 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3aed6799-4216-4450-8561-56ce058bdccd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:35.392723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cceaaa1b-b411-46cc-a298-f2617bc4a5e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:35.399686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3aed6799-4216-4450-8561-56ce058bdccd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:35.400813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cceaaa1b-b411-46cc-a298-f2617bc4a5e2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.219677 Aug 01 15:53:35.401393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1002/2330] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:35 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:35.408453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3aed6799-4216-4450-8561-56ce058bdccd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:35.410288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3aed6799-4216-4450-8561-56ce058bdccd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:35.412014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3aed6799-4216-4450-8561-56ce058bdccd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.214176 Aug 01 15:53:35.412874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1329/2331] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:36.423004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-288a8ff7-271b-46ff-a883-a0814c4fe067 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:36.423610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-288a8ff7-271b-46ff-a883-a0814c4fe067 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:36.430580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-288a8ff7-271b-46ff-a883-a0814c4fe067 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:36.430924 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-288a8ff7-271b-46ff-a883-a0814c4fe067 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:36.431698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-288a8ff7-271b-46ff-a883-a0814c4fe067 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:36.432132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-288a8ff7-271b-46ff-a883-a0814c4fe067 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:36.438392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4ce660f9-0fe2-4f83-9c25-e885d03e2c91 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:36.438896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4ce660f9-0fe2-4f83-9c25-e885d03e2c91 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:36.446381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ce660f9-0fe2-4f83-9c25-e885d03e2c91 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:36.446842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ce660f9-0fe2-4f83-9c25-e885d03e2c91 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:36.447627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ce660f9-0fe2-4f83-9c25-e885d03e2c91 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:36.448068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4ce660f9-0fe2-4f83-9c25-e885d03e2c91 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:36.627999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-288a8ff7-271b-46ff-a883-a0814c4fe067 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:36.636868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-288a8ff7-271b-46ff-a883-a0814c4fe067 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.217807 Aug 01 15:53:36.637549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1003/2332] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:36 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:36.642719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4ce660f9-0fe2-4f83-9c25-e885d03e2c91 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:36.652040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4ce660f9-0fe2-4f83-9c25-e885d03e2c91 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:36.653549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4ce660f9-0fe2-4f83-9c25-e885d03e2c91 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:36.654751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4ce660f9-0fe2-4f83-9c25-e885d03e2c91 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.222783 Aug 01 15:53:36.655322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1330/2333] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:53:37.659295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-439b4d2d-9068-438d-beb9-e849a7a0dc3e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:37.659904 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-439b4d2d-9068-438d-beb9-e849a7a0dc3e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:37.667271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-439b4d2d-9068-438d-beb9-e849a7a0dc3e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:37.667712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-439b4d2d-9068-438d-beb9-e849a7a0dc3e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:37.668483 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-439b4d2d-9068-438d-beb9-e849a7a0dc3e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:37.668912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-439b4d2d-9068-438d-beb9-e849a7a0dc3e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:37.677353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-08215762-c9e7-4e42-9dc1-429c28c23af4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:37.678139 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-08215762-c9e7-4e42-9dc1-429c28c23af4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:37.684996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08215762-c9e7-4e42-9dc1-429c28c23af4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:37.685570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08215762-c9e7-4e42-9dc1-429c28c23af4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:37.686380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08215762-c9e7-4e42-9dc1-429c28c23af4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:37.686815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08215762-c9e7-4e42-9dc1-429c28c23af4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:37.687567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:37.873302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-439b4d2d-9068-438d-beb9-e849a7a0dc3e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:37.881356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-08215762-c9e7-4e42-9dc1-429c28c23af4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:37.882484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-439b4d2d-9068-438d-beb9-e849a7a0dc3e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.226893 Aug 01 15:53:37.882963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1004/2334] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:37 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:37.890783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-08215762-c9e7-4e42-9dc1-429c28c23af4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:37.892292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-08215762-c9e7-4e42-9dc1-429c28c23af4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:37.893460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-08215762-c9e7-4e42-9dc1-429c28c23af4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.220459 Aug 01 15:53:37.894055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1331/2335] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:38.906633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5d122096-0deb-452f-a5b9-b9639a10cd36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:38.907288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5d122096-0deb-452f-a5b9-b9639a10cd36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:38.913996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d122096-0deb-452f-a5b9-b9639a10cd36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:38.914451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d122096-0deb-452f-a5b9-b9639a10cd36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:38.915227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d122096-0deb-452f-a5b9-b9639a10cd36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:38.915664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d122096-0deb-452f-a5b9-b9639a10cd36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:38.924932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bf1a12aa-d827-46b9-a15a-894179e76f08 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:38.925584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bf1a12aa-d827-46b9-a15a-894179e76f08 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:38.932281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf1a12aa-d827-46b9-a15a-894179e76f08 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:38.932732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf1a12aa-d827-46b9-a15a-894179e76f08 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:38.933509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf1a12aa-d827-46b9-a15a-894179e76f08 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:38.933984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf1a12aa-d827-46b9-a15a-894179e76f08 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:39.103560 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d122096-0deb-452f-a5b9-b9639a10cd36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:39.112675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5d122096-0deb-452f-a5b9-b9639a10cd36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.209907 Aug 01 15:53:39.113252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1005/2336] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:38 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:39.126491 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bf1a12aa-d827-46b9-a15a-894179e76f08 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:39.135552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bf1a12aa-d827-46b9-a15a-894179e76f08 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:39.137063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bf1a12aa-d827-46b9-a15a-894179e76f08 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:39.138333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bf1a12aa-d827-46b9-a15a-894179e76f08 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.217212 Aug 01 15:53:39.138827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1332/2337] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:40.134819 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-94ec8b30-88cc-4cbe-af24-bcdc3115d9f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:40.135436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-94ec8b30-88cc-4cbe-af24-bcdc3115d9f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:40.141880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94ec8b30-88cc-4cbe-af24-bcdc3115d9f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:40.142358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94ec8b30-88cc-4cbe-af24-bcdc3115d9f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:40.143154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94ec8b30-88cc-4cbe-af24-bcdc3115d9f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:40.143593 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94ec8b30-88cc-4cbe-af24-bcdc3115d9f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:40.160724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c535bd88-6a7f-4495-aac5-278fb18d9d85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:40.161345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c535bd88-6a7f-4495-aac5-278fb18d9d85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:40.167957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c535bd88-6a7f-4495-aac5-278fb18d9d85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:40.168405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c535bd88-6a7f-4495-aac5-278fb18d9d85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:40.169182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c535bd88-6a7f-4495-aac5-278fb18d9d85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:40.169621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c535bd88-6a7f-4495-aac5-278fb18d9d85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:40.188176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:40.330091 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-94ec8b30-88cc-4cbe-af24-bcdc3115d9f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:40.338583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-94ec8b30-88cc-4cbe-af24-bcdc3115d9f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.208213 Aug 01 15:53:40.339147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1006/2338] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:40 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:40.352145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c535bd88-6a7f-4495-aac5-278fb18d9d85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:40.360682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c535bd88-6a7f-4495-aac5-278fb18d9d85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:40.362294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c535bd88-6a7f-4495-aac5-278fb18d9d85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:40.363462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c535bd88-6a7f-4495-aac5-278fb18d9d85 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.206637 Aug 01 15:53:40.364022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1333/2339] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:41.361783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-59c35bda-83b0-449a-9d87-f2c18b5d48f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:41.362357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-59c35bda-83b0-449a-9d87-f2c18b5d48f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:41.364668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=58 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:41.369913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-59c35bda-83b0-449a-9d87-f2c18b5d48f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:41.370370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-59c35bda-83b0-449a-9d87-f2c18b5d48f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:41.371135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-59c35bda-83b0-449a-9d87-f2c18b5d48f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:41.371572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-59c35bda-83b0-449a-9d87-f2c18b5d48f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:41.386306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7aa9ac6b-5cbe-4ff3-84b5-09c8cc564cc4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:41.386930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7aa9ac6b-5cbe-4ff3-84b5-09c8cc564cc4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:41.393575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aa9ac6b-5cbe-4ff3-84b5-09c8cc564cc4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:41.394077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aa9ac6b-5cbe-4ff3-84b5-09c8cc564cc4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:41.394858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aa9ac6b-5cbe-4ff3-84b5-09c8cc564cc4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:41.395300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7aa9ac6b-5cbe-4ff3-84b5-09c8cc564cc4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:41.584628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-59c35bda-83b0-449a-9d87-f2c18b5d48f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:41.588837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7aa9ac6b-5cbe-4ff3-84b5-09c8cc564cc4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:41.593322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-59c35bda-83b0-449a-9d87-f2c18b5d48f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.235518 Aug 01 15:53:41.594003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1007/2340] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:41.600918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7aa9ac6b-5cbe-4ff3-84b5-09c8cc564cc4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:41.602621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7aa9ac6b-5cbe-4ff3-84b5-09c8cc564cc4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:41.603801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7aa9ac6b-5cbe-4ff3-84b5-09c8cc564cc4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.221430 Aug 01 15:53:41.604363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1334/2341] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:42.617363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e35ce887-9d31-4229-9166-5749ad068d0d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:42.618007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e35ce887-9d31-4229-9166-5749ad068d0d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:42.625441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e35ce887-9d31-4229-9166-5749ad068d0d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:42.625441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e35ce887-9d31-4229-9166-5749ad068d0d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:42.625915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e35ce887-9d31-4229-9166-5749ad068d0d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:42.626357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e35ce887-9d31-4229-9166-5749ad068d0d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:42.627845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4dcf23b9-9185-4fe0-9c96-9ac9c45e5276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:42.628555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4dcf23b9-9185-4fe0-9c96-9ac9c45e5276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:42.635082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4dcf23b9-9185-4fe0-9c96-9ac9c45e5276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:42.635531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4dcf23b9-9185-4fe0-9c96-9ac9c45e5276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:42.636299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4dcf23b9-9185-4fe0-9c96-9ac9c45e5276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:42.636736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4dcf23b9-9185-4fe0-9c96-9ac9c45e5276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:42.824227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e35ce887-9d31-4229-9166-5749ad068d0d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:42.827594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4dcf23b9-9185-4fe0-9c96-9ac9c45e5276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:42.834533 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e35ce887-9d31-4229-9166-5749ad068d0d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.221545 Aug 01 15:53:42.835157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1008/2342] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:42 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:53:42.836744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4dcf23b9-9185-4fe0-9c96-9ac9c45e5276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:42.838285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4dcf23b9-9185-4fe0-9c96-9ac9c45e5276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:42.839463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4dcf23b9-9185-4fe0-9c96-9ac9c45e5276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.215544 Aug 01 15:53:42.840020 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1335/2343] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:42 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:43.859970 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9b95ef73-0473-419b-8351-1608d88efcf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:43.860617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9b95ef73-0473-419b-8351-1608d88efcf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:43.863178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-341ae9e4-71ac-4715-86f6-684e7aba1f06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:43.863800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-341ae9e4-71ac-4715-86f6-684e7aba1f06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:43.867906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b95ef73-0473-419b-8351-1608d88efcf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:43.868363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b95ef73-0473-419b-8351-1608d88efcf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:43.869131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b95ef73-0473-419b-8351-1608d88efcf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:43.869572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b95ef73-0473-419b-8351-1608d88efcf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:43.870969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-341ae9e4-71ac-4715-86f6-684e7aba1f06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:43.871424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-341ae9e4-71ac-4715-86f6-684e7aba1f06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:43.872190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-341ae9e4-71ac-4715-86f6-684e7aba1f06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:43.872645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-341ae9e4-71ac-4715-86f6-684e7aba1f06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:44.083613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-341ae9e4-71ac-4715-86f6-684e7aba1f06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:44.085986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9b95ef73-0473-419b-8351-1608d88efcf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:44.092561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-341ae9e4-71ac-4715-86f6-684e7aba1f06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:44.094077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-341ae9e4-71ac-4715-86f6-684e7aba1f06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:44.094245 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9b95ef73-0473-419b-8351-1608d88efcf0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.238090 Aug 01 15:53:44.094942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1009/2344] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:43 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:44.095225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-341ae9e4-71ac-4715-86f6-684e7aba1f06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.236061 Aug 01 15:53:44.095765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1336/2345] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:45.117159 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e733226b-549f-48dd-8630-354c8c218210 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:45.117781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e733226b-549f-48dd-8630-354c8c218210 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:45.119013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-099976de-9de7-49fc-88b6-3dc96c877c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:45.119631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-099976de-9de7-49fc-88b6-3dc96c877c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:45.124372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e733226b-549f-48dd-8630-354c8c218210 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:45.124821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e733226b-549f-48dd-8630-354c8c218210 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:45.125598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e733226b-549f-48dd-8630-354c8c218210 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:45.126069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e733226b-549f-48dd-8630-354c8c218210 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:45.126241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-099976de-9de7-49fc-88b6-3dc96c877c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:45.126602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-099976de-9de7-49fc-88b6-3dc96c877c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:45.127366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-099976de-9de7-49fc-88b6-3dc96c877c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:45.127805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-099976de-9de7-49fc-88b6-3dc96c877c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:45.552382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e733226b-549f-48dd-8630-354c8c218210 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:45.559421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-099976de-9de7-49fc-88b6-3dc96c877c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:45.560469 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e733226b-549f-48dd-8630-354c8c218210 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.447678 Aug 01 15:53:45.561052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1010/2346] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:45 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:45.572092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-099976de-9de7-49fc-88b6-3dc96c877c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:45.573708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-099976de-9de7-49fc-88b6-3dc96c877c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:45.575005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-099976de-9de7-49fc-88b6-3dc96c877c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.459831 Aug 01 15:53:45.575548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1337/2347] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:46.582001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a9b96953-e5a3-4249-96f1-32f70482bf7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:46.582552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a9b96953-e5a3-4249-96f1-32f70482bf7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:46.589915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9b96953-e5a3-4249-96f1-32f70482bf7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:46.590390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9b96953-e5a3-4249-96f1-32f70482bf7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:46.591221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9b96953-e5a3-4249-96f1-32f70482bf7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:46.591614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9b96953-e5a3-4249-96f1-32f70482bf7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:46.596495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-915235a1-c6b7-42d7-ad43-a394159f085f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:46.597114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-915235a1-c6b7-42d7-ad43-a394159f085f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:46.603920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-915235a1-c6b7-42d7-ad43-a394159f085f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:46.604369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-915235a1-c6b7-42d7-ad43-a394159f085f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:46.605134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-915235a1-c6b7-42d7-ad43-a394159f085f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:46.605566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-915235a1-c6b7-42d7-ad43-a394159f085f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:46.775022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a9b96953-e5a3-4249-96f1-32f70482bf7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:46.783097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a9b96953-e5a3-4249-96f1-32f70482bf7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.205006 Aug 01 15:53:46.783801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1011/2348] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:46 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:46.795407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-915235a1-c6b7-42d7-ad43-a394159f085f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:46.803957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-915235a1-c6b7-42d7-ad43-a394159f085f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:46.805455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-915235a1-c6b7-42d7-ad43-a394159f085f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:46.806665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-915235a1-c6b7-42d7-ad43-a394159f085f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.214092 Aug 01 15:53:46.807237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1338/2349] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:47.804901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-acccd2f6-f217-4bfc-8d24-3af48bcaba15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:47.805539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-acccd2f6-f217-4bfc-8d24-3af48bcaba15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:47.812025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acccd2f6-f217-4bfc-8d24-3af48bcaba15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:47.812492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acccd2f6-f217-4bfc-8d24-3af48bcaba15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:47.813243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acccd2f6-f217-4bfc-8d24-3af48bcaba15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:47.813673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acccd2f6-f217-4bfc-8d24-3af48bcaba15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:47.829738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-924442a6-20ac-48c9-8abe-017b32de083d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:47.830392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-924442a6-20ac-48c9-8abe-017b32de083d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:47.837498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-924442a6-20ac-48c9-8abe-017b32de083d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:47.837983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-924442a6-20ac-48c9-8abe-017b32de083d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:47.838758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-924442a6-20ac-48c9-8abe-017b32de083d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:47.839195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-924442a6-20ac-48c9-8abe-017b32de083d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:48.014019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-acccd2f6-f217-4bfc-8d24-3af48bcaba15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:48.022684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-acccd2f6-f217-4bfc-8d24-3af48bcaba15 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.221821 Aug 01 15:53:48.023246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1012/2350] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:47 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:48.026250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-924442a6-20ac-48c9-8abe-017b32de083d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:48.034922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-924442a6-20ac-48c9-8abe-017b32de083d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:48.036720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-924442a6-20ac-48c9-8abe-017b32de083d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:48.037881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-924442a6-20ac-48c9-8abe-017b32de083d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.212282 Aug 01 15:53:48.038466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1339/2351] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:49.044648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-10e89caf-7bce-4618-b933-4812f04cddb2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:49.045298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-10e89caf-7bce-4618-b933-4812f04cddb2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:49.053216 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-10e89caf-7bce-4618-b933-4812f04cddb2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:49.056552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-10e89caf-7bce-4618-b933-4812f04cddb2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:49.056552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-10e89caf-7bce-4618-b933-4812f04cddb2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:49.056552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-10e89caf-7bce-4618-b933-4812f04cddb2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:49.062261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ebc11b71-3722-4ed2-a3ee-d839f92e85c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:49.063402 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ebc11b71-3722-4ed2-a3ee-d839f92e85c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:49.070304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebc11b71-3722-4ed2-a3ee-d839f92e85c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:49.070757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebc11b71-3722-4ed2-a3ee-d839f92e85c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:49.071533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebc11b71-3722-4ed2-a3ee-d839f92e85c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:49.071968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebc11b71-3722-4ed2-a3ee-d839f92e85c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:49.254978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-10e89caf-7bce-4618-b933-4812f04cddb2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:49.262063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ebc11b71-3722-4ed2-a3ee-d839f92e85c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:49.263050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-10e89caf-7bce-4618-b933-4812f04cddb2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.222360 Aug 01 15:53:49.263643 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1013/2352] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:49.271267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ebc11b71-3722-4ed2-a3ee-d839f92e85c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:49.272768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ebc11b71-3722-4ed2-a3ee-d839f92e85c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:49.273956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ebc11b71-3722-4ed2-a3ee-d839f92e85c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.216081 Aug 01 15:53:49.274502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1340/2353] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:53:50.284911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-42112543-5214-4400-af0f-41d882e78bc6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:50.285525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-42112543-5214-4400-af0f-41d882e78bc6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:50.292632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42112543-5214-4400-af0f-41d882e78bc6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:50.293087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42112543-5214-4400-af0f-41d882e78bc6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:50.293852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42112543-5214-4400-af0f-41d882e78bc6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:50.294332 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42112543-5214-4400-af0f-41d882e78bc6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:50.296647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e589d0bc-0e8e-4aca-ab30-6bcefd136bdd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:50.297263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e589d0bc-0e8e-4aca-ab30-6bcefd136bdd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:50.304877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e589d0bc-0e8e-4aca-ab30-6bcefd136bdd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:50.305262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e589d0bc-0e8e-4aca-ab30-6bcefd136bdd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:50.306081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e589d0bc-0e8e-4aca-ab30-6bcefd136bdd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:50.306523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e589d0bc-0e8e-4aca-ab30-6bcefd136bdd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:50.498306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-42112543-5214-4400-af0f-41d882e78bc6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:50.502091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e589d0bc-0e8e-4aca-ab30-6bcefd136bdd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:50.506415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-42112543-5214-4400-af0f-41d882e78bc6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.225374 Aug 01 15:53:50.507061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1014/2354] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:50 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:50.511128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e589d0bc-0e8e-4aca-ab30-6bcefd136bdd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:50.512629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e589d0bc-0e8e-4aca-ab30-6bcefd136bdd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:50.513826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e589d0bc-0e8e-4aca-ab30-6bcefd136bdd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.221074 Aug 01 15:53:50.514429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1341/2355] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:51.528669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-86087604-b082-4104-8c20-245b5f071018 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:51.529283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-86087604-b082-4104-8c20-245b5f071018 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:51.536130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-86087604-b082-4104-8c20-245b5f071018 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:51.536367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-70bda476-62ef-4a3c-aedc-26005ad34019 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:51.536831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-86087604-b082-4104-8c20-245b5f071018 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:51.536939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-70bda476-62ef-4a3c-aedc-26005ad34019 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:51.537347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-86087604-b082-4104-8c20-245b5f071018 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:51.537788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-86087604-b082-4104-8c20-245b5f071018 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:51.543611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70bda476-62ef-4a3c-aedc-26005ad34019 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:51.544085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70bda476-62ef-4a3c-aedc-26005ad34019 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:51.544915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70bda476-62ef-4a3c-aedc-26005ad34019 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:51.545306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70bda476-62ef-4a3c-aedc-26005ad34019 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:51.734171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-86087604-b082-4104-8c20-245b5f071018 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:51.737468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-70bda476-62ef-4a3c-aedc-26005ad34019 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:51.743027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-86087604-b082-4104-8c20-245b5f071018 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.218261 Aug 01 15:53:51.743849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1015/2356] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:51 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:51.747024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-70bda476-62ef-4a3c-aedc-26005ad34019 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:51.748529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-70bda476-62ef-4a3c-aedc-26005ad34019 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:51.749696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-70bda476-62ef-4a3c-aedc-26005ad34019 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.217251 Aug 01 15:53:51.750280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1342/2357] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:52.767936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-345f617c-11b9-47af-9794-eaa4cec34197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:52.769060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-345f617c-11b9-47af-9794-eaa4cec34197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:52.774462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-348af0f8-f3f0-448f-9592-502d59acdad6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:52.775142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-348af0f8-f3f0-448f-9592-502d59acdad6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:52.777770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-345f617c-11b9-47af-9794-eaa4cec34197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:52.778258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-345f617c-11b9-47af-9794-eaa4cec34197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:52.779046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-345f617c-11b9-47af-9794-eaa4cec34197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:52.779482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-345f617c-11b9-47af-9794-eaa4cec34197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:52.787746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-348af0f8-f3f0-448f-9592-502d59acdad6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:52.788199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-348af0f8-f3f0-448f-9592-502d59acdad6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:52.788970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-348af0f8-f3f0-448f-9592-502d59acdad6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:52.789414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-348af0f8-f3f0-448f-9592-502d59acdad6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:52.997688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-345f617c-11b9-47af-9794-eaa4cec34197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:53.006585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-345f617c-11b9-47af-9794-eaa4cec34197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.245067 Aug 01 15:53:53.007165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1016/2358] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:52 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:53.009320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-348af0f8-f3f0-448f-9592-502d59acdad6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:53.017782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-348af0f8-f3f0-448f-9592-502d59acdad6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:53.019372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-348af0f8-f3f0-448f-9592-502d59acdad6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:53.020535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-348af0f8-f3f0-448f-9592-502d59acdad6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.251716 Aug 01 15:53:53.021093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1343/2359] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:54.027774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9e53696c-a60f-4d5e-a0a5-30352b4432a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:54.028363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9e53696c-a60f-4d5e-a0a5-30352b4432a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:54.034890 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e53696c-a60f-4d5e-a0a5-30352b4432a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:54.035335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e53696c-a60f-4d5e-a0a5-30352b4432a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:54.036120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e53696c-a60f-4d5e-a0a5-30352b4432a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:54.036562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9e53696c-a60f-4d5e-a0a5-30352b4432a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:54.043352 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8b63f9c6-2bcd-47a0-bc7f-fde560248884 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:54.043964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8b63f9c6-2bcd-47a0-bc7f-fde560248884 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:54.050283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b63f9c6-2bcd-47a0-bc7f-fde560248884 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:54.050739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b63f9c6-2bcd-47a0-bc7f-fde560248884 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:54.051525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b63f9c6-2bcd-47a0-bc7f-fde560248884 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:54.051973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b63f9c6-2bcd-47a0-bc7f-fde560248884 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:54.238143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9e53696c-a60f-4d5e-a0a5-30352b4432a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:54.244760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8b63f9c6-2bcd-47a0-bc7f-fde560248884 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:54.246220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9e53696c-a60f-4d5e-a0a5-30352b4432a3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.222329 Aug 01 15:53:54.246796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1017/2360] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:54 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:54.253532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8b63f9c6-2bcd-47a0-bc7f-fde560248884 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:54.255559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8b63f9c6-2bcd-47a0-bc7f-fde560248884 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:54.256718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8b63f9c6-2bcd-47a0-bc7f-fde560248884 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.217407 Aug 01 15:53:54.257267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1344/2361] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:55.267749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8e9ffa02-f98a-4c19-b716-c57c8b725ad8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:55.268373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8e9ffa02-f98a-4c19-b716-c57c8b725ad8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:55.275775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e9ffa02-f98a-4c19-b716-c57c8b725ad8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:55.276223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e9ffa02-f98a-4c19-b716-c57c8b725ad8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:55.277013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e9ffa02-f98a-4c19-b716-c57c8b725ad8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:55.277448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e9ffa02-f98a-4c19-b716-c57c8b725ad8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:55.280217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ad2568aa-d500-4e23-8e80-46a098917cae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:55.280835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ad2568aa-d500-4e23-8e80-46a098917cae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:55.288277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad2568aa-d500-4e23-8e80-46a098917cae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:55.288731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad2568aa-d500-4e23-8e80-46a098917cae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:55.289497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad2568aa-d500-4e23-8e80-46a098917cae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:55.289957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ad2568aa-d500-4e23-8e80-46a098917cae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:55.479349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8e9ffa02-f98a-4c19-b716-c57c8b725ad8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:55.482557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ad2568aa-d500-4e23-8e80-46a098917cae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:55.487416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8e9ffa02-f98a-4c19-b716-c57c8b725ad8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.223578 Aug 01 15:53:55.487986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1018/2362] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:55 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:55.491434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ad2568aa-d500-4e23-8e80-46a098917cae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:55.492935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ad2568aa-d500-4e23-8e80-46a098917cae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:55.494163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ad2568aa-d500-4e23-8e80-46a098917cae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.218024 Aug 01 15:53:55.494671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1345/2363] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:56.509409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-93d51c26-0a77-4dbd-89c6-306ed82f0f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:56.510425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-93d51c26-0a77-4dbd-89c6-306ed82f0f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:56.516229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5dd83be7-da17-434c-8fc2-4d857aa6c29a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:56.516872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5dd83be7-da17-434c-8fc2-4d857aa6c29a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:56.517005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93d51c26-0a77-4dbd-89c6-306ed82f0f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:56.517423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93d51c26-0a77-4dbd-89c6-306ed82f0f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:56.518218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93d51c26-0a77-4dbd-89c6-306ed82f0f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:56.518658 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93d51c26-0a77-4dbd-89c6-306ed82f0f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:56.523025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5dd83be7-da17-434c-8fc2-4d857aa6c29a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:56.523472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5dd83be7-da17-434c-8fc2-4d857aa6c29a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:56.524232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5dd83be7-da17-434c-8fc2-4d857aa6c29a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:56.524665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5dd83be7-da17-434c-8fc2-4d857aa6c29a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:56.711039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5dd83be7-da17-434c-8fc2-4d857aa6c29a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:56.717694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-93d51c26-0a77-4dbd-89c6-306ed82f0f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:56.719480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5dd83be7-da17-434c-8fc2-4d857aa6c29a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:56.720978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5dd83be7-da17-434c-8fc2-4d857aa6c29a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:56.722163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5dd83be7-da17-434c-8fc2-4d857aa6c29a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.209829 Aug 01 15:53:56.722978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1346/2364] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:56.726777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-93d51c26-0a77-4dbd-89c6-306ed82f0f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.221278 Aug 01 15:53:56.727346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1019/2365] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:56 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:53:57.746344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a1b263c5-cb7a-4dd6-8f71-662df9d49ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:57.747043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a1b263c5-cb7a-4dd6-8f71-662df9d49ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:57.747167 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8ae6f1d7-3011-4404-aa24-6747170fba56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:57.747636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8ae6f1d7-3011-4404-aa24-6747170fba56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:57.754240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ae6f1d7-3011-4404-aa24-6747170fba56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:57.754406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a1b263c5-cb7a-4dd6-8f71-662df9d49ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:57.754698 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a1b263c5-cb7a-4dd6-8f71-662df9d49ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:57.754823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ae6f1d7-3011-4404-aa24-6747170fba56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:57.755461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ae6f1d7-3011-4404-aa24-6747170fba56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:57.755569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a1b263c5-cb7a-4dd6-8f71-662df9d49ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:57.755897 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ae6f1d7-3011-4404-aa24-6747170fba56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:57.756062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a1b263c5-cb7a-4dd6-8f71-662df9d49ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:57.958217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a1b263c5-cb7a-4dd6-8f71-662df9d49ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:57.961013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8ae6f1d7-3011-4404-aa24-6747170fba56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:57.966847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a1b263c5-cb7a-4dd6-8f71-662df9d49ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:57.968357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a1b263c5-cb7a-4dd6-8f71-662df9d49ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:57.968936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8ae6f1d7-3011-4404-aa24-6747170fba56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.225722 Aug 01 15:53:57.969510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1020/2366] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:57 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:53:57.969686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a1b263c5-cb7a-4dd6-8f71-662df9d49ef3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.227134 Aug 01 15:53:57.970093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1347/2367] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:53:58.992917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-160b3dd4-137e-4bc9-b650-49f39c3c018e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:58.993621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-160b3dd4-137e-4bc9-b650-49f39c3c018e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:58.994457 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-621a45a4-14b0-4008-b517-fbf4588d5b28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:53:58.995993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=48 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:58.996126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-621a45a4-14b0-4008-b517-fbf4588d5b28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:53:59.002016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-160b3dd4-137e-4bc9-b650-49f39c3c018e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:59.002594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-160b3dd4-137e-4bc9-b650-49f39c3c018e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:59.003250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-160b3dd4-137e-4bc9-b650-49f39c3c018e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:59.003353 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-621a45a4-14b0-4008-b517-fbf4588d5b28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:59.003717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-160b3dd4-137e-4bc9-b650-49f39c3c018e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:59.003836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-621a45a4-14b0-4008-b517-fbf4588d5b28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:59.004572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-621a45a4-14b0-4008-b517-fbf4588d5b28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:53:59.005021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-621a45a4-14b0-4008-b517-fbf4588d5b28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:53:59.009035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:53:59.142198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-160b3dd4-137e-4bc9-b650-49f39c3c018e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:59.150672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-160b3dd4-137e-4bc9-b650-49f39c3c018e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:59.152181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-160b3dd4-137e-4bc9-b650-49f39c3c018e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:59.153344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-160b3dd4-137e-4bc9-b650-49f39c3c018e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.164951 Aug 01 15:53:59.157919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1348/2368] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:53:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:53:59.383902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-621a45a4-14b0-4008-b517-fbf4588d5b28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:53:59.391833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-621a45a4-14b0-4008-b517-fbf4588d5b28 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.404452 Aug 01 15:53:59.392399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1021/2369] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:53:58 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:00.175612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cb8f3a3f-c02e-42ed-bbd5-5cc16f71e97a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:00.176214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cb8f3a3f-c02e-42ed-bbd5-5cc16f71e97a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:00.182923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cb8f3a3f-c02e-42ed-bbd5-5cc16f71e97a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:00.183384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cb8f3a3f-c02e-42ed-bbd5-5cc16f71e97a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:00.184160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cb8f3a3f-c02e-42ed-bbd5-5cc16f71e97a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:00.184636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cb8f3a3f-c02e-42ed-bbd5-5cc16f71e97a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:00.367090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cb8f3a3f-c02e-42ed-bbd5-5cc16f71e97a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:00.375531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cb8f3a3f-c02e-42ed-bbd5-5cc16f71e97a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:00.377067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cb8f3a3f-c02e-42ed-bbd5-5cc16f71e97a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:00.378267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cb8f3a3f-c02e-42ed-bbd5-5cc16f71e97a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.206652 Aug 01 15:54:00.378843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1349/2370] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:00.412537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-07d53a0d-4b4b-4e58-a148-232522248484 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:00.413152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-07d53a0d-4b4b-4e58-a148-232522248484 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:00.419721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07d53a0d-4b4b-4e58-a148-232522248484 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:00.420171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07d53a0d-4b4b-4e58-a148-232522248484 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:00.420944 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07d53a0d-4b4b-4e58-a148-232522248484 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:00.421384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07d53a0d-4b4b-4e58-a148-232522248484 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:00.552127 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-07d53a0d-4b4b-4e58-a148-232522248484 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:00.560078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-07d53a0d-4b4b-4e58-a148-232522248484 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.151329 Aug 01 15:54:00.560637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1022/2371] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:00 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:01.402253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dcda6ac5-54d7-49b2-92d5-9187695ab69a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:01.402868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dcda6ac5-54d7-49b2-92d5-9187695ab69a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:01.409349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcda6ac5-54d7-49b2-92d5-9187695ab69a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:01.409801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcda6ac5-54d7-49b2-92d5-9187695ab69a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:01.410591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcda6ac5-54d7-49b2-92d5-9187695ab69a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:01.411700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcda6ac5-54d7-49b2-92d5-9187695ab69a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:01.415706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:01.540864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dcda6ac5-54d7-49b2-92d5-9187695ab69a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:01.549336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dcda6ac5-54d7-49b2-92d5-9187695ab69a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:01.550863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dcda6ac5-54d7-49b2-92d5-9187695ab69a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:01.552024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dcda6ac5-54d7-49b2-92d5-9187695ab69a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.153753 Aug 01 15:54:01.552587 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1350/2372] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:01.581995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-70aa8b72-1303-4f4f-a5ab-6bf177e12867 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:01.583193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-70aa8b72-1303-4f4f-a5ab-6bf177e12867 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:01.589801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70aa8b72-1303-4f4f-a5ab-6bf177e12867 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:01.590282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70aa8b72-1303-4f4f-a5ab-6bf177e12867 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:01.591054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70aa8b72-1303-4f4f-a5ab-6bf177e12867 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:01.591497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70aa8b72-1303-4f4f-a5ab-6bf177e12867 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:01.723133 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-70aa8b72-1303-4f4f-a5ab-6bf177e12867 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:01.731123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-70aa8b72-1303-4f4f-a5ab-6bf177e12867 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.153087 Aug 01 15:54:01.731683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1023/2373] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:01 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:02.575929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-82decd23-b1e4-4202-8a29-598e6e3f10c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:02.576483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-82decd23-b1e4-4202-8a29-598e6e3f10c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:02.583119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82decd23-b1e4-4202-8a29-598e6e3f10c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:02.583563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82decd23-b1e4-4202-8a29-598e6e3f10c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:02.584318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82decd23-b1e4-4202-8a29-598e6e3f10c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:02.584747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82decd23-b1e4-4202-8a29-598e6e3f10c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:02.753142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c6b7eb93-cdaa-4dee-ae44-179e8446d829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:02.754007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c6b7eb93-cdaa-4dee-ae44-179e8446d829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:02.760677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c6b7eb93-cdaa-4dee-ae44-179e8446d829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:02.761128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c6b7eb93-cdaa-4dee-ae44-179e8446d829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:02.761934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c6b7eb93-cdaa-4dee-ae44-179e8446d829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:02.762378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c6b7eb93-cdaa-4dee-ae44-179e8446d829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:02.798525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-82decd23-b1e4-4202-8a29-598e6e3f10c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:02.807216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-82decd23-b1e4-4202-8a29-598e6e3f10c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:02.808760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-82decd23-b1e4-4202-8a29-598e6e3f10c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:02.810101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-82decd23-b1e4-4202-8a29-598e6e3f10c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.238090 Aug 01 15:54:02.810671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1351/2374] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:02.961835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c6b7eb93-cdaa-4dee-ae44-179e8446d829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:02.969874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c6b7eb93-cdaa-4dee-ae44-179e8446d829 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.220920 Aug 01 15:54:02.970464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1024/2375] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:02 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:03.832711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-18bf6098-aa1a-44f5-9ace-04fe96626e01 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:03.833327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-18bf6098-aa1a-44f5-9ace-04fe96626e01 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:03.839824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-18bf6098-aa1a-44f5-9ace-04fe96626e01 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:03.840264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-18bf6098-aa1a-44f5-9ace-04fe96626e01 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:03.841016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-18bf6098-aa1a-44f5-9ace-04fe96626e01 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:03.841443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-18bf6098-aa1a-44f5-9ace-04fe96626e01 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:03.975232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-18bf6098-aa1a-44f5-9ace-04fe96626e01 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:03.983721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-18bf6098-aa1a-44f5-9ace-04fe96626e01 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:03.985240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-18bf6098-aa1a-44f5-9ace-04fe96626e01 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:03.986444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-18bf6098-aa1a-44f5-9ace-04fe96626e01 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.157581 Aug 01 15:54:03.987022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1352/2376] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:03.992375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b637664d-6459-4cdc-bc3d-ccd651e492d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:03.992994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b637664d-6459-4cdc-bc3d-ccd651e492d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:03.999521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b637664d-6459-4cdc-bc3d-ccd651e492d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:03.999999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b637664d-6459-4cdc-bc3d-ccd651e492d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:04.000773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b637664d-6459-4cdc-bc3d-ccd651e492d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:04.001208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b637664d-6459-4cdc-bc3d-ccd651e492d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:04.131392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b637664d-6459-4cdc-bc3d-ccd651e492d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:04.139415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b637664d-6459-4cdc-bc3d-ccd651e492d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.151489 Aug 01 15:54:04.139978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1025/2377] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:03 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:05.009821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fdf93150-2350-4ff4-a43c-fae4505fc614 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:05.010465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fdf93150-2350-4ff4-a43c-fae4505fc614 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:05.016785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fdf93150-2350-4ff4-a43c-fae4505fc614 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:05.017225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fdf93150-2350-4ff4-a43c-fae4505fc614 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:05.018006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fdf93150-2350-4ff4-a43c-fae4505fc614 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:05.018438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fdf93150-2350-4ff4-a43c-fae4505fc614 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:05.153606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fdf93150-2350-4ff4-a43c-fae4505fc614 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:05.160466 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1db9fe07-8567-40b8-b958-f950459d67e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:05.161712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1db9fe07-8567-40b8-b958-f950459d67e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:05.163147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fdf93150-2350-4ff4-a43c-fae4505fc614 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:05.164923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fdf93150-2350-4ff4-a43c-fae4505fc614 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:05.166166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fdf93150-2350-4ff4-a43c-fae4505fc614 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.160283 Aug 01 15:54:05.166736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1353/2378] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:05.168565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1db9fe07-8567-40b8-b958-f950459d67e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:05.169015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1db9fe07-8567-40b8-b958-f950459d67e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:05.169790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1db9fe07-8567-40b8-b958-f950459d67e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:05.170264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1db9fe07-8567-40b8-b958-f950459d67e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:05.299316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1db9fe07-8567-40b8-b958-f950459d67e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:05.307299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1db9fe07-8567-40b8-b958-f950459d67e5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.150677 Aug 01 15:54:05.307867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1026/2379] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:05 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:06.189349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-83f666a3-00f8-4415-9997-0cf9ee3a08ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:06.189991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-83f666a3-00f8-4415-9997-0cf9ee3a08ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:06.196870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83f666a3-00f8-4415-9997-0cf9ee3a08ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:06.197322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83f666a3-00f8-4415-9997-0cf9ee3a08ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:06.198140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83f666a3-00f8-4415-9997-0cf9ee3a08ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:06.198663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83f666a3-00f8-4415-9997-0cf9ee3a08ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:06.328693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1b76a973-d019-4742-8af8-cb7f12651e01 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:06.329312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1b76a973-d019-4742-8af8-cb7f12651e01 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:06.333092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-83f666a3-00f8-4415-9997-0cf9ee3a08ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:06.335585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b76a973-d019-4742-8af8-cb7f12651e01 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:06.336056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b76a973-d019-4742-8af8-cb7f12651e01 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:06.336814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b76a973-d019-4742-8af8-cb7f12651e01 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:06.337252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b76a973-d019-4742-8af8-cb7f12651e01 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:06.341695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-83f666a3-00f8-4415-9997-0cf9ee3a08ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:06.343254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-83f666a3-00f8-4415-9997-0cf9ee3a08ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:06.344422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-83f666a3-00f8-4415-9997-0cf9ee3a08ce tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.159321 Aug 01 15:54:06.345161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1354/2380] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:06.467469 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1b76a973-d019-4742-8af8-cb7f12651e01 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:06.476744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1b76a973-d019-4742-8af8-cb7f12651e01 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.151809 Aug 01 15:54:06.477375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1027/2381] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:06 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:07.368624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c16d842f-a1ca-47c1-9257-789b3f2c4244 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:07.369243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c16d842f-a1ca-47c1-9257-789b3f2c4244 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:07.375850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c16d842f-a1ca-47c1-9257-789b3f2c4244 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:07.376311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c16d842f-a1ca-47c1-9257-789b3f2c4244 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:07.377082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c16d842f-a1ca-47c1-9257-789b3f2c4244 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:07.377524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c16d842f-a1ca-47c1-9257-789b3f2c4244 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:07.498394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b9fa12d6-e160-4cec-aea4-9efd796dc6d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:07.499006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b9fa12d6-e160-4cec-aea4-9efd796dc6d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:07.505581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b9fa12d6-e160-4cec-aea4-9efd796dc6d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:07.506073 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b9fa12d6-e160-4cec-aea4-9efd796dc6d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:07.506851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b9fa12d6-e160-4cec-aea4-9efd796dc6d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:07.507291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b9fa12d6-e160-4cec-aea4-9efd796dc6d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:07.511321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c16d842f-a1ca-47c1-9257-789b3f2c4244 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:07.519828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c16d842f-a1ca-47c1-9257-789b3f2c4244 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:07.521708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c16d842f-a1ca-47c1-9257-789b3f2c4244 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:07.522923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c16d842f-a1ca-47c1-9257-789b3f2c4244 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.158276 Aug 01 15:54:07.523491 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1355/2382] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:07 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:07.635990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b9fa12d6-e160-4cec-aea4-9efd796dc6d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:07.644013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b9fa12d6-e160-4cec-aea4-9efd796dc6d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.149471 Aug 01 15:54:07.644579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1028/2383] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:07 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:08.546636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-192d8292-3b13-4269-bf86-f0841e305e06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:08.547251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-192d8292-3b13-4269-bf86-f0841e305e06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:08.554024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-192d8292-3b13-4269-bf86-f0841e305e06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:08.554478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-192d8292-3b13-4269-bf86-f0841e305e06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:08.555243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-192d8292-3b13-4269-bf86-f0841e305e06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:08.555680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-192d8292-3b13-4269-bf86-f0841e305e06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:08.664590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3d8bb59a-a426-4cdb-b5d8-c6a1b975adfc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:08.665208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3d8bb59a-a426-4cdb-b5d8-c6a1b975adfc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:08.671727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d8bb59a-a426-4cdb-b5d8-c6a1b975adfc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:08.672180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d8bb59a-a426-4cdb-b5d8-c6a1b975adfc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:08.672985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d8bb59a-a426-4cdb-b5d8-c6a1b975adfc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:08.673425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d8bb59a-a426-4cdb-b5d8-c6a1b975adfc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:08.683194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-192d8292-3b13-4269-bf86-f0841e305e06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:08.693002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-192d8292-3b13-4269-bf86-f0841e305e06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:08.694586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-192d8292-3b13-4269-bf86-f0841e305e06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:08.695758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-192d8292-3b13-4269-bf86-f0841e305e06 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.153057 Aug 01 15:54:08.696324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1356/2384] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:08.806503 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3d8bb59a-a426-4cdb-b5d8-c6a1b975adfc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:08.814457 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3d8bb59a-a426-4cdb-b5d8-c6a1b975adfc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.153700 Aug 01 15:54:08.815022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1029/2385] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:08 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:09.718956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-90349c08-9768-4f9f-b69a-e812f0fa3445 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:09.719480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-90349c08-9768-4f9f-b69a-e812f0fa3445 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:09.726940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-90349c08-9768-4f9f-b69a-e812f0fa3445 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:09.727391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-90349c08-9768-4f9f-b69a-e812f0fa3445 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:09.728219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-90349c08-9768-4f9f-b69a-e812f0fa3445 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:09.728657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-90349c08-9768-4f9f-b69a-e812f0fa3445 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:09.836370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b1e69aef-1a20-4b34-ae74-e9e656b25170 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:09.837027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b1e69aef-1a20-4b34-ae74-e9e656b25170 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:09.843819 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1e69aef-1a20-4b34-ae74-e9e656b25170 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:09.844278 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1e69aef-1a20-4b34-ae74-e9e656b25170 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:09.845058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1e69aef-1a20-4b34-ae74-e9e656b25170 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:09.845502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1e69aef-1a20-4b34-ae74-e9e656b25170 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:09.857696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-90349c08-9768-4f9f-b69a-e812f0fa3445 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:09.869447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-90349c08-9768-4f9f-b69a-e812f0fa3445 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:09.871142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-90349c08-9768-4f9f-b69a-e812f0fa3445 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:09.872689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-90349c08-9768-4f9f-b69a-e812f0fa3445 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.157681 Aug 01 15:54:09.873337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1357/2386] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:09.981908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b1e69aef-1a20-4b34-ae74-e9e656b25170 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:09.989983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b1e69aef-1a20-4b34-ae74-e9e656b25170 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.158246 Aug 01 15:54:09.990649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1030/2387] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:09 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:10.897906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-219085d0-34eb-447a-992d-920c7fa9d746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:10.898560 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-219085d0-34eb-447a-992d-920c7fa9d746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:10.905942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-219085d0-34eb-447a-992d-920c7fa9d746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:10.906400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-219085d0-34eb-447a-992d-920c7fa9d746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:10.907176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-219085d0-34eb-447a-992d-920c7fa9d746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:10.907614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-219085d0-34eb-447a-992d-920c7fa9d746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:11.014083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9001f8b8-1822-43d7-b3ef-8a780d5c2ec9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:11.014694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9001f8b8-1822-43d7-b3ef-8a780d5c2ec9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:11.022881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9001f8b8-1822-43d7-b3ef-8a780d5c2ec9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:11.023768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9001f8b8-1822-43d7-b3ef-8a780d5c2ec9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:11.024104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9001f8b8-1822-43d7-b3ef-8a780d5c2ec9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:11.024550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9001f8b8-1822-43d7-b3ef-8a780d5c2ec9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:11.042543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-219085d0-34eb-447a-992d-920c7fa9d746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:11.051085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-219085d0-34eb-447a-992d-920c7fa9d746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:11.052880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-219085d0-34eb-447a-992d-920c7fa9d746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:11.054383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-219085d0-34eb-447a-992d-920c7fa9d746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.160833 Aug 01 15:54:11.055382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1358/2388] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:10 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:11.160561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9001f8b8-1822-43d7-b3ef-8a780d5c2ec9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:11.169117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9001f8b8-1822-43d7-b3ef-8a780d5c2ec9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.158898 Aug 01 15:54:11.169678 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1031/2389] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:11 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:12.078110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b2c571f7-67f1-4017-8143-cdfff2e57ac7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:12.078723 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b2c571f7-67f1-4017-8143-cdfff2e57ac7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:12.085188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2c571f7-67f1-4017-8143-cdfff2e57ac7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:12.085641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2c571f7-67f1-4017-8143-cdfff2e57ac7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:12.086441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2c571f7-67f1-4017-8143-cdfff2e57ac7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:12.086882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b2c571f7-67f1-4017-8143-cdfff2e57ac7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:12.191139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c24ca76b-1443-4d59-998d-3162fc0eb149 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:12.191756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c24ca76b-1443-4d59-998d-3162fc0eb149 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:12.194389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=50 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:12.200376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c24ca76b-1443-4d59-998d-3162fc0eb149 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:12.201027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c24ca76b-1443-4d59-998d-3162fc0eb149 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:12.202429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c24ca76b-1443-4d59-998d-3162fc0eb149 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:12.203223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c24ca76b-1443-4d59-998d-3162fc0eb149 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:12.238490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b2c571f7-67f1-4017-8143-cdfff2e57ac7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:12.250310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b2c571f7-67f1-4017-8143-cdfff2e57ac7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:12.251958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b2c571f7-67f1-4017-8143-cdfff2e57ac7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:12.253169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b2c571f7-67f1-4017-8143-cdfff2e57ac7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.179049 Aug 01 15:54:12.253738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1359/2390] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:12.337290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c24ca76b-1443-4d59-998d-3162fc0eb149 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:12.345176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c24ca76b-1443-4d59-998d-3162fc0eb149 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.157874 Aug 01 15:54:12.345736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1032/2391] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:12 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:13.277210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0f2620d4-007a-4081-b2bf-5af454723b15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:13.277811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0f2620d4-007a-4081-b2bf-5af454723b15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:13.284295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0f2620d4-007a-4081-b2bf-5af454723b15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:13.284736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0f2620d4-007a-4081-b2bf-5af454723b15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:13.285482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0f2620d4-007a-4081-b2bf-5af454723b15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:13.286570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0f2620d4-007a-4081-b2bf-5af454723b15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:13.367519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3df536d9-8dc3-4c68-94d3-86bc0fe62e66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:13.368134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3df536d9-8dc3-4c68-94d3-86bc0fe62e66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:13.374951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3df536d9-8dc3-4c68-94d3-86bc0fe62e66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:13.375409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3df536d9-8dc3-4c68-94d3-86bc0fe62e66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:13.376192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3df536d9-8dc3-4c68-94d3-86bc0fe62e66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:13.376633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3df536d9-8dc3-4c68-94d3-86bc0fe62e66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:13.426415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0f2620d4-007a-4081-b2bf-5af454723b15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:13.435033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0f2620d4-007a-4081-b2bf-5af454723b15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:13.436541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0f2620d4-007a-4081-b2bf-5af454723b15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:13.437707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0f2620d4-007a-4081-b2bf-5af454723b15 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.164422 Aug 01 15:54:13.438303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1360/2392] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:13.511103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3df536d9-8dc3-4c68-94d3-86bc0fe62e66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:13.519044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3df536d9-8dc3-4c68-94d3-86bc0fe62e66 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.155414 Aug 01 15:54:13.519598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1033/2393] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:13 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:14.461468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4abe4b7b-4a12-4caf-a982-d0bc57416744 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:14.462119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4abe4b7b-4a12-4caf-a982-d0bc57416744 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:14.468651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4abe4b7b-4a12-4caf-a982-d0bc57416744 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:14.469104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4abe4b7b-4a12-4caf-a982-d0bc57416744 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:14.469874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4abe4b7b-4a12-4caf-a982-d0bc57416744 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:14.470340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4abe4b7b-4a12-4caf-a982-d0bc57416744 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:14.541067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0699a4a4-df8f-40ce-8bd1-669b29f9f715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:14.541683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0699a4a4-df8f-40ce-8bd1-669b29f9f715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:14.548779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0699a4a4-df8f-40ce-8bd1-669b29f9f715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:14.548779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0699a4a4-df8f-40ce-8bd1-669b29f9f715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:14.549482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0699a4a4-df8f-40ce-8bd1-669b29f9f715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:14.549941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0699a4a4-df8f-40ce-8bd1-669b29f9f715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:14.632267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4abe4b7b-4a12-4caf-a982-d0bc57416744 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:14.640807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4abe4b7b-4a12-4caf-a982-d0bc57416744 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:14.642324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4abe4b7b-4a12-4caf-a982-d0bc57416744 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:14.643494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4abe4b7b-4a12-4caf-a982-d0bc57416744 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.185954 Aug 01 15:54:14.644060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1361/2394] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:14.694965 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0699a4a4-df8f-40ce-8bd1-669b29f9f715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:14.702863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0699a4a4-df8f-40ce-8bd1-669b29f9f715 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.166155 Aug 01 15:54:14.703421 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1034/2395] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:14 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:15.666181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cca5378d-5387-4db5-89b2-9061893b0f0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:15.666787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cca5378d-5387-4db5-89b2-9061893b0f0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:15.673276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cca5378d-5387-4db5-89b2-9061893b0f0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:15.673725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cca5378d-5387-4db5-89b2-9061893b0f0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:15.674533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cca5378d-5387-4db5-89b2-9061893b0f0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:15.674976 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cca5378d-5387-4db5-89b2-9061893b0f0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:15.725462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-edf632c9-f3c1-440f-b8b9-74efd5116c23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:15.726117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-edf632c9-f3c1-440f-b8b9-74efd5116c23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:15.732492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-edf632c9-f3c1-440f-b8b9-74efd5116c23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:15.732951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-edf632c9-f3c1-440f-b8b9-74efd5116c23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:15.733734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-edf632c9-f3c1-440f-b8b9-74efd5116c23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:15.734208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-edf632c9-f3c1-440f-b8b9-74efd5116c23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:15.849457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cca5378d-5387-4db5-89b2-9061893b0f0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:15.858204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cca5378d-5387-4db5-89b2-9061893b0f0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:15.859756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cca5378d-5387-4db5-89b2-9061893b0f0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:15.860932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cca5378d-5387-4db5-89b2-9061893b0f0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.198668 Aug 01 15:54:15.861510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1362/2396] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:15.894559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-edf632c9-f3c1-440f-b8b9-74efd5116c23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:15.903156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-edf632c9-f3c1-440f-b8b9-74efd5116c23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.182407 Aug 01 15:54:15.903730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1035/2397] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:15 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:16.885059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2b7438fb-1d7e-465e-8635-a541bc65144f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:16.885663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2b7438fb-1d7e-465e-8635-a541bc65144f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:16.892173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2b7438fb-1d7e-465e-8635-a541bc65144f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:16.892611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2b7438fb-1d7e-465e-8635-a541bc65144f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:16.893359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2b7438fb-1d7e-465e-8635-a541bc65144f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:16.893785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2b7438fb-1d7e-465e-8635-a541bc65144f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:16.925406 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-09a7e256-8b2f-4eaf-8bd0-2d762b0de1bb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:16.926060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-09a7e256-8b2f-4eaf-8bd0-2d762b0de1bb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:16.933292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09a7e256-8b2f-4eaf-8bd0-2d762b0de1bb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:16.933748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09a7e256-8b2f-4eaf-8bd0-2d762b0de1bb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:16.934549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09a7e256-8b2f-4eaf-8bd0-2d762b0de1bb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:16.934993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09a7e256-8b2f-4eaf-8bd0-2d762b0de1bb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:17.076225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2b7438fb-1d7e-465e-8635-a541bc65144f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:17.085240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2b7438fb-1d7e-465e-8635-a541bc65144f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:17.086781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2b7438fb-1d7e-465e-8635-a541bc65144f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:17.087991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2b7438fb-1d7e-465e-8635-a541bc65144f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.206724 Aug 01 15:54:17.088536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1363/2398] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:16 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:17.107111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-09a7e256-8b2f-4eaf-8bd0-2d762b0de1bb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:17.115815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-09a7e256-8b2f-4eaf-8bd0-2d762b0de1bb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.194258 Aug 01 15:54:17.116383 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1036/2399] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:16 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:18.111161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-730fe478-7980-4dc6-a5a5-47fdcd11f581 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:18.111769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-730fe478-7980-4dc6-a5a5-47fdcd11f581 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:18.118394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-730fe478-7980-4dc6-a5a5-47fdcd11f581 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:18.118834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-730fe478-7980-4dc6-a5a5-47fdcd11f581 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:18.119586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-730fe478-7980-4dc6-a5a5-47fdcd11f581 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:18.120017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-730fe478-7980-4dc6-a5a5-47fdcd11f581 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:18.137100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ea3199ad-2d59-495e-b83f-0e4305eb086e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:18.137717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ea3199ad-2d59-495e-b83f-0e4305eb086e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:18.144195 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ea3199ad-2d59-495e-b83f-0e4305eb086e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:18.144649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ea3199ad-2d59-495e-b83f-0e4305eb086e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:18.145419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ea3199ad-2d59-495e-b83f-0e4305eb086e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:18.146599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ea3199ad-2d59-495e-b83f-0e4305eb086e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:18.312391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-730fe478-7980-4dc6-a5a5-47fdcd11f581 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:18.321315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-730fe478-7980-4dc6-a5a5-47fdcd11f581 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:18.322850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-730fe478-7980-4dc6-a5a5-47fdcd11f581 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:18.324228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-730fe478-7980-4dc6-a5a5-47fdcd11f581 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.216731 Aug 01 15:54:18.324574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1364/2400] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:18.327864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ea3199ad-2d59-495e-b83f-0e4305eb086e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:18.331450 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:18.337713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ea3199ad-2d59-495e-b83f-0e4305eb086e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.204437 Aug 01 15:54:18.338460 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1037/2401] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:18 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:19.348233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b7f37d1f-e7e0-4aeb-b28a-caf2defe47f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:19.348787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b7f37d1f-e7e0-4aeb-b28a-caf2defe47f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:19.355653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b7f37d1f-e7e0-4aeb-b28a-caf2defe47f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:19.356105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b7f37d1f-e7e0-4aeb-b28a-caf2defe47f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:19.356871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b7f37d1f-e7e0-4aeb-b28a-caf2defe47f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:19.357315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b7f37d1f-e7e0-4aeb-b28a-caf2defe47f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:19.485781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8e17884c-9d6f-4c8d-b46b-43a50b8399b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:19.486424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8e17884c-9d6f-4c8d-b46b-43a50b8399b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:19.491909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b7f37d1f-e7e0-4aeb-b28a-caf2defe47f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:19.492547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e17884c-9d6f-4c8d-b46b-43a50b8399b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:19.492989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e17884c-9d6f-4c8d-b46b-43a50b8399b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:19.493747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e17884c-9d6f-4c8d-b46b-43a50b8399b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:19.494206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e17884c-9d6f-4c8d-b46b-43a50b8399b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:19.501584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b7f37d1f-e7e0-4aeb-b28a-caf2defe47f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:19.503122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b7f37d1f-e7e0-4aeb-b28a-caf2defe47f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:19.504289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b7f37d1f-e7e0-4aeb-b28a-caf2defe47f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.160489 Aug 01 15:54:19.505568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1365/2402] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:19.624919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8e17884c-9d6f-4c8d-b46b-43a50b8399b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:19.633633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8e17884c-9d6f-4c8d-b46b-43a50b8399b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.278144 Aug 01 15:54:19.634236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1038/2403] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:19 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:20.651793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e33f1d56-54f3-49b0-bc03-45944496cc52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:20.652408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e33f1d56-54f3-49b0-bc03-45944496cc52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:20.655550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c07d5365-def2-4799-8dd7-25643966f903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:20.656160 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c07d5365-def2-4799-8dd7-25643966f903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:20.658531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e33f1d56-54f3-49b0-bc03-45944496cc52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:20.658983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e33f1d56-54f3-49b0-bc03-45944496cc52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:20.659745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e33f1d56-54f3-49b0-bc03-45944496cc52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:20.660185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e33f1d56-54f3-49b0-bc03-45944496cc52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:20.663122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c07d5365-def2-4799-8dd7-25643966f903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:20.663568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c07d5365-def2-4799-8dd7-25643966f903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:20.664346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c07d5365-def2-4799-8dd7-25643966f903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:20.664760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c07d5365-def2-4799-8dd7-25643966f903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:20.865465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e33f1d56-54f3-49b0-bc03-45944496cc52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:20.868456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c07d5365-def2-4799-8dd7-25643966f903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:20.869076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:20.875430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e33f1d56-54f3-49b0-bc03-45944496cc52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:20.876915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e33f1d56-54f3-49b0-bc03-45944496cc52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:20.877335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c07d5365-def2-4799-8dd7-25643966f903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.225430 Aug 01 15:54:20.877939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1039/2404] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:20 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:20.878152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e33f1d56-54f3-49b0-bc03-45944496cc52 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.352656 Aug 01 15:54:20.878846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1366/2405] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:21.899619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6c5f6f23-c966-46e1-b304-e2d0f038d915 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:21.900750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6c5f6f23-c966-46e1-b304-e2d0f038d915 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:21.901570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ab937db1-a339-439d-93fb-abd915f213cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:21.902535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ab937db1-a339-439d-93fb-abd915f213cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:21.909504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6c5f6f23-c966-46e1-b304-e2d0f038d915 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:21.909987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6c5f6f23-c966-46e1-b304-e2d0f038d915 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:21.910773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6c5f6f23-c966-46e1-b304-e2d0f038d915 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:21.911208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6c5f6f23-c966-46e1-b304-e2d0f038d915 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:21.912007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab937db1-a339-439d-93fb-abd915f213cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:21.912557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab937db1-a339-439d-93fb-abd915f213cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:21.913614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab937db1-a339-439d-93fb-abd915f213cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:21.914196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab937db1-a339-439d-93fb-abd915f213cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:22.119232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ab937db1-a339-439d-93fb-abd915f213cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:22.123063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6c5f6f23-c966-46e1-b304-e2d0f038d915 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:22.128033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ab937db1-a339-439d-93fb-abd915f213cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:22.129535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ab937db1-a339-439d-93fb-abd915f213cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:22.130751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ab937db1-a339-439d-93fb-abd915f213cf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.233635 Aug 01 15:54:22.131271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6c5f6f23-c966-46e1-b304-e2d0f038d915 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.235952 Aug 01 15:54:22.131443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1367/2406] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:22.131803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1040/2407] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:21 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:23.152645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4e6c62dd-f0c7-44b1-bf30-0886aa172903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:23.153259 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4e6c62dd-f0c7-44b1-bf30-0886aa172903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:23.153649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-706b9bb8-90a1-4232-b307-cd334d3951b5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:23.154293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-706b9bb8-90a1-4232-b307-cd334d3951b5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:23.160158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e6c62dd-f0c7-44b1-bf30-0886aa172903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:23.160603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e6c62dd-f0c7-44b1-bf30-0886aa172903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:23.161003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-706b9bb8-90a1-4232-b307-cd334d3951b5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:23.161369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e6c62dd-f0c7-44b1-bf30-0886aa172903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:23.161494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-706b9bb8-90a1-4232-b307-cd334d3951b5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:23.161803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e6c62dd-f0c7-44b1-bf30-0886aa172903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:23.162244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-706b9bb8-90a1-4232-b307-cd334d3951b5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:23.162685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-706b9bb8-90a1-4232-b307-cd334d3951b5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:23.366707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4e6c62dd-f0c7-44b1-bf30-0886aa172903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:23.369165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-706b9bb8-90a1-4232-b307-cd334d3951b5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:23.375323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4e6c62dd-f0c7-44b1-bf30-0886aa172903 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.226488 Aug 01 15:54:23.375906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1368/2408] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:23 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:23.377825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-706b9bb8-90a1-4232-b307-cd334d3951b5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:23.379412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-706b9bb8-90a1-4232-b307-cd334d3951b5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:23.380710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-706b9bb8-90a1-4232-b307-cd334d3951b5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.230864 Aug 01 15:54:23.381258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1041/2409] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:24.396630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6a08f17e-ece7-4ff2-af6f-4c6e1b5d5557 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:24.397244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6a08f17e-ece7-4ff2-af6f-4c6e1b5d5557 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:24.403045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-209183e7-8f78-448a-8bb8-04f1766528ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:24.403658 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-209183e7-8f78-448a-8bb8-04f1766528ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:24.404117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a08f17e-ece7-4ff2-af6f-4c6e1b5d5557 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:24.404572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a08f17e-ece7-4ff2-af6f-4c6e1b5d5557 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:24.405342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a08f17e-ece7-4ff2-af6f-4c6e1b5d5557 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:24.405776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a08f17e-ece7-4ff2-af6f-4c6e1b5d5557 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:24.410171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-209183e7-8f78-448a-8bb8-04f1766528ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:24.410618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-209183e7-8f78-448a-8bb8-04f1766528ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:24.411382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-209183e7-8f78-448a-8bb8-04f1766528ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:24.411819 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-209183e7-8f78-448a-8bb8-04f1766528ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:24.601859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6a08f17e-ece7-4ff2-af6f-4c6e1b5d5557 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:24.606373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-209183e7-8f78-448a-8bb8-04f1766528ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:24.610034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6a08f17e-ece7-4ff2-af6f-4c6e1b5d5557 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.217196 Aug 01 15:54:24.610613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1369/2410] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:24 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:24.615459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-209183e7-8f78-448a-8bb8-04f1766528ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:24.616963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-209183e7-8f78-448a-8bb8-04f1766528ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:24.618247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-209183e7-8f78-448a-8bb8-04f1766528ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.218921 Aug 01 15:54:24.618798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1042/2411] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:25.632278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8f01adba-2066-40f0-87e4-b50d14d51c09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:25.632930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8f01adba-2066-40f0-87e4-b50d14d51c09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:25.639578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f01adba-2066-40f0-87e4-b50d14d51c09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:25.640031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f01adba-2066-40f0-87e4-b50d14d51c09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:25.640727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-17fee3ca-abb7-4f6a-bfe0-243e56f2154c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:25.641154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f01adba-2066-40f0-87e4-b50d14d51c09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:25.641256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f01adba-2066-40f0-87e4-b50d14d51c09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:25.641356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-17fee3ca-abb7-4f6a-bfe0-243e56f2154c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:25.648361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17fee3ca-abb7-4f6a-bfe0-243e56f2154c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:25.648804 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17fee3ca-abb7-4f6a-bfe0-243e56f2154c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:25.649559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17fee3ca-abb7-4f6a-bfe0-243e56f2154c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:25.650014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-17fee3ca-abb7-4f6a-bfe0-243e56f2154c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:25.839290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f01adba-2066-40f0-87e4-b50d14d51c09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:25.843485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-17fee3ca-abb7-4f6a-bfe0-243e56f2154c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:25.847373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8f01adba-2066-40f0-87e4-b50d14d51c09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.219477 Aug 01 15:54:25.848213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1370/2412] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:25 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:25.852299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-17fee3ca-abb7-4f6a-bfe0-243e56f2154c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:25.853791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-17fee3ca-abb7-4f6a-bfe0-243e56f2154c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:25.854967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-17fee3ca-abb7-4f6a-bfe0-243e56f2154c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.218111 Aug 01 15:54:25.855508 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1043/2413] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:25 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:26.869318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cab5dc67-b7bb-4bd7-aab9-a9df3bc37f62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:26.869958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cab5dc67-b7bb-4bd7-aab9-a9df3bc37f62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:26.876784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cab5dc67-b7bb-4bd7-aab9-a9df3bc37f62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:26.877233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cab5dc67-b7bb-4bd7-aab9-a9df3bc37f62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:26.878022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cab5dc67-b7bb-4bd7-aab9-a9df3bc37f62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:26.878460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cab5dc67-b7bb-4bd7-aab9-a9df3bc37f62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:26.878595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7d557b8b-f096-4220-be3f-a97b0f66dbd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:26.879208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7d557b8b-f096-4220-be3f-a97b0f66dbd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:26.885632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d557b8b-f096-4220-be3f-a97b0f66dbd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:26.886122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d557b8b-f096-4220-be3f-a97b0f66dbd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:26.886881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d557b8b-f096-4220-be3f-a97b0f66dbd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:26.887313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d557b8b-f096-4220-be3f-a97b0f66dbd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:27.303915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cab5dc67-b7bb-4bd7-aab9-a9df3bc37f62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:27.311230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7d557b8b-f096-4220-be3f-a97b0f66dbd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:27.311941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cab5dc67-b7bb-4bd7-aab9-a9df3bc37f62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.446526 Aug 01 15:54:27.312502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1371/2414] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:26 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:27.320256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7d557b8b-f096-4220-be3f-a97b0f66dbd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:27.321762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7d557b8b-f096-4220-be3f-a97b0f66dbd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:27.322953 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7d557b8b-f096-4220-be3f-a97b0f66dbd3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.448272 Aug 01 15:54:27.323510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1044/2415] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:28.334752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-846bc9b4-2327-4935-8806-a89f921544d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:28.335306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-846bc9b4-2327-4935-8806-a89f921544d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:28.341947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-846bc9b4-2327-4935-8806-a89f921544d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:28.342500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-846bc9b4-2327-4935-8806-a89f921544d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:28.343365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-846bc9b4-2327-4935-8806-a89f921544d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:28.344094 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-846bc9b4-2327-4935-8806-a89f921544d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:28.346253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5af069fc-a31e-43db-9373-c3976f1dbeb3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:28.346867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5af069fc-a31e-43db-9373-c3976f1dbeb3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:28.353369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5af069fc-a31e-43db-9373-c3976f1dbeb3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:28.353816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5af069fc-a31e-43db-9373-c3976f1dbeb3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:28.354736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5af069fc-a31e-43db-9373-c3976f1dbeb3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:28.355177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5af069fc-a31e-43db-9373-c3976f1dbeb3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:28.548949 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-846bc9b4-2327-4935-8806-a89f921544d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:28.552739 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5af069fc-a31e-43db-9373-c3976f1dbeb3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:28.557598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-846bc9b4-2327-4935-8806-a89f921544d6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.227180 Aug 01 15:54:28.558198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1372/2416] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:28 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:28.561254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5af069fc-a31e-43db-9373-c3976f1dbeb3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:28.562793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5af069fc-a31e-43db-9373-c3976f1dbeb3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:28.563958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5af069fc-a31e-43db-9373-c3976f1dbeb3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.221539 Aug 01 15:54:28.564501 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1045/2417] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:29.578321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6a82cb23-ec62-42c9-a6d3-bdf864341ad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:29.578939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6a82cb23-ec62-42c9-a6d3-bdf864341ad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:29.581409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=50 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:29.588191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-dedf367f-d6c8-4cf2-b778-e7d23ff3dbe9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:29.588714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a82cb23-ec62-42c9-a6d3-bdf864341ad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:29.588838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-dedf367f-d6c8-4cf2-b778-e7d23ff3dbe9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:29.589169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a82cb23-ec62-42c9-a6d3-bdf864341ad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:29.589971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a82cb23-ec62-42c9-a6d3-bdf864341ad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:29.590415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a82cb23-ec62-42c9-a6d3-bdf864341ad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:29.594927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dedf367f-d6c8-4cf2-b778-e7d23ff3dbe9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:29.595389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dedf367f-d6c8-4cf2-b778-e7d23ff3dbe9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:29.596128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dedf367f-d6c8-4cf2-b778-e7d23ff3dbe9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:29.596595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dedf367f-d6c8-4cf2-b778-e7d23ff3dbe9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:29.784244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6a82cb23-ec62-42c9-a6d3-bdf864341ad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:29.788881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dedf367f-d6c8-4cf2-b778-e7d23ff3dbe9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:29.793510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6a82cb23-ec62-42c9-a6d3-bdf864341ad6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.218980 Aug 01 15:54:29.794705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1373/2418] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:29 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:29.797335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dedf367f-d6c8-4cf2-b778-e7d23ff3dbe9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:29.798869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dedf367f-d6c8-4cf2-b778-e7d23ff3dbe9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:29.800026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-dedf367f-d6c8-4cf2-b778-e7d23ff3dbe9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.217228 Aug 01 15:54:29.800573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1046/2419] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:30.815635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c859722e-78ea-4bed-82b1-1d85892444dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:30.816249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c859722e-78ea-4bed-82b1-1d85892444dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:30.822952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0b5b8a4e-3cc4-48a7-a675-6111e5c294d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:30.823468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c859722e-78ea-4bed-82b1-1d85892444dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:30.823625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c859722e-78ea-4bed-82b1-1d85892444dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:30.823743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0b5b8a4e-3cc4-48a7-a675-6111e5c294d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:30.824269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c859722e-78ea-4bed-82b1-1d85892444dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:30.824735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c859722e-78ea-4bed-82b1-1d85892444dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:30.830678 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b5b8a4e-3cc4-48a7-a675-6111e5c294d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:30.831133 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b5b8a4e-3cc4-48a7-a675-6111e5c294d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:30.831934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b5b8a4e-3cc4-48a7-a675-6111e5c294d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:30.832508 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0b5b8a4e-3cc4-48a7-a675-6111e5c294d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:31.020169 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0b5b8a4e-3cc4-48a7-a675-6111e5c294d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:31.024253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c859722e-78ea-4bed-82b1-1d85892444dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:31.028923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0b5b8a4e-3cc4-48a7-a675-6111e5c294d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:31.030788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0b5b8a4e-3cc4-48a7-a675-6111e5c294d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:31.031977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0b5b8a4e-3cc4-48a7-a675-6111e5c294d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.212827 Aug 01 15:54:31.032346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c859722e-78ea-4bed-82b1-1d85892444dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.220549 Aug 01 15:54:31.032536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1047/2420] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:31.037024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1374/2421] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:32.057550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f8ea8037-045f-4913-a7c3-c2cba5c2673b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:32.058192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f8ea8037-045f-4913-a7c3-c2cba5c2673b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:32.058937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-302311dc-a396-4284-86a5-7d4b5b45a810 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:32.059553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-302311dc-a396-4284-86a5-7d4b5b45a810 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:32.064676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8ea8037-045f-4913-a7c3-c2cba5c2673b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:32.065125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8ea8037-045f-4913-a7c3-c2cba5c2673b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:32.065875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-302311dc-a396-4284-86a5-7d4b5b45a810 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:32.066035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8ea8037-045f-4913-a7c3-c2cba5c2673b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:32.066342 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8ea8037-045f-4913-a7c3-c2cba5c2673b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:32.066454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-302311dc-a396-4284-86a5-7d4b5b45a810 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:32.067112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-302311dc-a396-4284-86a5-7d4b5b45a810 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:32.068127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-302311dc-a396-4284-86a5-7d4b5b45a810 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:32.263179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f8ea8037-045f-4913-a7c3-c2cba5c2673b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:32.266314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-302311dc-a396-4284-86a5-7d4b5b45a810 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:32.271722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f8ea8037-045f-4913-a7c3-c2cba5c2673b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:32.273307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f8ea8037-045f-4913-a7c3-c2cba5c2673b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:32.274356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-302311dc-a396-4284-86a5-7d4b5b45a810 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.219888 Aug 01 15:54:32.274686 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f8ea8037-045f-4913-a7c3-c2cba5c2673b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.221422 Aug 01 15:54:32.274939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1375/2422] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:32 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:32.275594 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1048/2423] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:33.296473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-98e719d4-0c36-4b4a-bfa3-b8bbab589f67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:33.297118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-98e719d4-0c36-4b4a-bfa3-b8bbab589f67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:33.297873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d1b2f629-3fed-4a28-ad07-31456ebdc10c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:33.298511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d1b2f629-3fed-4a28-ad07-31456ebdc10c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:33.303804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98e719d4-0c36-4b4a-bfa3-b8bbab589f67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:33.304241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98e719d4-0c36-4b4a-bfa3-b8bbab589f67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:33.305060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98e719d4-0c36-4b4a-bfa3-b8bbab589f67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:33.305433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98e719d4-0c36-4b4a-bfa3-b8bbab589f67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:33.308647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1b2f629-3fed-4a28-ad07-31456ebdc10c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:33.309105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1b2f629-3fed-4a28-ad07-31456ebdc10c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:33.309913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1b2f629-3fed-4a28-ad07-31456ebdc10c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:33.310366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1b2f629-3fed-4a28-ad07-31456ebdc10c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:33.500328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-98e719d4-0c36-4b4a-bfa3-b8bbab589f67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:33.504248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d1b2f629-3fed-4a28-ad07-31456ebdc10c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:33.509164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-98e719d4-0c36-4b4a-bfa3-b8bbab589f67 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.216587 Aug 01 15:54:33.509746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1376/2424] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:33 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:33.513860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d1b2f629-3fed-4a28-ad07-31456ebdc10c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:33.515375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d1b2f629-3fed-4a28-ad07-31456ebdc10c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:33.516520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d1b2f629-3fed-4a28-ad07-31456ebdc10c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.222610 Aug 01 15:54:33.517064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1049/2425] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:34.530640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a57ad15e-b714-4ecf-9667-7db0659b2ded tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:34.531258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a57ad15e-b714-4ecf-9667-7db0659b2ded tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:34.538702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a57ad15e-b714-4ecf-9667-7db0659b2ded tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:34.539074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f8f1b7a0-2322-46b6-9a4f-6506d5e4a4ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:34.539636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a57ad15e-b714-4ecf-9667-7db0659b2ded tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:34.539792 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f8f1b7a0-2322-46b6-9a4f-6506d5e4a4ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:34.539962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a57ad15e-b714-4ecf-9667-7db0659b2ded tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:34.540347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a57ad15e-b714-4ecf-9667-7db0659b2ded tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:34.546781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8f1b7a0-2322-46b6-9a4f-6506d5e4a4ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:34.547232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8f1b7a0-2322-46b6-9a4f-6506d5e4a4ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:34.547999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8f1b7a0-2322-46b6-9a4f-6506d5e4a4ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:34.548435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8f1b7a0-2322-46b6-9a4f-6506d5e4a4ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:34.738023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a57ad15e-b714-4ecf-9667-7db0659b2ded tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:34.742765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f8f1b7a0-2322-46b6-9a4f-6506d5e4a4ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:34.747195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a57ad15e-b714-4ecf-9667-7db0659b2ded tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.220370 Aug 01 15:54:34.747768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1377/2426] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:34 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:34.751259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f8f1b7a0-2322-46b6-9a4f-6506d5e4a4ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:34.752779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f8f1b7a0-2322-46b6-9a4f-6506d5e4a4ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:34.753967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f8f1b7a0-2322-46b6-9a4f-6506d5e4a4ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.219324 Aug 01 15:54:34.754511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1050/2427] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:35.768833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1f93b783-d15d-4df3-ae86-43d15cdad979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:35.769443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1f93b783-d15d-4df3-ae86-43d15cdad979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:35.776470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f93b783-d15d-4df3-ae86-43d15cdad979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:35.776738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f44c7d46-40ab-4fe2-ad3e-2b82a8a38eec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:35.777263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f93b783-d15d-4df3-ae86-43d15cdad979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:35.777371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f44c7d46-40ab-4fe2-ad3e-2b82a8a38eec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:35.777673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f93b783-d15d-4df3-ae86-43d15cdad979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:35.778129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f93b783-d15d-4df3-ae86-43d15cdad979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:35.784395 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f44c7d46-40ab-4fe2-ad3e-2b82a8a38eec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:35.784834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f44c7d46-40ab-4fe2-ad3e-2b82a8a38eec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:35.785615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f44c7d46-40ab-4fe2-ad3e-2b82a8a38eec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:35.786074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f44c7d46-40ab-4fe2-ad3e-2b82a8a38eec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:35.972071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f44c7d46-40ab-4fe2-ad3e-2b82a8a38eec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:35.979670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1f93b783-d15d-4df3-ae86-43d15cdad979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:35.981325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f44c7d46-40ab-4fe2-ad3e-2b82a8a38eec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:35.983835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f44c7d46-40ab-4fe2-ad3e-2b82a8a38eec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:35.984460 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f44c7d46-40ab-4fe2-ad3e-2b82a8a38eec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.211766 Aug 01 15:54:35.985023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1051/2428] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:35.991492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1f93b783-d15d-4df3-ae86-43d15cdad979 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.226608 Aug 01 15:54:35.992270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1378/2429] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:35 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:36.526328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:54:36.526607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:54:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:54:37.007756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-03cf0333-2b9d-4394-b531-872cd9a6444e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:37.008698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-03cf0333-2b9d-4394-b531-872cd9a6444e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:37.012649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3a334c51-17ca-42ce-83e5-acdcbb0d4238 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:37.013271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3a334c51-17ca-42ce-83e5-acdcbb0d4238 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:37.015358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03cf0333-2b9d-4394-b531-872cd9a6444e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:37.015801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03cf0333-2b9d-4394-b531-872cd9a6444e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:37.016571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03cf0333-2b9d-4394-b531-872cd9a6444e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:37.017000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03cf0333-2b9d-4394-b531-872cd9a6444e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:37.019833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3a334c51-17ca-42ce-83e5-acdcbb0d4238 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:37.020286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3a334c51-17ca-42ce-83e5-acdcbb0d4238 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:37.021055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3a334c51-17ca-42ce-83e5-acdcbb0d4238 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:37.021492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3a334c51-17ca-42ce-83e5-acdcbb0d4238 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:37.233332 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-03cf0333-2b9d-4394-b531-872cd9a6444e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:37.236536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3a334c51-17ca-42ce-83e5-acdcbb0d4238 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:37.242345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-03cf0333-2b9d-4394-b531-872cd9a6444e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:37.243948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-03cf0333-2b9d-4394-b531-872cd9a6444e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:37.244602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3a334c51-17ca-42ce-83e5-acdcbb0d4238 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.236084 Aug 01 15:54:37.245124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-03cf0333-2b9d-4394-b531-872cd9a6444e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.241320 Aug 01 15:54:37.245302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1379/2430] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:37 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:37.245756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1052/2431] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:38.266122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2734c48e-4a11-4026-9aab-509a663ace68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:38.266746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2734c48e-4a11-4026-9aab-509a663ace68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:38.267443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-06dacf57-bd4a-4171-9d68-ebe503013b6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:38.268055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-06dacf57-bd4a-4171-9d68-ebe503013b6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:38.273326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2734c48e-4a11-4026-9aab-509a663ace68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:38.273782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2734c48e-4a11-4026-9aab-509a663ace68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:38.274586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2734c48e-4a11-4026-9aab-509a663ace68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:38.274782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06dacf57-bd4a-4171-9d68-ebe503013b6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:38.275029 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2734c48e-4a11-4026-9aab-509a663ace68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:38.275227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06dacf57-bd4a-4171-9d68-ebe503013b6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:38.275980 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06dacf57-bd4a-4171-9d68-ebe503013b6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:38.276416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06dacf57-bd4a-4171-9d68-ebe503013b6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:38.470089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2734c48e-4a11-4026-9aab-509a663ace68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:38.473253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-06dacf57-bd4a-4171-9d68-ebe503013b6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:38.479027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2734c48e-4a11-4026-9aab-509a663ace68 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.216811 Aug 01 15:54:38.479605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1380/2432] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:38 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:38.482757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-06dacf57-bd4a-4171-9d68-ebe503013b6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:38.484273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-06dacf57-bd4a-4171-9d68-ebe503013b6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:38.485433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-06dacf57-bd4a-4171-9d68-ebe503013b6a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.221833 Aug 01 15:54:38.485998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1053/2433] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:39.501678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e18d5652-ded1-4a3e-965f-008a173212e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:39.502751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e18d5652-ded1-4a3e-965f-008a173212e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:39.508433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c35d5d7a-9999-4575-ac45-0819deb41d8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:39.509061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c35d5d7a-9999-4575-ac45-0819deb41d8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:39.509785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e18d5652-ded1-4a3e-965f-008a173212e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:39.510271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e18d5652-ded1-4a3e-965f-008a173212e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:39.511053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e18d5652-ded1-4a3e-965f-008a173212e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:39.511488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e18d5652-ded1-4a3e-965f-008a173212e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:39.515465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c35d5d7a-9999-4575-ac45-0819deb41d8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:39.515915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c35d5d7a-9999-4575-ac45-0819deb41d8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:39.516689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c35d5d7a-9999-4575-ac45-0819deb41d8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:39.517127 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c35d5d7a-9999-4575-ac45-0819deb41d8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:39.537010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:39.711365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e18d5652-ded1-4a3e-965f-008a173212e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:39.714323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c35d5d7a-9999-4575-ac45-0819deb41d8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:39.719600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e18d5652-ded1-4a3e-965f-008a173212e9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.221873 Aug 01 15:54:39.720480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1381/2434] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:39 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:39.723294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c35d5d7a-9999-4575-ac45-0819deb41d8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:39.725347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c35d5d7a-9999-4575-ac45-0819deb41d8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:39.726532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c35d5d7a-9999-4575-ac45-0819deb41d8a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.221997 Aug 01 15:54:39.727226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1054/2435] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:40.742151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-78f477a4-4686-4252-88b2-1554dd62890d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:40.742793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-78f477a4-4686-4252-88b2-1554dd62890d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:40.749287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78f477a4-4686-4252-88b2-1554dd62890d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:40.749453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-24eb0373-8697-48dc-8349-b8f97de39c1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:40.749866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78f477a4-4686-4252-88b2-1554dd62890d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:40.750063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-24eb0373-8697-48dc-8349-b8f97de39c1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:40.750899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78f477a4-4686-4252-88b2-1554dd62890d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:40.751427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78f477a4-4686-4252-88b2-1554dd62890d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:40.757121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-24eb0373-8697-48dc-8349-b8f97de39c1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:40.757576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-24eb0373-8697-48dc-8349-b8f97de39c1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:40.758375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-24eb0373-8697-48dc-8349-b8f97de39c1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:40.758813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-24eb0373-8697-48dc-8349-b8f97de39c1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:40.946790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-78f477a4-4686-4252-88b2-1554dd62890d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:40.953065 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-24eb0373-8697-48dc-8349-b8f97de39c1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:40.954863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-78f477a4-4686-4252-88b2-1554dd62890d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.216526 Aug 01 15:54:40.955438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1382/2436] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:40 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:40.961702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-24eb0373-8697-48dc-8349-b8f97de39c1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:40.963239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-24eb0373-8697-48dc-8349-b8f97de39c1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:40.964381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-24eb0373-8697-48dc-8349-b8f97de39c1f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.218761 Aug 01 15:54:40.964919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1055/2437] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:41.976925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4b32d4a4-45d3-4116-84be-24a149d84bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:41.977536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4b32d4a4-45d3-4116-84be-24a149d84bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:41.984197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b32d4a4-45d3-4116-84be-24a149d84bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:41.984644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b32d4a4-45d3-4116-84be-24a149d84bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:41.985406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b32d4a4-45d3-4116-84be-24a149d84bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:41.985844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b32d4a4-45d3-4116-84be-24a149d84bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:41.987505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5cf7da19-36ff-4716-a3ac-3a6702c13e72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:41.988155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5cf7da19-36ff-4716-a3ac-3a6702c13e72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:41.994879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5cf7da19-36ff-4716-a3ac-3a6702c13e72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:41.995330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5cf7da19-36ff-4716-a3ac-3a6702c13e72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:41.996107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5cf7da19-36ff-4716-a3ac-3a6702c13e72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:41.996548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5cf7da19-36ff-4716-a3ac-3a6702c13e72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:42.004480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:42.183837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4b32d4a4-45d3-4116-84be-24a149d84bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:42.190914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5cf7da19-36ff-4716-a3ac-3a6702c13e72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:42.191881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4b32d4a4-45d3-4116-84be-24a149d84bea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.218971 Aug 01 15:54:42.192999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1383/2438] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:42.200156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5cf7da19-36ff-4716-a3ac-3a6702c13e72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:42.201674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5cf7da19-36ff-4716-a3ac-3a6702c13e72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:42.202866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5cf7da19-36ff-4716-a3ac-3a6702c13e72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.219257 Aug 01 15:54:42.203421 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1056/2439] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:43.215507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-47accfda-c3ce-4d04-a9a3-abec9efeb099 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:43.216889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-47accfda-c3ce-4d04-a9a3-abec9efeb099 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:43.224581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-47accfda-c3ce-4d04-a9a3-abec9efeb099 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:43.225106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-47accfda-c3ce-4d04-a9a3-abec9efeb099 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:43.225928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-47accfda-c3ce-4d04-a9a3-abec9efeb099 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:43.226364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-47accfda-c3ce-4d04-a9a3-abec9efeb099 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:43.226648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-feb227f6-fb0e-4177-bed3-d19aff8e47d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:43.227341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-feb227f6-fb0e-4177-bed3-d19aff8e47d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:43.229708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=50 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:54:43.235817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-feb227f6-fb0e-4177-bed3-d19aff8e47d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:43.236270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-feb227f6-fb0e-4177-bed3-d19aff8e47d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:43.237170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-feb227f6-fb0e-4177-bed3-d19aff8e47d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:43.237610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-feb227f6-fb0e-4177-bed3-d19aff8e47d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:43.438132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-47accfda-c3ce-4d04-a9a3-abec9efeb099 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:43.442704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-feb227f6-fb0e-4177-bed3-d19aff8e47d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:43.446767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-47accfda-c3ce-4d04-a9a3-abec9efeb099 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.235891 Aug 01 15:54:43.447624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1384/2440] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:43 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:43.452287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-feb227f6-fb0e-4177-bed3-d19aff8e47d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:43.453773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-feb227f6-fb0e-4177-bed3-d19aff8e47d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:43.454963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-feb227f6-fb0e-4177-bed3-d19aff8e47d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.232460 Aug 01 15:54:43.455504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1057/2441] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:44.468484 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e95380ef-ccbe-4b2d-bf65-9f7c77ad8b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:44.469102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e95380ef-ccbe-4b2d-bf65-9f7c77ad8b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:44.476628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e95380ef-ccbe-4b2d-bf65-9f7c77ad8b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:44.477076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e95380ef-ccbe-4b2d-bf65-9f7c77ad8b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:44.477844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e95380ef-ccbe-4b2d-bf65-9f7c77ad8b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:44.478310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e95380ef-ccbe-4b2d-bf65-9f7c77ad8b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:44.478888 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-dbc7c953-4580-425e-bf97-0d73ac32163a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:44.479501 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-dbc7c953-4580-425e-bf97-0d73ac32163a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:44.486190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dbc7c953-4580-425e-bf97-0d73ac32163a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:44.486671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dbc7c953-4580-425e-bf97-0d73ac32163a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:44.487399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dbc7c953-4580-425e-bf97-0d73ac32163a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:44.487841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dbc7c953-4580-425e-bf97-0d73ac32163a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:44.629559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dbc7c953-4580-425e-bf97-0d73ac32163a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:44.639172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dbc7c953-4580-425e-bf97-0d73ac32163a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:44.640654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dbc7c953-4580-425e-bf97-0d73ac32163a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:44.641824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-dbc7c953-4580-425e-bf97-0d73ac32163a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.166834 Aug 01 15:54:44.642390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1058/2442] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:44.772713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e95380ef-ccbe-4b2d-bf65-9f7c77ad8b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:44.780655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e95380ef-ccbe-4b2d-bf65-9f7c77ad8b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.315992 Aug 01 15:54:44.781213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1385/2443] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:44 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:45.665463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f062efde-0163-4f07-b228-a2b8475015ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:45.666104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f062efde-0163-4f07-b228-a2b8475015ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:45.672116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f062efde-0163-4f07-b228-a2b8475015ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:45.672604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f062efde-0163-4f07-b228-a2b8475015ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:45.673323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f062efde-0163-4f07-b228-a2b8475015ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:45.673768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f062efde-0163-4f07-b228-a2b8475015ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:45.802019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1af20b96-43cd-4bba-8bb5-086707db6b0c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:45.802643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1af20b96-43cd-4bba-8bb5-086707db6b0c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:45.802780 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f062efde-0163-4f07-b228-a2b8475015ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:45.809604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1af20b96-43cd-4bba-8bb5-086707db6b0c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:45.810109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1af20b96-43cd-4bba-8bb5-086707db6b0c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:45.810882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1af20b96-43cd-4bba-8bb5-086707db6b0c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:45.811320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1af20b96-43cd-4bba-8bb5-086707db6b0c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:45.811444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f062efde-0163-4f07-b228-a2b8475015ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:45.812902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f062efde-0163-4f07-b228-a2b8475015ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:45.814093 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f062efde-0163-4f07-b228-a2b8475015ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.153353 Aug 01 15:54:45.814645 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1059/2444] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:45.941515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1af20b96-43cd-4bba-8bb5-086707db6b0c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:45.950527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1af20b96-43cd-4bba-8bb5-086707db6b0c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.152352 Aug 01 15:54:45.951096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1386/2445] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:45 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:46.837842 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0362e129-b2db-41e5-aa6d-3403090c68ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:46.838479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0362e129-b2db-41e5-aa6d-3403090c68ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:46.845032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0362e129-b2db-41e5-aa6d-3403090c68ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:46.845482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0362e129-b2db-41e5-aa6d-3403090c68ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:46.846285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0362e129-b2db-41e5-aa6d-3403090c68ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:46.846730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0362e129-b2db-41e5-aa6d-3403090c68ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:46.972538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a8e7b15f-4b4e-4760-8d27-9991b6bf44a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:46.973985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a8e7b15f-4b4e-4760-8d27-9991b6bf44a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:46.978218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0362e129-b2db-41e5-aa6d-3403090c68ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:46.980600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8e7b15f-4b4e-4760-8d27-9991b6bf44a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:46.981053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8e7b15f-4b4e-4760-8d27-9991b6bf44a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:46.981833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8e7b15f-4b4e-4760-8d27-9991b6bf44a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:46.982303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8e7b15f-4b4e-4760-8d27-9991b6bf44a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:46.987264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0362e129-b2db-41e5-aa6d-3403090c68ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:46.988446 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0362e129-b2db-41e5-aa6d-3403090c68ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:46.989704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0362e129-b2db-41e5-aa6d-3403090c68ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.155763 Aug 01 15:54:46.990294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1060/2446] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:47.112674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a8e7b15f-4b4e-4760-8d27-9991b6bf44a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:47.120717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a8e7b15f-4b4e-4760-8d27-9991b6bf44a0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.152037 Aug 01 15:54:47.121280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1387/2447] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:46 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:48.012600 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a769c330-a3d0-406e-9e09-d2d369d007f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:48.013211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a769c330-a3d0-406e-9e09-d2d369d007f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:48.019888 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a769c330-a3d0-406e-9e09-d2d369d007f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:48.020335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a769c330-a3d0-406e-9e09-d2d369d007f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:48.021095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a769c330-a3d0-406e-9e09-d2d369d007f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:48.021531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a769c330-a3d0-406e-9e09-d2d369d007f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:48.142996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c3aee1ad-e90f-493d-b69d-71c95b8b08be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:48.143636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c3aee1ad-e90f-493d-b69d-71c95b8b08be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:48.150225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3aee1ad-e90f-493d-b69d-71c95b8b08be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:48.150627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3aee1ad-e90f-493d-b69d-71c95b8b08be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:48.151401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3aee1ad-e90f-493d-b69d-71c95b8b08be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:48.151833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3aee1ad-e90f-493d-b69d-71c95b8b08be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:48.152940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a769c330-a3d0-406e-9e09-d2d369d007f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:48.162033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a769c330-a3d0-406e-9e09-d2d369d007f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:48.163632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a769c330-a3d0-406e-9e09-d2d369d007f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:48.164900 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a769c330-a3d0-406e-9e09-d2d369d007f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.156265 Aug 01 15:54:48.165542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1061/2448] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:48.279598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c3aee1ad-e90f-493d-b69d-71c95b8b08be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:48.288123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c3aee1ad-e90f-493d-b69d-71c95b8b08be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.149094 Aug 01 15:54:48.288691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1388/2449] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:48 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:49.188362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c8e71189-6d46-4431-be99-9c61f4c227d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:49.189009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c8e71189-6d46-4431-be99-9c61f4c227d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:49.195689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8e71189-6d46-4431-be99-9c61f4c227d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:49.196144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8e71189-6d46-4431-be99-9c61f4c227d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:49.196904 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8e71189-6d46-4431-be99-9c61f4c227d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:49.197344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8e71189-6d46-4431-be99-9c61f4c227d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:49.310479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-703830a4-5057-4b49-bab3-82cf50857035 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:49.311183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-703830a4-5057-4b49-bab3-82cf50857035 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:49.317611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-703830a4-5057-4b49-bab3-82cf50857035 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:49.318097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-703830a4-5057-4b49-bab3-82cf50857035 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:49.318871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-703830a4-5057-4b49-bab3-82cf50857035 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:49.319306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-703830a4-5057-4b49-bab3-82cf50857035 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:49.328699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c8e71189-6d46-4431-be99-9c61f4c227d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:49.337644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c8e71189-6d46-4431-be99-9c61f4c227d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:49.339198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c8e71189-6d46-4431-be99-9c61f4c227d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:49.340364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c8e71189-6d46-4431-be99-9c61f4c227d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.155926 Aug 01 15:54:49.340971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1062/2450] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:49.447800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-703830a4-5057-4b49-bab3-82cf50857035 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:49.455712 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-703830a4-5057-4b49-bab3-82cf50857035 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.149244 Aug 01 15:54:49.456267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1389/2451] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:50.364543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fdd3d6e4-f6cf-4613-8e82-33d9a74357cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:50.365181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fdd3d6e4-f6cf-4613-8e82-33d9a74357cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:50.371855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdd3d6e4-f6cf-4613-8e82-33d9a74357cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:50.372308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdd3d6e4-f6cf-4613-8e82-33d9a74357cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:50.373105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdd3d6e4-f6cf-4613-8e82-33d9a74357cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:50.373547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdd3d6e4-f6cf-4613-8e82-33d9a74357cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:50.477193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6c00c695-e241-4eba-a86c-ade6b7a72b41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:50.477806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6c00c695-e241-4eba-a86c-ade6b7a72b41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:50.484277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c00c695-e241-4eba-a86c-ade6b7a72b41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:50.484730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c00c695-e241-4eba-a86c-ade6b7a72b41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:50.485486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c00c695-e241-4eba-a86c-ade6b7a72b41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:50.486051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c00c695-e241-4eba-a86c-ade6b7a72b41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:50.502010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fdd3d6e4-f6cf-4613-8e82-33d9a74357cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:50.510653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fdd3d6e4-f6cf-4613-8e82-33d9a74357cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:50.512161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fdd3d6e4-f6cf-4613-8e82-33d9a74357cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:50.513329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fdd3d6e4-f6cf-4613-8e82-33d9a74357cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.153338 Aug 01 15:54:50.513896 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1063/2452] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:50.618482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6c00c695-e241-4eba-a86c-ade6b7a72b41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:50.626346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6c00c695-e241-4eba-a86c-ade6b7a72b41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.153649 Aug 01 15:54:50.626900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1390/2453] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:50 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:51.538985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-778d7260-7af5-451e-b8a1-9ca9561d0a8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:51.539602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-778d7260-7af5-451e-b8a1-9ca9561d0a8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:51.546211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-778d7260-7af5-451e-b8a1-9ca9561d0a8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:51.546670 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-778d7260-7af5-451e-b8a1-9ca9561d0a8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:51.547430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-778d7260-7af5-451e-b8a1-9ca9561d0a8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:51.547867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-778d7260-7af5-451e-b8a1-9ca9561d0a8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:51.652796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-23b3fad3-dad6-4530-a4e2-95194c8f7e55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:51.653469 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-23b3fad3-dad6-4530-a4e2-95194c8f7e55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:51.659914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23b3fad3-dad6-4530-a4e2-95194c8f7e55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:51.660366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23b3fad3-dad6-4530-a4e2-95194c8f7e55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:51.661753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23b3fad3-dad6-4530-a4e2-95194c8f7e55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:51.662214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23b3fad3-dad6-4530-a4e2-95194c8f7e55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:51.678070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-778d7260-7af5-451e-b8a1-9ca9561d0a8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:51.686413 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-778d7260-7af5-451e-b8a1-9ca9561d0a8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:51.687902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-778d7260-7af5-451e-b8a1-9ca9561d0a8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:51.689060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-778d7260-7af5-451e-b8a1-9ca9561d0a8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.155082 Aug 01 15:54:51.689623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1064/2454] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:51.796838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-23b3fad3-dad6-4530-a4e2-95194c8f7e55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:51.805595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-23b3fad3-dad6-4530-a4e2-95194c8f7e55 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.156599 Aug 01 15:54:51.806204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1391/2455] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:51 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:52.712806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e34b2625-1415-4057-b4ac-6f5fb3d71a0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:52.713448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e34b2625-1415-4057-b4ac-6f5fb3d71a0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:52.719928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e34b2625-1415-4057-b4ac-6f5fb3d71a0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:52.720375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e34b2625-1415-4057-b4ac-6f5fb3d71a0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:52.721133 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e34b2625-1415-4057-b4ac-6f5fb3d71a0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:52.721570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e34b2625-1415-4057-b4ac-6f5fb3d71a0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:52.828481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-43b590f0-2214-42d0-a01d-ef6076d2c37f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:52.829195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-43b590f0-2214-42d0-a01d-ef6076d2c37f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:52.836862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43b590f0-2214-42d0-a01d-ef6076d2c37f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:52.837347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43b590f0-2214-42d0-a01d-ef6076d2c37f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:52.838111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43b590f0-2214-42d0-a01d-ef6076d2c37f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:52.838546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43b590f0-2214-42d0-a01d-ef6076d2c37f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:52.853674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e34b2625-1415-4057-b4ac-6f5fb3d71a0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:52.862157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e34b2625-1415-4057-b4ac-6f5fb3d71a0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:52.863702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e34b2625-1415-4057-b4ac-6f5fb3d71a0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:52.864906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e34b2625-1415-4057-b4ac-6f5fb3d71a0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.155986 Aug 01 15:54:52.865431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1065/2456] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:54:52.971743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-43b590f0-2214-42d0-a01d-ef6076d2c37f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:52.981727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-43b590f0-2214-42d0-a01d-ef6076d2c37f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.157530 Aug 01 15:54:52.982358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1392/2457] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:52 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:53.888336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8bdb8146-8d40-4ffb-a767-0c7a14caa273 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:53.888931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8bdb8146-8d40-4ffb-a767-0c7a14caa273 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:53.896147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8bdb8146-8d40-4ffb-a767-0c7a14caa273 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:53.896608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8bdb8146-8d40-4ffb-a767-0c7a14caa273 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:53.897375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8bdb8146-8d40-4ffb-a767-0c7a14caa273 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:53.897818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8bdb8146-8d40-4ffb-a767-0c7a14caa273 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:54.005596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e8b82f29-a3f2-4bfa-8d83-b40da0d788de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:54.006236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e8b82f29-a3f2-4bfa-8d83-b40da0d788de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:54.013175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8b82f29-a3f2-4bfa-8d83-b40da0d788de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:54.013627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8b82f29-a3f2-4bfa-8d83-b40da0d788de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:54.014445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8b82f29-a3f2-4bfa-8d83-b40da0d788de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:54.014879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8b82f29-a3f2-4bfa-8d83-b40da0d788de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:54.058070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8bdb8146-8d40-4ffb-a767-0c7a14caa273 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:54.069333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8bdb8146-8d40-4ffb-a767-0c7a14caa273 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:54.071002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8bdb8146-8d40-4ffb-a767-0c7a14caa273 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:54.072261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8bdb8146-8d40-4ffb-a767-0c7a14caa273 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.187855 Aug 01 15:54:54.072857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1066/2458] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:54.158666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e8b82f29-a3f2-4bfa-8d83-b40da0d788de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:54.166955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e8b82f29-a3f2-4bfa-8d83-b40da0d788de tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.165530 Aug 01 15:54:54.167540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1393/2459] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:54 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:55.096770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-09a009e0-6815-4dbf-a50c-c78a5ea0d1f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:55.097397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-09a009e0-6815-4dbf-a50c-c78a5ea0d1f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:55.105054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09a009e0-6815-4dbf-a50c-c78a5ea0d1f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:55.105523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09a009e0-6815-4dbf-a50c-c78a5ea0d1f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:55.106359 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09a009e0-6815-4dbf-a50c-c78a5ea0d1f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:55.106798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09a009e0-6815-4dbf-a50c-c78a5ea0d1f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:55.188576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2f1798c5-ff81-4834-935a-214462852053 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:55.189192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2f1798c5-ff81-4834-935a-214462852053 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:55.195765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f1798c5-ff81-4834-935a-214462852053 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:55.196217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f1798c5-ff81-4834-935a-214462852053 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:55.196991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f1798c5-ff81-4834-935a-214462852053 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:55.197432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f1798c5-ff81-4834-935a-214462852053 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:55.609617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-09a009e0-6815-4dbf-a50c-c78a5ea0d1f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:55.619791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-09a009e0-6815-4dbf-a50c-c78a5ea0d1f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:55.621404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-09a009e0-6815-4dbf-a50c-c78a5ea0d1f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:55.622729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-09a009e0-6815-4dbf-a50c-c78a5ea0d1f4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.529876 Aug 01 15:54:55.623342 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1067/2460] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:55.646191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2f1798c5-ff81-4834-935a-214462852053 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:55.654037 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2f1798c5-ff81-4834-935a-214462852053 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.469390 Aug 01 15:54:55.654603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1394/2461] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:55 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:56.646711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f046d97e-b27e-4dd0-954e-ea681bf9c93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:56.647329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f046d97e-b27e-4dd0-954e-ea681bf9c93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:56.654192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f046d97e-b27e-4dd0-954e-ea681bf9c93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:56.654649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f046d97e-b27e-4dd0-954e-ea681bf9c93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:56.655560 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f046d97e-b27e-4dd0-954e-ea681bf9c93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:56.656004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f046d97e-b27e-4dd0-954e-ea681bf9c93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:56.675954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a28be955-7da7-425b-802c-9e3ebe01fa77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:56.676567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a28be955-7da7-425b-802c-9e3ebe01fa77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:56.683193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a28be955-7da7-425b-802c-9e3ebe01fa77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:56.683647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a28be955-7da7-425b-802c-9e3ebe01fa77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:56.684414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a28be955-7da7-425b-802c-9e3ebe01fa77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:56.684852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a28be955-7da7-425b-802c-9e3ebe01fa77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:56.858683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f046d97e-b27e-4dd0-954e-ea681bf9c93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:56.865089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a28be955-7da7-425b-802c-9e3ebe01fa77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:56.868410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f046d97e-b27e-4dd0-954e-ea681bf9c93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:56.870408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f046d97e-b27e-4dd0-954e-ea681bf9c93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:56.871544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f046d97e-b27e-4dd0-954e-ea681bf9c93c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.229608 Aug 01 15:54:56.872098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1068/2462] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:56.873879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a28be955-7da7-425b-802c-9e3ebe01fa77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.201769 Aug 01 15:54:56.874498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1395/2463] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:56 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:57.895256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4d1f9cc4-a9fc-43c7-b76f-630ab0cd6d0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:57.895939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4d1f9cc4-a9fc-43c7-b76f-630ab0cd6d0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:57.896047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eec05479-7865-44c5-92a4-54fc6513437e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:57.896594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eec05479-7865-44c5-92a4-54fc6513437e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:57.903279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d1f9cc4-a9fc-43c7-b76f-630ab0cd6d0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:57.903881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d1f9cc4-a9fc-43c7-b76f-630ab0cd6d0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:57.904082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eec05479-7865-44c5-92a4-54fc6513437e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:57.904737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eec05479-7865-44c5-92a4-54fc6513437e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:57.905023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d1f9cc4-a9fc-43c7-b76f-630ab0cd6d0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:57.905620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d1f9cc4-a9fc-43c7-b76f-630ab0cd6d0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:57.905846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eec05479-7865-44c5-92a4-54fc6513437e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:57.906106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eec05479-7865-44c5-92a4-54fc6513437e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:58.104116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4d1f9cc4-a9fc-43c7-b76f-630ab0cd6d0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:58.108105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eec05479-7865-44c5-92a4-54fc6513437e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:58.112645 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4d1f9cc4-a9fc-43c7-b76f-630ab0cd6d0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:58.114241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4d1f9cc4-a9fc-43c7-b76f-630ab0cd6d0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:58.115411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4d1f9cc4-a9fc-43c7-b76f-630ab0cd6d0a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.224271 Aug 01 15:54:58.115968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1069/2464] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:54:58.116224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eec05479-7865-44c5-92a4-54fc6513437e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.224006 Aug 01 15:54:58.116793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1396/2465] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:57 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:54:59.137490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-317f316a-1fe1-4553-8ae7-4b8e4bde14dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:59.138159 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-317f316a-1fe1-4553-8ae7-4b8e4bde14dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:59.138324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6139613c-5a46-4854-a12a-f0195de4bdcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:54:59.138789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6139613c-5a46-4854-a12a-f0195de4bdcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:54:59.145252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-317f316a-1fe1-4553-8ae7-4b8e4bde14dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:59.145730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-317f316a-1fe1-4553-8ae7-4b8e4bde14dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:59.145909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6139613c-5a46-4854-a12a-f0195de4bdcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:59.146349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6139613c-5a46-4854-a12a-f0195de4bdcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:59.146603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-317f316a-1fe1-4553-8ae7-4b8e4bde14dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:59.147071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-317f316a-1fe1-4553-8ae7-4b8e4bde14dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:59.147238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6139613c-5a46-4854-a12a-f0195de4bdcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:54:59.148241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6139613c-5a46-4854-a12a-f0195de4bdcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:54:59.348609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-317f316a-1fe1-4553-8ae7-4b8e4bde14dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:59.357964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-317f316a-1fe1-4553-8ae7-4b8e4bde14dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.224156 Aug 01 15:54:59.359618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1070/2466] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:54:59 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:54:59.361365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6139613c-5a46-4854-a12a-f0195de4bdcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:59.374030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6139613c-5a46-4854-a12a-f0195de4bdcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:59.376837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6139613c-5a46-4854-a12a-f0195de4bdcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:54:59.378089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6139613c-5a46-4854-a12a-f0195de4bdcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.243777 Aug 01 15:54:59.378848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1397/2467] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:54:59 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:00.382370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ba90dfed-69e1-4323-a87b-76492283e897 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:00.382987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ba90dfed-69e1-4323-a87b-76492283e897 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:00.389519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba90dfed-69e1-4323-a87b-76492283e897 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:00.390000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba90dfed-69e1-4323-a87b-76492283e897 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:00.390765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba90dfed-69e1-4323-a87b-76492283e897 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:00.391201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ba90dfed-69e1-4323-a87b-76492283e897 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:00.395158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:00.406411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e3c73ba4-3953-4a5d-aa94-32772b405861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:00.407222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e3c73ba4-3953-4a5d-aa94-32772b405861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:00.409327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=50 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:00.415687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3c73ba4-3953-4a5d-aa94-32772b405861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:00.416133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3c73ba4-3953-4a5d-aa94-32772b405861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:00.416896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3c73ba4-3953-4a5d-aa94-32772b405861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:00.417325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3c73ba4-3953-4a5d-aa94-32772b405861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:00.632362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ba90dfed-69e1-4323-a87b-76492283e897 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:00.639323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e3c73ba4-3953-4a5d-aa94-32772b405861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:00.640682 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ba90dfed-69e1-4323-a87b-76492283e897 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.262192 Aug 01 15:55:00.641278 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1071/2468] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:00 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:00.648675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e3c73ba4-3953-4a5d-aa94-32772b405861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:00.650204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e3c73ba4-3953-4a5d-aa94-32772b405861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:00.651436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e3c73ba4-3953-4a5d-aa94-32772b405861 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.248907 Aug 01 15:55:00.651992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1398/2469] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:55:01.675171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d96c109b-d035-47e6-ac5e-e9cd518614fb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:01.675801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c1cb8373-f30b-4129-ae44-e9fd21cf0380 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:01.676165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d96c109b-d035-47e6-ac5e-e9cd518614fb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:01.676275 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c1cb8373-f30b-4129-ae44-e9fd21cf0380 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:01.684426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d96c109b-d035-47e6-ac5e-e9cd518614fb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:01.684426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d96c109b-d035-47e6-ac5e-e9cd518614fb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:01.684619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1cb8373-f30b-4129-ae44-e9fd21cf0380 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:01.684619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1cb8373-f30b-4129-ae44-e9fd21cf0380 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:01.684816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d96c109b-d035-47e6-ac5e-e9cd518614fb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:01.684816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d96c109b-d035-47e6-ac5e-e9cd518614fb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:01.684978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1cb8373-f30b-4129-ae44-e9fd21cf0380 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:01.684978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c1cb8373-f30b-4129-ae44-e9fd21cf0380 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:01.901216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d96c109b-d035-47e6-ac5e-e9cd518614fb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:01.915956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d96c109b-d035-47e6-ac5e-e9cd518614fb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.244182 Aug 01 15:55:01.917143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1399/2470] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:01 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:55:01.919827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c1cb8373-f30b-4129-ae44-e9fd21cf0380 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:01.930281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c1cb8373-f30b-4129-ae44-e9fd21cf0380 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:01.931891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c1cb8373-f30b-4129-ae44-e9fd21cf0380 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:01.933179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c1cb8373-f30b-4129-ae44-e9fd21cf0380 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.261867 Aug 01 15:55:01.933830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1072/2471] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:55:02.939204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6b75a7cf-b5d2-4a23-8002-1e109bf8553d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:02.939855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6b75a7cf-b5d2-4a23-8002-1e109bf8553d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:02.947149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b75a7cf-b5d2-4a23-8002-1e109bf8553d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:02.947591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b75a7cf-b5d2-4a23-8002-1e109bf8553d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:02.948355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b75a7cf-b5d2-4a23-8002-1e109bf8553d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:02.948788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b75a7cf-b5d2-4a23-8002-1e109bf8553d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:02.952847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:02.964127 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-65f91cc5-3978-4ba5-8d32-cde0ef6bbb5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:02.965069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-65f91cc5-3978-4ba5-8d32-cde0ef6bbb5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:02.975021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f91cc5-3978-4ba5-8d32-cde0ef6bbb5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:02.975743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f91cc5-3978-4ba5-8d32-cde0ef6bbb5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:02.976684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f91cc5-3978-4ba5-8d32-cde0ef6bbb5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:02.977125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f91cc5-3978-4ba5-8d32-cde0ef6bbb5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:03.174269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6b75a7cf-b5d2-4a23-8002-1e109bf8553d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:03.179289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-65f91cc5-3978-4ba5-8d32-cde0ef6bbb5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:03.184029 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6b75a7cf-b5d2-4a23-8002-1e109bf8553d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.248637 Aug 01 15:55:03.184616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1400/2472] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:02 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:03.188109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-65f91cc5-3978-4ba5-8d32-cde0ef6bbb5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:03.189732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-65f91cc5-3978-4ba5-8d32-cde0ef6bbb5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:03.190880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-65f91cc5-3978-4ba5-8d32-cde0ef6bbb5d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.233607 Aug 01 15:55:03.191423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1073/2473] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:55:04.205946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-94c18cdd-8d4d-48c4-a92b-023ac725c473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:04.206557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-94c18cdd-8d4d-48c4-a92b-023ac725c473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:04.213647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-94c18cdd-8d4d-48c4-a92b-023ac725c473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:04.214130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-94c18cdd-8d4d-48c4-a92b-023ac725c473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:04.214419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c283b406-7a0f-4887-b7d6-b168b222047c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:04.214887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-94c18cdd-8d4d-48c4-a92b-023ac725c473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:04.215032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c283b406-7a0f-4887-b7d6-b168b222047c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:04.215311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-94c18cdd-8d4d-48c4-a92b-023ac725c473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:04.223189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c283b406-7a0f-4887-b7d6-b168b222047c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:04.224510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c283b406-7a0f-4887-b7d6-b168b222047c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:04.225370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c283b406-7a0f-4887-b7d6-b168b222047c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:04.225819 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c283b406-7a0f-4887-b7d6-b168b222047c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:04.416037 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-94c18cdd-8d4d-48c4-a92b-023ac725c473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:04.424182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-94c18cdd-8d4d-48c4-a92b-023ac725c473 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.222026 Aug 01 15:55:04.425002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1401/2474] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:04 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:04.432249 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c283b406-7a0f-4887-b7d6-b168b222047c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:04.447015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c283b406-7a0f-4887-b7d6-b168b222047c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:04.448541 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c283b406-7a0f-4887-b7d6-b168b222047c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:04.449688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c283b406-7a0f-4887-b7d6-b168b222047c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.239148 Aug 01 15:55:04.450636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1074/2475] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:04 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:05.445816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c085831d-d062-4646-97c6-a549c36829f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:05.446444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c085831d-d062-4646-97c6-a549c36829f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:05.453096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c085831d-d062-4646-97c6-a549c36829f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:05.453544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c085831d-d062-4646-97c6-a549c36829f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:05.454335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c085831d-d062-4646-97c6-a549c36829f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:05.454773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c085831d-d062-4646-97c6-a549c36829f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:05.473169 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ccac1907-1ec8-4cab-a413-ca28bcc87ed0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:05.474688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ccac1907-1ec8-4cab-a413-ca28bcc87ed0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:05.481098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccac1907-1ec8-4cab-a413-ca28bcc87ed0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:05.481550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccac1907-1ec8-4cab-a413-ca28bcc87ed0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:05.482350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccac1907-1ec8-4cab-a413-ca28bcc87ed0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:05.482793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccac1907-1ec8-4cab-a413-ca28bcc87ed0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:05.647891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c085831d-d062-4646-97c6-a549c36829f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:05.655906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c085831d-d062-4646-97c6-a549c36829f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.213995 Aug 01 15:55:05.656485 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1402/2476] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:05 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:05.670976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ccac1907-1ec8-4cab-a413-ca28bcc87ed0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:05.679508 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ccac1907-1ec8-4cab-a413-ca28bcc87ed0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:05.680985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ccac1907-1ec8-4cab-a413-ca28bcc87ed0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:05.682263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ccac1907-1ec8-4cab-a413-ca28bcc87ed0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.212834 Aug 01 15:55:05.683190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1075/2477] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:06.678122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1a0fe955-7564-4daa-8693-febf63cd26fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:06.678757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1a0fe955-7564-4daa-8693-febf63cd26fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:06.685363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1a0fe955-7564-4daa-8693-febf63cd26fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:06.685801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1a0fe955-7564-4daa-8693-febf63cd26fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:06.686604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1a0fe955-7564-4daa-8693-febf63cd26fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:06.687035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1a0fe955-7564-4daa-8693-febf63cd26fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:06.709484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e2596e74-0128-4ebe-8c47-4cdd326a6837 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:06.710353 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e2596e74-0128-4ebe-8c47-4cdd326a6837 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:06.717443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2596e74-0128-4ebe-8c47-4cdd326a6837 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:06.717776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2596e74-0128-4ebe-8c47-4cdd326a6837 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:06.718615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2596e74-0128-4ebe-8c47-4cdd326a6837 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:06.719059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2596e74-0128-4ebe-8c47-4cdd326a6837 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:06.876456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1a0fe955-7564-4daa-8693-febf63cd26fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:06.885215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1a0fe955-7564-4daa-8693-febf63cd26fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.210907 Aug 01 15:55:06.885973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1403/2478] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:06 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:06.900918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e2596e74-0128-4ebe-8c47-4cdd326a6837 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:06.911356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e2596e74-0128-4ebe-8c47-4cdd326a6837 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:06.912887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e2596e74-0128-4ebe-8c47-4cdd326a6837 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:06.914188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e2596e74-0128-4ebe-8c47-4cdd326a6837 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.209299 Aug 01 15:55:06.914797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1076/2479] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:07.907941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0b7d2459-abb3-4934-8f03-4e493a295f7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:07.908565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0b7d2459-abb3-4934-8f03-4e493a295f7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:07.917038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b7d2459-abb3-4934-8f03-4e493a295f7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:07.917628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b7d2459-abb3-4934-8f03-4e493a295f7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:07.918690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b7d2459-abb3-4934-8f03-4e493a295f7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:07.919157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b7d2459-abb3-4934-8f03-4e493a295f7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:07.937414 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8b8390d1-4f73-49b9-8a19-9d65cccd3d24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:07.938042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8b8390d1-4f73-49b9-8a19-9d65cccd3d24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:07.944859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b8390d1-4f73-49b9-8a19-9d65cccd3d24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:07.945583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b8390d1-4f73-49b9-8a19-9d65cccd3d24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:07.946460 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b8390d1-4f73-49b9-8a19-9d65cccd3d24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:07.946895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b8390d1-4f73-49b9-8a19-9d65cccd3d24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:08.143834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0b7d2459-abb3-4934-8f03-4e493a295f7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:08.152388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8b8390d1-4f73-49b9-8a19-9d65cccd3d24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:08.154378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0b7d2459-abb3-4934-8f03-4e493a295f7b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.250379 Aug 01 15:55:08.154945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1404/2480] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:07 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:08.162988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8b8390d1-4f73-49b9-8a19-9d65cccd3d24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:08.164518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8b8390d1-4f73-49b9-8a19-9d65cccd3d24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:08.165781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8b8390d1-4f73-49b9-8a19-9d65cccd3d24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.232267 Aug 01 15:55:08.166468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1077/2481] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:07 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:09.177853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a74fda26-92bd-48a8-b39b-ae5625a3ed02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:09.178518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a74fda26-92bd-48a8-b39b-ae5625a3ed02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:09.185371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a74fda26-92bd-48a8-b39b-ae5625a3ed02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:09.185823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a74fda26-92bd-48a8-b39b-ae5625a3ed02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:09.186628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a74fda26-92bd-48a8-b39b-ae5625a3ed02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:09.187064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a74fda26-92bd-48a8-b39b-ae5625a3ed02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:09.188841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-89260465-cffe-4c7e-87c8-13a9ee6d7e41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:09.189359 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-89260465-cffe-4c7e-87c8-13a9ee6d7e41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:09.196467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89260465-cffe-4c7e-87c8-13a9ee6d7e41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:09.196913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89260465-cffe-4c7e-87c8-13a9ee6d7e41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:09.197683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89260465-cffe-4c7e-87c8-13a9ee6d7e41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:09.198140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89260465-cffe-4c7e-87c8-13a9ee6d7e41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:09.390044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a74fda26-92bd-48a8-b39b-ae5625a3ed02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:09.393451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-89260465-cffe-4c7e-87c8-13a9ee6d7e41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:09.398417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a74fda26-92bd-48a8-b39b-ae5625a3ed02 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.224500 Aug 01 15:55:09.399087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1405/2482] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:09 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:09.402531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-89260465-cffe-4c7e-87c8-13a9ee6d7e41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:09.404014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-89260465-cffe-4c7e-87c8-13a9ee6d7e41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:09.405221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-89260465-cffe-4c7e-87c8-13a9ee6d7e41 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.220435 Aug 01 15:55:09.405864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1078/2483] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:10.424505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f33803b5-d107-4806-88a6-ec434cb27baa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:10.425601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f33803b5-d107-4806-88a6-ec434cb27baa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:10.428058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6551aee2-e9fb-4907-bb2c-781f848b9dd0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:10.428717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6551aee2-e9fb-4907-bb2c-781f848b9dd0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:10.435299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6551aee2-e9fb-4907-bb2c-781f848b9dd0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:10.435754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6551aee2-e9fb-4907-bb2c-781f848b9dd0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:10.436522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6551aee2-e9fb-4907-bb2c-781f848b9dd0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:10.436630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f33803b5-d107-4806-88a6-ec434cb27baa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:10.436963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6551aee2-e9fb-4907-bb2c-781f848b9dd0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:10.437299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f33803b5-d107-4806-88a6-ec434cb27baa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:10.438198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f33803b5-d107-4806-88a6-ec434cb27baa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:10.438638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f33803b5-d107-4806-88a6-ec434cb27baa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:10.639622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6551aee2-e9fb-4907-bb2c-781f848b9dd0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:10.643188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f33803b5-d107-4806-88a6-ec434cb27baa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:10.649289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6551aee2-e9fb-4907-bb2c-781f848b9dd0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:10.650828 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6551aee2-e9fb-4907-bb2c-781f848b9dd0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:10.652042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6551aee2-e9fb-4907-bb2c-781f848b9dd0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.227875 Aug 01 15:55:10.652175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f33803b5-d107-4806-88a6-ec434cb27baa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.234349 Aug 01 15:55:10.652594 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1079/2484] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:10 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:55:10.652746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1406/2485] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:10 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:11.674949 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-19d6ff80-7a4a-4d3e-a848-3f2050a6ac77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:11.675724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-19d6ff80-7a4a-4d3e-a848-3f2050a6ac77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:11.678693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-15e93c14-11e5-4852-91ed-08492d419ca7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:11.679305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-15e93c14-11e5-4852-91ed-08492d419ca7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:11.682936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19d6ff80-7a4a-4d3e-a848-3f2050a6ac77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:11.683387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19d6ff80-7a4a-4d3e-a848-3f2050a6ac77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:11.684215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19d6ff80-7a4a-4d3e-a848-3f2050a6ac77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:11.684826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19d6ff80-7a4a-4d3e-a848-3f2050a6ac77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:11.686800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-15e93c14-11e5-4852-91ed-08492d419ca7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:11.687257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-15e93c14-11e5-4852-91ed-08492d419ca7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:11.688024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-15e93c14-11e5-4852-91ed-08492d419ca7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:11.688463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-15e93c14-11e5-4852-91ed-08492d419ca7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:11.901646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-19d6ff80-7a4a-4d3e-a848-3f2050a6ac77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:11.910438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-19d6ff80-7a4a-4d3e-a848-3f2050a6ac77 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.239405 Aug 01 15:55:11.911517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1407/2486] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:11 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:11.913005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-15e93c14-11e5-4852-91ed-08492d419ca7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:11.921604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-15e93c14-11e5-4852-91ed-08492d419ca7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:11.923149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-15e93c14-11e5-4852-91ed-08492d419ca7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:11.924328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-15e93c14-11e5-4852-91ed-08492d419ca7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.250148 Aug 01 15:55:11.924997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1080/2487] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:11 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:12.935431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3f482da6-4ca2-465a-92d9-fe8a68e23413 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:12.935993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3f482da6-4ca2-465a-92d9-fe8a68e23413 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:12.943052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f482da6-4ca2-465a-92d9-fe8a68e23413 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:12.943502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f482da6-4ca2-465a-92d9-fe8a68e23413 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:12.944359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f482da6-4ca2-465a-92d9-fe8a68e23413 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:12.944817 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f482da6-4ca2-465a-92d9-fe8a68e23413 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:12.949368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-29e4f844-fe1d-4052-a0c5-df717755d5dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:12.950003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-29e4f844-fe1d-4052-a0c5-df717755d5dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:12.956741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-29e4f844-fe1d-4052-a0c5-df717755d5dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:12.957197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-29e4f844-fe1d-4052-a0c5-df717755d5dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:12.958653 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-29e4f844-fe1d-4052-a0c5-df717755d5dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:12.959097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-29e4f844-fe1d-4052-a0c5-df717755d5dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:13.152134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3f482da6-4ca2-465a-92d9-fe8a68e23413 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:13.156331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-29e4f844-fe1d-4052-a0c5-df717755d5dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:13.160627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3f482da6-4ca2-465a-92d9-fe8a68e23413 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.229205 Aug 01 15:55:13.161414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1408/2488] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:12 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:13.165510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-29e4f844-fe1d-4052-a0c5-df717755d5dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:13.167062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-29e4f844-fe1d-4052-a0c5-df717755d5dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:13.168240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-29e4f844-fe1d-4052-a0c5-df717755d5dd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.223250 Aug 01 15:55:13.168791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1081/2489] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:14.182633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-64c5ee3c-b540-480c-bad9-a7c99dd4bbeb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:14.183246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-64c5ee3c-b540-480c-bad9-a7c99dd4bbeb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:14.190049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64c5ee3c-b540-480c-bad9-a7c99dd4bbeb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:14.190488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64c5ee3c-b540-480c-bad9-a7c99dd4bbeb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:14.191255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64c5ee3c-b540-480c-bad9-a7c99dd4bbeb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:14.191510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ac4000cd-d651-4178-bff5-92c853612676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:14.191950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64c5ee3c-b540-480c-bad9-a7c99dd4bbeb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:14.192761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ac4000cd-d651-4178-bff5-92c853612676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:14.195498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=50 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:14.201172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac4000cd-d651-4178-bff5-92c853612676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:14.201623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac4000cd-d651-4178-bff5-92c853612676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:14.202470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac4000cd-d651-4178-bff5-92c853612676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:14.202913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac4000cd-d651-4178-bff5-92c853612676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:14.401999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-64c5ee3c-b540-480c-bad9-a7c99dd4bbeb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:14.405180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ac4000cd-d651-4178-bff5-92c853612676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:14.410246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-64c5ee3c-b540-480c-bad9-a7c99dd4bbeb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.231632 Aug 01 15:55:14.410828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1409/2490] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:14 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:14.413777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ac4000cd-d651-4178-bff5-92c853612676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:14.415301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ac4000cd-d651-4178-bff5-92c853612676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:14.416470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ac4000cd-d651-4178-bff5-92c853612676 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.228843 Aug 01 15:55:14.417023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1082/2491] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:15.431762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-05ba9bd5-00c6-4aac-888a-40fbcc6f45d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:15.432364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-05ba9bd5-00c6-4aac-888a-40fbcc6f45d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:15.439258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05ba9bd5-00c6-4aac-888a-40fbcc6f45d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:15.439711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05ba9bd5-00c6-4aac-888a-40fbcc6f45d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:15.440074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-30995b00-fe25-45ea-878e-7708fc35e89d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:15.440805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05ba9bd5-00c6-4aac-888a-40fbcc6f45d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:15.440981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-05ba9bd5-00c6-4aac-888a-40fbcc6f45d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:15.441165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-30995b00-fe25-45ea-878e-7708fc35e89d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:15.448386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30995b00-fe25-45ea-878e-7708fc35e89d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:15.448832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30995b00-fe25-45ea-878e-7708fc35e89d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:15.449620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30995b00-fe25-45ea-878e-7708fc35e89d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:15.450098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30995b00-fe25-45ea-878e-7708fc35e89d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:15.646093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-05ba9bd5-00c6-4aac-888a-40fbcc6f45d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:15.649055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-30995b00-fe25-45ea-878e-7708fc35e89d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:15.656049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-05ba9bd5-00c6-4aac-888a-40fbcc6f45d4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.227932 Aug 01 15:55:15.656552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1410/2492] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:15 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:15.658518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-30995b00-fe25-45ea-878e-7708fc35e89d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:15.660078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-30995b00-fe25-45ea-878e-7708fc35e89d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:15.661989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-30995b00-fe25-45ea-878e-7708fc35e89d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.225543 Aug 01 15:55:15.662553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1083/2493] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:16.681404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-265ac029-1a38-41ef-b18f-0d578e54191e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:16.682095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-265ac029-1a38-41ef-b18f-0d578e54191e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:16.684504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-25314247-e6c6-49b0-ba5f-1102b0c6dbfd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:16.685100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-25314247-e6c6-49b0-ba5f-1102b0c6dbfd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:16.689722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-265ac029-1a38-41ef-b18f-0d578e54191e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:16.690210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-265ac029-1a38-41ef-b18f-0d578e54191e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:16.691032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-265ac029-1a38-41ef-b18f-0d578e54191e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:16.691508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-265ac029-1a38-41ef-b18f-0d578e54191e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:16.691978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25314247-e6c6-49b0-ba5f-1102b0c6dbfd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:16.692931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25314247-e6c6-49b0-ba5f-1102b0c6dbfd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:16.693941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25314247-e6c6-49b0-ba5f-1102b0c6dbfd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:16.694812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25314247-e6c6-49b0-ba5f-1102b0c6dbfd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:16.894095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-265ac029-1a38-41ef-b18f-0d578e54191e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:16.901840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-25314247-e6c6-49b0-ba5f-1102b0c6dbfd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:16.902397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-265ac029-1a38-41ef-b18f-0d578e54191e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.225156 Aug 01 15:55:16.902984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1411/2494] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:16 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:16.910967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-25314247-e6c6-49b0-ba5f-1102b0c6dbfd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:16.912537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-25314247-e6c6-49b0-ba5f-1102b0c6dbfd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:16.913709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-25314247-e6c6-49b0-ba5f-1102b0c6dbfd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.233115 Aug 01 15:55:16.914297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1084/2495] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:16 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:17.924058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5976d622-b06f-4ed1-a1d6-820085801040 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:17.924705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5976d622-b06f-4ed1-a1d6-820085801040 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:17.931592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5976d622-b06f-4ed1-a1d6-820085801040 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:17.932051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5976d622-b06f-4ed1-a1d6-820085801040 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:17.932899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5976d622-b06f-4ed1-a1d6-820085801040 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:17.933344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5976d622-b06f-4ed1-a1d6-820085801040 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:17.936986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-26d6b6ac-5878-42a5-9c93-578f02f1e361 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:17.937827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-26d6b6ac-5878-42a5-9c93-578f02f1e361 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:17.945518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26d6b6ac-5878-42a5-9c93-578f02f1e361 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:17.946044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26d6b6ac-5878-42a5-9c93-578f02f1e361 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:17.947083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26d6b6ac-5878-42a5-9c93-578f02f1e361 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:17.947571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26d6b6ac-5878-42a5-9c93-578f02f1e361 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:18.132492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-26d6b6ac-5878-42a5-9c93-578f02f1e361 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:18.139459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5976d622-b06f-4ed1-a1d6-820085801040 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:18.140996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-26d6b6ac-5878-42a5-9c93-578f02f1e361 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:18.142574 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-26d6b6ac-5878-42a5-9c93-578f02f1e361 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:18.143756 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-26d6b6ac-5878-42a5-9c93-578f02f1e361 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.210819 Aug 01 15:55:18.144319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1085/2496] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:18.148307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5976d622-b06f-4ed1-a1d6-820085801040 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.228188 Aug 01 15:55:18.149189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1412/2497] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:17 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:19.167570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fbd98357-d6e0-40e9-9710-c2571e8d2ba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:19.168213 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fbd98357-d6e0-40e9-9710-c2571e8d2ba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:19.169653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-38bdaac0-17be-435c-a582-f8ac5c789094 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:19.170308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-38bdaac0-17be-435c-a582-f8ac5c789094 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:19.174893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fbd98357-d6e0-40e9-9710-c2571e8d2ba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:19.175344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fbd98357-d6e0-40e9-9710-c2571e8d2ba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:19.176120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fbd98357-d6e0-40e9-9710-c2571e8d2ba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:19.177001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38bdaac0-17be-435c-a582-f8ac5c789094 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:19.177144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fbd98357-d6e0-40e9-9710-c2571e8d2ba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:19.177457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38bdaac0-17be-435c-a582-f8ac5c789094 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:19.178257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38bdaac0-17be-435c-a582-f8ac5c789094 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:19.178697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38bdaac0-17be-435c-a582-f8ac5c789094 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:19.382865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fbd98357-d6e0-40e9-9710-c2571e8d2ba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:19.386892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-38bdaac0-17be-435c-a582-f8ac5c789094 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:19.392174 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fbd98357-d6e0-40e9-9710-c2571e8d2ba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:19.393683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fbd98357-d6e0-40e9-9710-c2571e8d2ba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:19.394885 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fbd98357-d6e0-40e9-9710-c2571e8d2ba5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.231321 Aug 01 15:55:19.395065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-38bdaac0-17be-435c-a582-f8ac5c789094 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.229223 Aug 01 15:55:19.395807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1086/2498] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:55:19.395948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1413/2499] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:19 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:55:20.417165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-62d82549-d0d1-4bed-bb4c-0b210b5e55a3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:20.418221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6b4c70c5-8d05-4701-a863-16a10b01bff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:20.418830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-62d82549-d0d1-4bed-bb4c-0b210b5e55a3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:20.419007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6b4c70c5-8d05-4701-a863-16a10b01bff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:20.424679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6b4c70c5-8d05-4701-a863-16a10b01bff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:20.424980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-62d82549-d0d1-4bed-bb4c-0b210b5e55a3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:20.425167 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6b4c70c5-8d05-4701-a863-16a10b01bff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:20.425388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-62d82549-d0d1-4bed-bb4c-0b210b5e55a3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:20.425988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6b4c70c5-8d05-4701-a863-16a10b01bff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:20.426214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-62d82549-d0d1-4bed-bb4c-0b210b5e55a3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:20.426450 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6b4c70c5-8d05-4701-a863-16a10b01bff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:20.426831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-62d82549-d0d1-4bed-bb4c-0b210b5e55a3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:20.634860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6b4c70c5-8d05-4701-a863-16a10b01bff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:20.638488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:20.639237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-62d82549-d0d1-4bed-bb4c-0b210b5e55a3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:20.644481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6b4c70c5-8d05-4701-a863-16a10b01bff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.231406 Aug 01 15:55:20.645323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1087/2500] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:20 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:20.648332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-62d82549-d0d1-4bed-bb4c-0b210b5e55a3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:20.649812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-62d82549-d0d1-4bed-bb4c-0b210b5e55a3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:20.651006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-62d82549-d0d1-4bed-bb4c-0b210b5e55a3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.237757 Aug 01 15:55:20.651554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1414/2501] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:55:21.668188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-293228fb-93b5-499a-802a-83f93777e49f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:21.668911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-293228fb-93b5-499a-802a-83f93777e49f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:21.674846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-85202add-4958-43a5-a18b-bcc86a34dbae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:21.675566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-85202add-4958-43a5-a18b-bcc86a34dbae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:21.675996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-293228fb-93b5-499a-802a-83f93777e49f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:21.677105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-293228fb-93b5-499a-802a-83f93777e49f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:21.678162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-293228fb-93b5-499a-802a-83f93777e49f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:21.678668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-293228fb-93b5-499a-802a-83f93777e49f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:21.683601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85202add-4958-43a5-a18b-bcc86a34dbae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:21.684048 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85202add-4958-43a5-a18b-bcc86a34dbae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:21.684844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85202add-4958-43a5-a18b-bcc86a34dbae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:21.685302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85202add-4958-43a5-a18b-bcc86a34dbae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:21.887055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-293228fb-93b5-499a-802a-83f93777e49f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:21.894524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-85202add-4958-43a5-a18b-bcc86a34dbae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:21.898838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-293228fb-93b5-499a-802a-83f93777e49f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.235252 Aug 01 15:55:21.899876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1088/2502] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:21 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:21.907506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-85202add-4958-43a5-a18b-bcc86a34dbae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:21.910286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-85202add-4958-43a5-a18b-bcc86a34dbae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:21.911346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-85202add-4958-43a5-a18b-bcc86a34dbae tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.240116 Aug 01 15:55:21.911987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1415/2503] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:22.922537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cb643c89-1ff0-4c19-a02f-49dfe913aa62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:22.923144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cb643c89-1ff0-4c19-a02f-49dfe913aa62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:22.931211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb643c89-1ff0-4c19-a02f-49dfe913aa62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:22.931662 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb643c89-1ff0-4c19-a02f-49dfe913aa62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:22.932437 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb643c89-1ff0-4c19-a02f-49dfe913aa62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:22.932870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cb643c89-1ff0-4c19-a02f-49dfe913aa62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:22.935057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d5a3a0d0-9fb7-406f-891e-9cd672d69aa8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:22.935766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d5a3a0d0-9fb7-406f-891e-9cd672d69aa8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:22.942643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5a3a0d0-9fb7-406f-891e-9cd672d69aa8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:22.943107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5a3a0d0-9fb7-406f-891e-9cd672d69aa8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:22.943892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5a3a0d0-9fb7-406f-891e-9cd672d69aa8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:22.944334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5a3a0d0-9fb7-406f-891e-9cd672d69aa8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:23.134431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cb643c89-1ff0-4c19-a02f-49dfe913aa62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:23.138372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d5a3a0d0-9fb7-406f-891e-9cd672d69aa8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:23.141708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:23.142705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cb643c89-1ff0-4c19-a02f-49dfe913aa62 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.223907 Aug 01 15:55:23.143368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1089/2504] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:22 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:23.148424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d5a3a0d0-9fb7-406f-891e-9cd672d69aa8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:23.149959 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d5a3a0d0-9fb7-406f-891e-9cd672d69aa8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:23.151142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d5a3a0d0-9fb7-406f-891e-9cd672d69aa8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.219885 Aug 01 15:55:23.151691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1416/2505] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:22 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:24.165083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-26561dac-93b6-46ea-bd0e-e28d2b53cff1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:24.165687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-26561dac-93b6-46ea-bd0e-e28d2b53cff1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:24.172992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26561dac-93b6-46ea-bd0e-e28d2b53cff1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:24.173436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26561dac-93b6-46ea-bd0e-e28d2b53cff1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:24.174268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26561dac-93b6-46ea-bd0e-e28d2b53cff1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:24.174850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-26561dac-93b6-46ea-bd0e-e28d2b53cff1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:24.174991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0854eae2-4111-466d-801d-cf1fd4674ba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:24.175624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0854eae2-4111-466d-801d-cf1fd4674ba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:24.184857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0854eae2-4111-466d-801d-cf1fd4674ba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:24.185324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0854eae2-4111-466d-801d-cf1fd4674ba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:24.186181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0854eae2-4111-466d-801d-cf1fd4674ba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:24.186619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0854eae2-4111-466d-801d-cf1fd4674ba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:24.385237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-26561dac-93b6-46ea-bd0e-e28d2b53cff1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:24.389818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0854eae2-4111-466d-801d-cf1fd4674ba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:24.396660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-26561dac-93b6-46ea-bd0e-e28d2b53cff1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.235789 Aug 01 15:55:24.397750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1090/2506] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:24 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:24.400467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0854eae2-4111-466d-801d-cf1fd4674ba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:24.402699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0854eae2-4111-466d-801d-cf1fd4674ba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:24.404276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0854eae2-4111-466d-801d-cf1fd4674ba1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.233355 Aug 01 15:55:24.409514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1417/2507] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:25.418620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1726bef6-69be-45b9-b368-0bc14f89a72d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:25.419237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1726bef6-69be-45b9-b368-0bc14f89a72d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:25.426013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1726bef6-69be-45b9-b368-0bc14f89a72d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:25.426522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1726bef6-69be-45b9-b368-0bc14f89a72d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:25.427306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1726bef6-69be-45b9-b368-0bc14f89a72d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:25.427763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1726bef6-69be-45b9-b368-0bc14f89a72d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:25.428646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bed8a8d3-11a0-4dfa-9820-e05259246aab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:25.429283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bed8a8d3-11a0-4dfa-9820-e05259246aab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:25.435867 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bed8a8d3-11a0-4dfa-9820-e05259246aab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:25.436307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bed8a8d3-11a0-4dfa-9820-e05259246aab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:25.437067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bed8a8d3-11a0-4dfa-9820-e05259246aab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:25.437492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bed8a8d3-11a0-4dfa-9820-e05259246aab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:25.631709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1726bef6-69be-45b9-b368-0bc14f89a72d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:25.638909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bed8a8d3-11a0-4dfa-9820-e05259246aab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:25.639873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1726bef6-69be-45b9-b368-0bc14f89a72d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.225079 Aug 01 15:55:25.640488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1091/2508] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:25 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:25.647978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bed8a8d3-11a0-4dfa-9820-e05259246aab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:25.649470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bed8a8d3-11a0-4dfa-9820-e05259246aab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:25.650656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bed8a8d3-11a0-4dfa-9820-e05259246aab tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.225986 Aug 01 15:55:25.651213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1418/2509] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:25 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:26.661303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c89524ce-602c-4004-a08a-59955b51c09a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:26.661862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c89524ce-602c-4004-a08a-59955b51c09a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:26.668824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c89524ce-602c-4004-a08a-59955b51c09a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:26.669266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c89524ce-602c-4004-a08a-59955b51c09a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:26.670074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c89524ce-602c-4004-a08a-59955b51c09a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:26.670512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c89524ce-602c-4004-a08a-59955b51c09a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:26.673447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c631bf71-e0ff-488e-9ea3-dba9ec07977e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:26.674158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c631bf71-e0ff-488e-9ea3-dba9ec07977e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:26.681424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c631bf71-e0ff-488e-9ea3-dba9ec07977e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:26.681874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c631bf71-e0ff-488e-9ea3-dba9ec07977e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:26.682686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c631bf71-e0ff-488e-9ea3-dba9ec07977e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:26.683120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c631bf71-e0ff-488e-9ea3-dba9ec07977e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:26.872704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c89524ce-602c-4004-a08a-59955b51c09a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:26.880106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c631bf71-e0ff-488e-9ea3-dba9ec07977e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:26.881453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c89524ce-602c-4004-a08a-59955b51c09a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.223998 Aug 01 15:55:26.882258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1092/2510] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:26 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:26.889498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c631bf71-e0ff-488e-9ea3-dba9ec07977e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:26.891067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c631bf71-e0ff-488e-9ea3-dba9ec07977e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:26.892248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c631bf71-e0ff-488e-9ea3-dba9ec07977e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.223008 Aug 01 15:55:26.892848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1419/2511] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:55:27.904566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-27480996-7b49-4967-b404-81f6fdfbf58e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:27.905172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-27480996-7b49-4967-b404-81f6fdfbf58e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:27.914024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27480996-7b49-4967-b404-81f6fdfbf58e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:27.914485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27480996-7b49-4967-b404-81f6fdfbf58e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:27.915313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27480996-7b49-4967-b404-81f6fdfbf58e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:27.915751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-27480996-7b49-4967-b404-81f6fdfbf58e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:27.918594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f446d526-c17d-4917-9204-e114a05a44ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:27.919544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f446d526-c17d-4917-9204-e114a05a44ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:27.932019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f446d526-c17d-4917-9204-e114a05a44ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:27.932950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f446d526-c17d-4917-9204-e114a05a44ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:27.933659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f446d526-c17d-4917-9204-e114a05a44ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:27.934130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f446d526-c17d-4917-9204-e114a05a44ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:28.363998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-27480996-7b49-4967-b404-81f6fdfbf58e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:28.373907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-27480996-7b49-4967-b404-81f6fdfbf58e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.473480 Aug 01 15:55:28.374509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1093/2512] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:27 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:55:28.380233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f446d526-c17d-4917-9204-e114a05a44ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:28.388887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f446d526-c17d-4917-9204-e114a05a44ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:28.390542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f446d526-c17d-4917-9204-e114a05a44ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:28.396976 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f446d526-c17d-4917-9204-e114a05a44ec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.482697 Aug 01 15:55:28.397558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1420/2513] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:55:29.395451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1e8cddda-ffa1-44d4-a779-89d1e7989f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:29.396066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1e8cddda-ffa1-44d4-a779-89d1e7989f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:29.402615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e8cddda-ffa1-44d4-a779-89d1e7989f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:29.403099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e8cddda-ffa1-44d4-a779-89d1e7989f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:29.403865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e8cddda-ffa1-44d4-a779-89d1e7989f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:29.404308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1e8cddda-ffa1-44d4-a779-89d1e7989f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:29.422273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1c54d748-e05c-4de3-8353-5cbd102391cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:29.422896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1c54d748-e05c-4de3-8353-5cbd102391cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:29.430212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c54d748-e05c-4de3-8353-5cbd102391cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:29.430667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c54d748-e05c-4de3-8353-5cbd102391cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:29.431443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c54d748-e05c-4de3-8353-5cbd102391cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:29.431886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c54d748-e05c-4de3-8353-5cbd102391cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:29.620788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1e8cddda-ffa1-44d4-a779-89d1e7989f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:29.629401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1e8cddda-ffa1-44d4-a779-89d1e7989f6d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.237745 Aug 01 15:55:29.630048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1094/2514] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:29 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:29.632255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1c54d748-e05c-4de3-8353-5cbd102391cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:29.640955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1c54d748-e05c-4de3-8353-5cbd102391cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:29.642501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1c54d748-e05c-4de3-8353-5cbd102391cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:29.643668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1c54d748-e05c-4de3-8353-5cbd102391cd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.225516 Aug 01 15:55:29.644226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1421/2515] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:30.649820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-daeccec1-96ea-4b5e-bb91-ed93e345acb7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:30.650397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-daeccec1-96ea-4b5e-bb91-ed93e345acb7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:30.656935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-daeccec1-96ea-4b5e-bb91-ed93e345acb7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:30.657554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-daeccec1-96ea-4b5e-bb91-ed93e345acb7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:30.658217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-daeccec1-96ea-4b5e-bb91-ed93e345acb7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:30.658666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-daeccec1-96ea-4b5e-bb91-ed93e345acb7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:30.667740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ce121052-a8de-4ed4-b07e-72e39010ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:30.668355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ce121052-a8de-4ed4-b07e-72e39010ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:30.670727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=48 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:30.677434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce121052-a8de-4ed4-b07e-72e39010ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:30.677902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce121052-a8de-4ed4-b07e-72e39010ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:30.678674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce121052-a8de-4ed4-b07e-72e39010ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:30.679104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce121052-a8de-4ed4-b07e-72e39010ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:30.857916 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-daeccec1-96ea-4b5e-bb91-ed93e345acb7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:30.866712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-daeccec1-96ea-4b5e-bb91-ed93e345acb7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.220727 Aug 01 15:55:30.867290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1095/2516] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:30.870560 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ce121052-a8de-4ed4-b07e-72e39010ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:30.879573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ce121052-a8de-4ed4-b07e-72e39010ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:30.881048 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ce121052-a8de-4ed4-b07e-72e39010ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:30.882660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ce121052-a8de-4ed4-b07e-72e39010ee03 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.218404 Aug 01 15:55:30.886052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1422/2517] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:31.888610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-838cb30f-4ab3-477c-a561-ea4900183b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:31.889215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-838cb30f-4ab3-477c-a561-ea4900183b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:31.896467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-838cb30f-4ab3-477c-a561-ea4900183b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:31.896921 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-838cb30f-4ab3-477c-a561-ea4900183b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:31.897696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-838cb30f-4ab3-477c-a561-ea4900183b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:31.898181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-838cb30f-4ab3-477c-a561-ea4900183b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:31.905565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6b2230a7-1caa-4322-b50c-08bcb2fc6d68 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:31.906216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6b2230a7-1caa-4322-b50c-08bcb2fc6d68 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:31.915726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b2230a7-1caa-4322-b50c-08bcb2fc6d68 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:31.916334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b2230a7-1caa-4322-b50c-08bcb2fc6d68 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:31.917120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b2230a7-1caa-4322-b50c-08bcb2fc6d68 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:31.917638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b2230a7-1caa-4322-b50c-08bcb2fc6d68 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:32.104954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-838cb30f-4ab3-477c-a561-ea4900183b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:32.111771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6b2230a7-1caa-4322-b50c-08bcb2fc6d68 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:32.113118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-838cb30f-4ab3-477c-a561-ea4900183b56 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.228812 Aug 01 15:55:32.113940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1096/2518] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:31 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:32.122071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6b2230a7-1caa-4322-b50c-08bcb2fc6d68 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:32.123622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6b2230a7-1caa-4322-b50c-08bcb2fc6d68 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:32.124791 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6b2230a7-1caa-4322-b50c-08bcb2fc6d68 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.223706 Aug 01 15:55:32.125348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1423/2519] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:33.135337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cce6fce7-9925-4870-8041-135b54e84806 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:33.135927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cce6fce7-9925-4870-8041-135b54e84806 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:33.142517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cce6fce7-9925-4870-8041-135b54e84806 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:33.142970 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cce6fce7-9925-4870-8041-135b54e84806 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:33.143733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cce6fce7-9925-4870-8041-135b54e84806 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:33.144177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cce6fce7-9925-4870-8041-135b54e84806 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:33.147793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f1ed5751-4186-4c69-8714-f448ae56b819 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:33.148403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f1ed5751-4186-4c69-8714-f448ae56b819 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:33.155003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1ed5751-4186-4c69-8714-f448ae56b819 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:33.155445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1ed5751-4186-4c69-8714-f448ae56b819 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:33.156329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1ed5751-4186-4c69-8714-f448ae56b819 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:33.156761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1ed5751-4186-4c69-8714-f448ae56b819 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:33.339646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cce6fce7-9925-4870-8041-135b54e84806 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:33.348043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cce6fce7-9925-4870-8041-135b54e84806 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.216582 Aug 01 15:55:33.349937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1097/2520] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:33 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:33.351982 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f1ed5751-4186-4c69-8714-f448ae56b819 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:33.360436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f1ed5751-4186-4c69-8714-f448ae56b819 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:33.361976 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f1ed5751-4186-4c69-8714-f448ae56b819 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:33.363131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f1ed5751-4186-4c69-8714-f448ae56b819 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.219259 Aug 01 15:55:33.363679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1424/2521] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:34.370547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-98955554-3d6d-4689-9125-dbc7799bc25e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:34.371157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-98955554-3d6d-4689-9125-dbc7799bc25e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:34.377986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-98955554-3d6d-4689-9125-dbc7799bc25e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:34.378439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-98955554-3d6d-4689-9125-dbc7799bc25e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:34.379208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-98955554-3d6d-4689-9125-dbc7799bc25e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:34.379646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-98955554-3d6d-4689-9125-dbc7799bc25e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:34.385600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9e98d7df-b823-4b4d-82d8-d7e146a04e23 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:34.386255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9e98d7df-b823-4b4d-82d8-d7e146a04e23 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:34.392829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e98d7df-b823-4b4d-82d8-d7e146a04e23 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:34.393281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e98d7df-b823-4b4d-82d8-d7e146a04e23 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:34.394077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e98d7df-b823-4b4d-82d8-d7e146a04e23 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:34.394522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9e98d7df-b823-4b4d-82d8-d7e146a04e23 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:34.579862 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-98955554-3d6d-4689-9125-dbc7799bc25e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:34.587833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9e98d7df-b823-4b4d-82d8-d7e146a04e23 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:34.589071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-98955554-3d6d-4689-9125-dbc7799bc25e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.222413 Aug 01 15:55:34.589786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1098/2522] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:34 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:34.596519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9e98d7df-b823-4b4d-82d8-d7e146a04e23 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:34.598044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9e98d7df-b823-4b4d-82d8-d7e146a04e23 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:34.599464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9e98d7df-b823-4b4d-82d8-d7e146a04e23 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.217739 Aug 01 15:55:34.600022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1425/2523] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:35.610969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-63f430f3-2762-420d-9260-aea9156d899b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:35.611563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-63f430f3-2762-420d-9260-aea9156d899b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:35.620183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-63f430f3-2762-420d-9260-aea9156d899b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:35.620879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-63f430f3-2762-420d-9260-aea9156d899b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:35.621819 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-63f430f3-2762-420d-9260-aea9156d899b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:35.622364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-63f430f3-2762-420d-9260-aea9156d899b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:35.623095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2503fcc0-d9e5-41f4-a8e4-53c6fa053416 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:35.623713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2503fcc0-d9e5-41f4-a8e4-53c6fa053416 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:35.631456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2503fcc0-d9e5-41f4-a8e4-53c6fa053416 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:35.631910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2503fcc0-d9e5-41f4-a8e4-53c6fa053416 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:35.632689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2503fcc0-d9e5-41f4-a8e4-53c6fa053416 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:35.633130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2503fcc0-d9e5-41f4-a8e4-53c6fa053416 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:35.830535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-63f430f3-2762-420d-9260-aea9156d899b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:35.837336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2503fcc0-d9e5-41f4-a8e4-53c6fa053416 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:35.841189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-63f430f3-2762-420d-9260-aea9156d899b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.234004 Aug 01 15:55:35.842200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1099/2524] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:35 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:55:35.847697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2503fcc0-d9e5-41f4-a8e4-53c6fa053416 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:35.850133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2503fcc0-d9e5-41f4-a8e4-53c6fa053416 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:35.851400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2503fcc0-d9e5-41f4-a8e4-53c6fa053416 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.233015 Aug 01 15:55:35.851955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1426/2525] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:36.865330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-81882e16-15bb-4952-b178-e7190cfa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:36.865930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-81882e16-15bb-4952-b178-e7190cfa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:36.873851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81882e16-15bb-4952-b178-e7190cfa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:36.874344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81882e16-15bb-4952-b178-e7190cfa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:36.875224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81882e16-15bb-4952-b178-e7190cfa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:36.875644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-81882e16-15bb-4952-b178-e7190cfa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:36.877608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dd0e062b-dc42-4f69-82ea-dd089973aac6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:36.878313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dd0e062b-dc42-4f69-82ea-dd089973aac6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:36.885742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd0e062b-dc42-4f69-82ea-dd089973aac6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:36.886229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd0e062b-dc42-4f69-82ea-dd089973aac6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:36.887009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd0e062b-dc42-4f69-82ea-dd089973aac6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:36.887681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd0e062b-dc42-4f69-82ea-dd089973aac6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:37.122145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-81882e16-15bb-4952-b178-e7190cfa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:37.129430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dd0e062b-dc42-4f69-82ea-dd089973aac6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:37.133206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-81882e16-15bb-4952-b178-e7190cfa3e9e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.272714 Aug 01 15:55:37.134059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1100/2526] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:36 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:37.139632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dd0e062b-dc42-4f69-82ea-dd089973aac6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:37.141205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dd0e062b-dc42-4f69-82ea-dd089973aac6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:37.142429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dd0e062b-dc42-4f69-82ea-dd089973aac6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.269248 Aug 01 15:55:37.143094 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1427/2527] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:38.155767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-18fa8e31-23c6-4f50-a0e1-2675f6b4151e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:38.156376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-18fa8e31-23c6-4f50-a0e1-2675f6b4151e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:38.164545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18fa8e31-23c6-4f50-a0e1-2675f6b4151e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:38.165044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18fa8e31-23c6-4f50-a0e1-2675f6b4151e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:38.165773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18fa8e31-23c6-4f50-a0e1-2675f6b4151e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:38.166243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18fa8e31-23c6-4f50-a0e1-2675f6b4151e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:38.167653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6279d930-f486-4e76-aa36-2184eb31e09f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:38.168302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6279d930-f486-4e76-aa36-2184eb31e09f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:38.175947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6279d930-f486-4e76-aa36-2184eb31e09f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:38.176414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6279d930-f486-4e76-aa36-2184eb31e09f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:38.177511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6279d930-f486-4e76-aa36-2184eb31e09f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:38.178115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6279d930-f486-4e76-aa36-2184eb31e09f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:38.384671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-18fa8e31-23c6-4f50-a0e1-2675f6b4151e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:38.394749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-18fa8e31-23c6-4f50-a0e1-2675f6b4151e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.242380 Aug 01 15:55:38.395226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1101/2528] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:38 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:38.398497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6279d930-f486-4e76-aa36-2184eb31e09f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:38.407700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6279d930-f486-4e76-aa36-2184eb31e09f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:38.409208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6279d930-f486-4e76-aa36-2184eb31e09f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:38.410469 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6279d930-f486-4e76-aa36-2184eb31e09f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.247067 Aug 01 15:55:38.410979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1428/2529] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:39.230421 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:55:39.231053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:55:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:55:39.417435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-eec91c77-e973-4b95-8f37-f7064794f6ef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:39.418142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-eec91c77-e973-4b95-8f37-f7064794f6ef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:39.425203 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eec91c77-e973-4b95-8f37-f7064794f6ef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:39.425666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eec91c77-e973-4b95-8f37-f7064794f6ef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:39.426505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eec91c77-e973-4b95-8f37-f7064794f6ef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:39.426943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eec91c77-e973-4b95-8f37-f7064794f6ef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:39.433149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2deb4613-46c3-4e48-b694-f8e33ab63b26 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:39.433782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2deb4613-46c3-4e48-b694-f8e33ab63b26 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:39.440465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2deb4613-46c3-4e48-b694-f8e33ab63b26 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:39.440914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2deb4613-46c3-4e48-b694-f8e33ab63b26 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:39.441690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2deb4613-46c3-4e48-b694-f8e33ab63b26 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:39.442152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2deb4613-46c3-4e48-b694-f8e33ab63b26 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:39.642377 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-eec91c77-e973-4b95-8f37-f7064794f6ef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:39.653209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-eec91c77-e973-4b95-8f37-f7064794f6ef tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.240244 Aug 01 15:55:39.654097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1102/2530] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:39 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:39.661869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2deb4613-46c3-4e48-b694-f8e33ab63b26 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:39.671345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2deb4613-46c3-4e48-b694-f8e33ab63b26 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:39.672783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2deb4613-46c3-4e48-b694-f8e33ab63b26 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:39.674826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2deb4613-46c3-4e48-b694-f8e33ab63b26 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.245391 Aug 01 15:55:39.675661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1429/2531] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:40.676020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a39d7900-b20f-40c4-b43f-5354bdf9dc4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:40.676701 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a39d7900-b20f-40c4-b43f-5354bdf9dc4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:40.684031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a39d7900-b20f-40c4-b43f-5354bdf9dc4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:40.684485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a39d7900-b20f-40c4-b43f-5354bdf9dc4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:40.685263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a39d7900-b20f-40c4-b43f-5354bdf9dc4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:40.685701 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a39d7900-b20f-40c4-b43f-5354bdf9dc4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:40.709722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bc3105ff-d85b-49a6-91c4-29f8af03b173 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:40.710377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bc3105ff-d85b-49a6-91c4-29f8af03b173 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:40.717150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc3105ff-d85b-49a6-91c4-29f8af03b173 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:40.717608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc3105ff-d85b-49a6-91c4-29f8af03b173 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:40.718428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc3105ff-d85b-49a6-91c4-29f8af03b173 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:40.718878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc3105ff-d85b-49a6-91c4-29f8af03b173 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:40.879468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a39d7900-b20f-40c4-b43f-5354bdf9dc4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:40.888558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a39d7900-b20f-40c4-b43f-5354bdf9dc4e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.216408 Aug 01 15:55:40.889132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1103/2532] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:40 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:40.914907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bc3105ff-d85b-49a6-91c4-29f8af03b173 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:40.924173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bc3105ff-d85b-49a6-91c4-29f8af03b173 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:40.925736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bc3105ff-d85b-49a6-91c4-29f8af03b173 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:40.927017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bc3105ff-d85b-49a6-91c4-29f8af03b173 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.222945 Aug 01 15:55:40.927498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1430/2533] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:41.911236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-478ae4e5-c2b5-49ab-bf38-69305833b666 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:41.911859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-478ae4e5-c2b5-49ab-bf38-69305833b666 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:41.919242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-478ae4e5-c2b5-49ab-bf38-69305833b666 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:41.919683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-478ae4e5-c2b5-49ab-bf38-69305833b666 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:41.920573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-478ae4e5-c2b5-49ab-bf38-69305833b666 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:41.921561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-478ae4e5-c2b5-49ab-bf38-69305833b666 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:41.943892 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:41.954033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2e3a811d-c886-475b-b17b-5785312aaf98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:41.955180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2e3a811d-c886-475b-b17b-5785312aaf98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:41.967138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e3a811d-c886-475b-b17b-5785312aaf98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:41.967842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e3a811d-c886-475b-b17b-5785312aaf98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:41.968640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e3a811d-c886-475b-b17b-5785312aaf98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:41.969251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e3a811d-c886-475b-b17b-5785312aaf98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:42.136997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-478ae4e5-c2b5-49ab-bf38-69305833b666 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:42.145570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-478ae4e5-c2b5-49ab-bf38-69305833b666 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.238163 Aug 01 15:55:42.146197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1104/2534] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:42.172163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2e3a811d-c886-475b-b17b-5785312aaf98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:42.182055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2e3a811d-c886-475b-b17b-5785312aaf98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:42.183517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2e3a811d-c886-475b-b17b-5785312aaf98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:42.184694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2e3a811d-c886-475b-b17b-5785312aaf98 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.237241 Aug 01 15:55:42.185290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1431/2535] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:55:43.167694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ec9706f7-972e-4208-be84-af8d3a676caf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:43.168277 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ec9706f7-972e-4208-be84-af8d3a676caf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:43.175101 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec9706f7-972e-4208-be84-af8d3a676caf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:43.175558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec9706f7-972e-4208-be84-af8d3a676caf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:43.176439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec9706f7-972e-4208-be84-af8d3a676caf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:43.176948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec9706f7-972e-4208-be84-af8d3a676caf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:43.208632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-efcaf8b3-49f1-4b33-909a-9e5977ed3920 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:43.210260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-efcaf8b3-49f1-4b33-909a-9e5977ed3920 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:43.217618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efcaf8b3-49f1-4b33-909a-9e5977ed3920 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:43.218114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efcaf8b3-49f1-4b33-909a-9e5977ed3920 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:43.218899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efcaf8b3-49f1-4b33-909a-9e5977ed3920 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:43.219335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efcaf8b3-49f1-4b33-909a-9e5977ed3920 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:43.372585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ec9706f7-972e-4208-be84-af8d3a676caf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:43.380919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ec9706f7-972e-4208-be84-af8d3a676caf tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.216994 Aug 01 15:55:43.395391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1105/2536] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:43 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:43.405153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-efcaf8b3-49f1-4b33-909a-9e5977ed3920 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:43.413798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-efcaf8b3-49f1-4b33-909a-9e5977ed3920 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:43.415374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-efcaf8b3-49f1-4b33-909a-9e5977ed3920 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:43.416557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-efcaf8b3-49f1-4b33-909a-9e5977ed3920 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.212163 Aug 01 15:55:43.417222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1432/2537] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:44.404757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8ea4b5aa-5059-40e4-9783-ebfe92763cec tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:44.405365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8ea4b5aa-5059-40e4-9783-ebfe92763cec tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:44.408427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=48 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:44.414718 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ea4b5aa-5059-40e4-9783-ebfe92763cec tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:44.415212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ea4b5aa-5059-40e4-9783-ebfe92763cec tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:44.416011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ea4b5aa-5059-40e4-9783-ebfe92763cec tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:44.416441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8ea4b5aa-5059-40e4-9783-ebfe92763cec tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:44.440699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5a0761bf-1d01-4265-8735-0e41ead0f9b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:44.441467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5a0761bf-1d01-4265-8735-0e41ead0f9b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:44.450587 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a0761bf-1d01-4265-8735-0e41ead0f9b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:44.451116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a0761bf-1d01-4265-8735-0e41ead0f9b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:44.451803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a0761bf-1d01-4265-8735-0e41ead0f9b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:44.453759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a0761bf-1d01-4265-8735-0e41ead0f9b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:44.473412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:55:44.620832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8ea4b5aa-5059-40e4-9783-ebfe92763cec tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:44.630368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8ea4b5aa-5059-40e4-9783-ebfe92763cec tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.230700 Aug 01 15:55:44.630996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1106/2538] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:44 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:44.644056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5a0761bf-1d01-4265-8735-0e41ead0f9b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:44.653574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5a0761bf-1d01-4265-8735-0e41ead0f9b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:44.655133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5a0761bf-1d01-4265-8735-0e41ead0f9b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:44.656297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5a0761bf-1d01-4265-8735-0e41ead0f9b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.219623 Aug 01 15:55:44.656860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1433/2539] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:45.653681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8954735c-01d8-451b-91e5-291d15d6e8bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:45.654318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8954735c-01d8-451b-91e5-291d15d6e8bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:45.660516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8954735c-01d8-451b-91e5-291d15d6e8bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:45.660957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8954735c-01d8-451b-91e5-291d15d6e8bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:45.661731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8954735c-01d8-451b-91e5-291d15d6e8bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:45.662196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8954735c-01d8-451b-91e5-291d15d6e8bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:45.680235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e6167de6-060a-4a55-b50c-f66f0bb98511 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:45.680895 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e6167de6-060a-4a55-b50c-f66f0bb98511 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:45.687635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6167de6-060a-4a55-b50c-f66f0bb98511 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:45.688108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6167de6-060a-4a55-b50c-f66f0bb98511 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:45.688977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6167de6-060a-4a55-b50c-f66f0bb98511 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:45.689358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6167de6-060a-4a55-b50c-f66f0bb98511 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:45.892437 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8954735c-01d8-451b-91e5-291d15d6e8bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:45.904888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e6167de6-060a-4a55-b50c-f66f0bb98511 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:45.905124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8954735c-01d8-451b-91e5-291d15d6e8bc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.255340 Aug 01 15:55:45.906144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1107/2540] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:45 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:45.915416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e6167de6-060a-4a55-b50c-f66f0bb98511 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:45.917531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e6167de6-060a-4a55-b50c-f66f0bb98511 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:45.918945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e6167de6-060a-4a55-b50c-f66f0bb98511 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.242799 Aug 01 15:55:45.919518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1434/2541] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:46.226441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:55:46.226664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:55:46.928984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6fb92922-f774-44ba-ae47-0b372a46e47a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:46.929813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6fb92922-f774-44ba-ae47-0b372a46e47a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:46.936237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6fb92922-f774-44ba-ae47-0b372a46e47a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:46.936688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6fb92922-f774-44ba-ae47-0b372a46e47a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:46.937465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6fb92922-f774-44ba-ae47-0b372a46e47a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:46.937914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6fb92922-f774-44ba-ae47-0b372a46e47a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:46.943053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7993b4c0-0ac8-4a98-a0a9-2491a928fc89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:46.943831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7993b4c0-0ac8-4a98-a0a9-2491a928fc89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:46.954385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7993b4c0-0ac8-4a98-a0a9-2491a928fc89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:46.955176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7993b4c0-0ac8-4a98-a0a9-2491a928fc89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:46.956545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7993b4c0-0ac8-4a98-a0a9-2491a928fc89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:46.957309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7993b4c0-0ac8-4a98-a0a9-2491a928fc89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:47.162971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6fb92922-f774-44ba-ae47-0b372a46e47a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:47.167412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7993b4c0-0ac8-4a98-a0a9-2491a928fc89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:47.171327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6fb92922-f774-44ba-ae47-0b372a46e47a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.247014 Aug 01 15:55:47.171910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1108/2542] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:46 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:47.176973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7993b4c0-0ac8-4a98-a0a9-2491a928fc89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:47.179384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7993b4c0-0ac8-4a98-a0a9-2491a928fc89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:47.180788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7993b4c0-0ac8-4a98-a0a9-2491a928fc89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.241314 Aug 01 15:55:47.181268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1435/2543] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:55:48.198760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-23f3e22a-3a8a-4bc6-a282-078430100da6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:48.199383 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-23f3e22a-3a8a-4bc6-a282-078430100da6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:48.207577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23f3e22a-3a8a-4bc6-a282-078430100da6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:48.208065 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23f3e22a-3a8a-4bc6-a282-078430100da6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:48.209141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23f3e22a-3a8a-4bc6-a282-078430100da6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:48.209826 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23f3e22a-3a8a-4bc6-a282-078430100da6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:48.210171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6817ec86-d52f-4160-97b0-0c1a43d15c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:48.211806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6817ec86-d52f-4160-97b0-0c1a43d15c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:48.221150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6817ec86-d52f-4160-97b0-0c1a43d15c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:48.222012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6817ec86-d52f-4160-97b0-0c1a43d15c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:48.223359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6817ec86-d52f-4160-97b0-0c1a43d15c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:48.224346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6817ec86-d52f-4160-97b0-0c1a43d15c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:48.418461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-23f3e22a-3a8a-4bc6-a282-078430100da6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:48.421714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6817ec86-d52f-4160-97b0-0c1a43d15c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:48.426718 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-23f3e22a-3a8a-4bc6-a282-078430100da6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.233825 Aug 01 15:55:48.427308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1109/2544] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:48 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:48.431770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6817ec86-d52f-4160-97b0-0c1a43d15c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:48.433279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6817ec86-d52f-4160-97b0-0c1a43d15c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:48.434473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6817ec86-d52f-4160-97b0-0c1a43d15c61 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.228524 Aug 01 15:55:48.435019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1436/2545] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:55:49.449271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-14170b5c-b2e8-4b06-8fca-a40b8de50dae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:49.449995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-14170b5c-b2e8-4b06-8fca-a40b8de50dae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:49.456915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-14170b5c-b2e8-4b06-8fca-a40b8de50dae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:49.457367 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-14170b5c-b2e8-4b06-8fca-a40b8de50dae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:49.457839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5532d4e7-b3ed-48c8-b35b-cb2b6cff373d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:49.458372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-14170b5c-b2e8-4b06-8fca-a40b8de50dae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:49.458733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5532d4e7-b3ed-48c8-b35b-cb2b6cff373d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:49.458921 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-14170b5c-b2e8-4b06-8fca-a40b8de50dae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:49.466081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5532d4e7-b3ed-48c8-b35b-cb2b6cff373d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:49.466536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5532d4e7-b3ed-48c8-b35b-cb2b6cff373d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:49.467311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5532d4e7-b3ed-48c8-b35b-cb2b6cff373d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:49.467754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5532d4e7-b3ed-48c8-b35b-cb2b6cff373d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:49.662308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-14170b5c-b2e8-4b06-8fca-a40b8de50dae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:49.666739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5532d4e7-b3ed-48c8-b35b-cb2b6cff373d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:49.671086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-14170b5c-b2e8-4b06-8fca-a40b8de50dae tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.225629 Aug 01 15:55:49.671671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1110/2546] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:49.675487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5532d4e7-b3ed-48c8-b35b-cb2b6cff373d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:49.676999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5532d4e7-b3ed-48c8-b35b-cb2b6cff373d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:49.678563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5532d4e7-b3ed-48c8-b35b-cb2b6cff373d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.224312 Aug 01 15:55:49.678563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1437/2547] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:50.692988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-68ec5a35-aa2c-43f8-89b4-2167eb83d54a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:50.693992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-68ec5a35-aa2c-43f8-89b4-2167eb83d54a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:50.701015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c46dcb84-120c-4511-8780-aed005347afd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:50.701802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c46dcb84-120c-4511-8780-aed005347afd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:50.701946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68ec5a35-aa2c-43f8-89b4-2167eb83d54a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:50.702391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68ec5a35-aa2c-43f8-89b4-2167eb83d54a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:50.703198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68ec5a35-aa2c-43f8-89b4-2167eb83d54a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:50.703663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68ec5a35-aa2c-43f8-89b4-2167eb83d54a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:50.708431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c46dcb84-120c-4511-8780-aed005347afd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:50.708931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c46dcb84-120c-4511-8780-aed005347afd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:50.710605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c46dcb84-120c-4511-8780-aed005347afd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:50.711206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c46dcb84-120c-4511-8780-aed005347afd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:50.906624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-68ec5a35-aa2c-43f8-89b4-2167eb83d54a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:50.910689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c46dcb84-120c-4511-8780-aed005347afd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:50.915899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-68ec5a35-aa2c-43f8-89b4-2167eb83d54a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.227133 Aug 01 15:55:50.916478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1111/2548] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:50 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:50.919776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c46dcb84-120c-4511-8780-aed005347afd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:50.921267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c46dcb84-120c-4511-8780-aed005347afd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:50.922502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c46dcb84-120c-4511-8780-aed005347afd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.225529 Aug 01 15:55:50.923052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1438/2549] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:51.939205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-58cad825-7c2e-42fe-a004-456a7cbe6cd6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:51.939755 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-58cad825-7c2e-42fe-a004-456a7cbe6cd6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:51.946645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-da23b534-306c-4d79-af80-1742489f7c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:51.947216 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-58cad825-7c2e-42fe-a004-456a7cbe6cd6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:51.947327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-da23b534-306c-4d79-af80-1742489f7c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:51.947429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-58cad825-7c2e-42fe-a004-456a7cbe6cd6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:51.948124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-58cad825-7c2e-42fe-a004-456a7cbe6cd6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:51.948560 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-58cad825-7c2e-42fe-a004-456a7cbe6cd6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:51.953382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da23b534-306c-4d79-af80-1742489f7c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:51.953920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da23b534-306c-4d79-af80-1742489f7c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:51.954702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da23b534-306c-4d79-af80-1742489f7c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:51.955136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da23b534-306c-4d79-af80-1742489f7c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:52.136357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-58cad825-7c2e-42fe-a004-456a7cbe6cd6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:52.144734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-58cad825-7c2e-42fe-a004-456a7cbe6cd6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.209531 Aug 01 15:55:52.145299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1112/2550] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:51 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:52.154385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-da23b534-306c-4d79-af80-1742489f7c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:52.163689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-da23b534-306c-4d79-af80-1742489f7c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:52.165224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-da23b534-306c-4d79-af80-1742489f7c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:52.166426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-da23b534-306c-4d79-af80-1742489f7c7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.224466 Aug 01 15:55:52.166993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1439/2551] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:53.166776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b09c07ca-4602-4654-b5ee-f54aeecba27b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:53.167371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b09c07ca-4602-4654-b5ee-f54aeecba27b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:53.173857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b09c07ca-4602-4654-b5ee-f54aeecba27b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:53.174340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b09c07ca-4602-4654-b5ee-f54aeecba27b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:53.175096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b09c07ca-4602-4654-b5ee-f54aeecba27b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:53.175531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b09c07ca-4602-4654-b5ee-f54aeecba27b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:53.188892 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1ca67075-c368-43af-bc77-1171cf11d5ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:53.189650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1ca67075-c368-43af-bc77-1171cf11d5ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:53.196683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ca67075-c368-43af-bc77-1171cf11d5ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:53.197140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ca67075-c368-43af-bc77-1171cf11d5ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:53.197927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ca67075-c368-43af-bc77-1171cf11d5ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:53.198371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ca67075-c368-43af-bc77-1171cf11d5ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:53.398832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b09c07ca-4602-4654-b5ee-f54aeecba27b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:53.405734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1ca67075-c368-43af-bc77-1171cf11d5ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:53.406860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b09c07ca-4602-4654-b5ee-f54aeecba27b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.243918 Aug 01 15:55:53.407433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1113/2552] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:53 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:53.414905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1ca67075-c368-43af-bc77-1171cf11d5ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:53.416400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1ca67075-c368-43af-bc77-1171cf11d5ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:53.417573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1ca67075-c368-43af-bc77-1171cf11d5ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.232575 Aug 01 15:55:53.418283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1440/2553] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:55:54.429744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8f3090dc-efa3-46e3-87b9-714b812edb09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:54.430412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8f3090dc-efa3-46e3-87b9-714b812edb09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:54.437394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f3090dc-efa3-46e3-87b9-714b812edb09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:54.437850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f3090dc-efa3-46e3-87b9-714b812edb09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:54.438672 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f3090dc-efa3-46e3-87b9-714b812edb09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:54.439154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8f3090dc-efa3-46e3-87b9-714b812edb09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:54.441168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b687e38b-f6e8-4f97-9c28-0743010bd984 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:54.442005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b687e38b-f6e8-4f97-9c28-0743010bd984 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:54.449059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b687e38b-f6e8-4f97-9c28-0743010bd984 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:54.449578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b687e38b-f6e8-4f97-9c28-0743010bd984 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:54.450307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b687e38b-f6e8-4f97-9c28-0743010bd984 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:54.450745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b687e38b-f6e8-4f97-9c28-0743010bd984 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:54.642855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8f3090dc-efa3-46e3-87b9-714b812edb09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:54.650023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b687e38b-f6e8-4f97-9c28-0743010bd984 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:54.651380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8f3090dc-efa3-46e3-87b9-714b812edb09 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.226117 Aug 01 15:55:54.651967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1114/2554] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:54 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:54.659059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b687e38b-f6e8-4f97-9c28-0743010bd984 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:54.660602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b687e38b-f6e8-4f97-9c28-0743010bd984 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:54.661911 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b687e38b-f6e8-4f97-9c28-0743010bd984 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.224927 Aug 01 15:55:54.662970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1441/2555] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:55.672911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3e433e24-d733-40d6-8c9d-813db2c1740d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:55.673540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3e433e24-d733-40d6-8c9d-813db2c1740d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:55.685222 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3e433e24-d733-40d6-8c9d-813db2c1740d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:55.685847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3e433e24-d733-40d6-8c9d-813db2c1740d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:55.686813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3e433e24-d733-40d6-8c9d-813db2c1740d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:55.687264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3e433e24-d733-40d6-8c9d-813db2c1740d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:55.693111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-56466fd9-862e-45fb-ae40-3d5f67ef47a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:55.694274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-56466fd9-862e-45fb-ae40-3d5f67ef47a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:55.700773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56466fd9-862e-45fb-ae40-3d5f67ef47a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:55.701224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56466fd9-862e-45fb-ae40-3d5f67ef47a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:55.702060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56466fd9-862e-45fb-ae40-3d5f67ef47a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:55.702619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56466fd9-862e-45fb-ae40-3d5f67ef47a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:55.884773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3e433e24-d733-40d6-8c9d-813db2c1740d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:55.893837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3e433e24-d733-40d6-8c9d-813db2c1740d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.224863 Aug 01 15:55:55.894450 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1115/2556] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:55 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:55:55.908986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-56466fd9-862e-45fb-ae40-3d5f67ef47a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:55.917624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-56466fd9-862e-45fb-ae40-3d5f67ef47a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:55.919194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-56466fd9-862e-45fb-ae40-3d5f67ef47a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:55.920369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-56466fd9-862e-45fb-ae40-3d5f67ef47a1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.231334 Aug 01 15:55:55.920922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1442/2557] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:56.915178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4388fa7a-861a-4087-9fc3-cc439c1c14b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:56.915826 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4388fa7a-861a-4087-9fc3-cc439c1c14b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:56.922457 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4388fa7a-861a-4087-9fc3-cc439c1c14b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:56.922907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4388fa7a-861a-4087-9fc3-cc439c1c14b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:56.923671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4388fa7a-861a-4087-9fc3-cc439c1c14b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:56.924111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4388fa7a-861a-4087-9fc3-cc439c1c14b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:56.945179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-48bb9e6b-8197-4cb1-822f-1ca38154856a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:56.945776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-48bb9e6b-8197-4cb1-822f-1ca38154856a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:56.952305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48bb9e6b-8197-4cb1-822f-1ca38154856a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:56.952748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48bb9e6b-8197-4cb1-822f-1ca38154856a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:56.953503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48bb9e6b-8197-4cb1-822f-1ca38154856a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:56.953954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48bb9e6b-8197-4cb1-822f-1ca38154856a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:57.126001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4388fa7a-861a-4087-9fc3-cc439c1c14b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:57.134901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4388fa7a-861a-4087-9fc3-cc439c1c14b8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.223544 Aug 01 15:55:57.135499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1116/2558] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:56 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:57.144042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48bb9e6b-8197-4cb1-822f-1ca38154856a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:57.153433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48bb9e6b-8197-4cb1-822f-1ca38154856a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:57.154979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48bb9e6b-8197-4cb1-822f-1ca38154856a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:57.156142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-48bb9e6b-8197-4cb1-822f-1ca38154856a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.215388 Aug 01 15:55:57.156694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1443/2559] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:58.157950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bdcb63b7-47b2-4825-9ac9-a0c8acd4d7ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:58.158546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bdcb63b7-47b2-4825-9ac9-a0c8acd4d7ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:58.165031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bdcb63b7-47b2-4825-9ac9-a0c8acd4d7ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:58.165474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bdcb63b7-47b2-4825-9ac9-a0c8acd4d7ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:58.166250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bdcb63b7-47b2-4825-9ac9-a0c8acd4d7ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:58.166740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bdcb63b7-47b2-4825-9ac9-a0c8acd4d7ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:58.179040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4520e82e-1ae9-4349-b24f-137dcd2ecc39 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:58.179657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4520e82e-1ae9-4349-b24f-137dcd2ecc39 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:58.186375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4520e82e-1ae9-4349-b24f-137dcd2ecc39 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:58.186954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4520e82e-1ae9-4349-b24f-137dcd2ecc39 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:58.187759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4520e82e-1ae9-4349-b24f-137dcd2ecc39 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:58.188199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4520e82e-1ae9-4349-b24f-137dcd2ecc39 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:58.375736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bdcb63b7-47b2-4825-9ac9-a0c8acd4d7ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:58.383445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4520e82e-1ae9-4349-b24f-137dcd2ecc39 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:58.385076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bdcb63b7-47b2-4825-9ac9-a0c8acd4d7ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.230865 Aug 01 15:55:58.385656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1117/2560] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:58 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:58.392480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4520e82e-1ae9-4349-b24f-137dcd2ecc39 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:58.394024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4520e82e-1ae9-4349-b24f-137dcd2ecc39 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:58.395296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4520e82e-1ae9-4349-b24f-137dcd2ecc39 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.220875 Aug 01 15:55:58.395770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1444/2561] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:55:59.407093 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c74ec90c-c7cf-48be-b805-588372d05c3c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:59.407706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c74ec90c-c7cf-48be-b805-588372d05c3c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:59.415354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c74ec90c-c7cf-48be-b805-588372d05c3c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:59.415802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c74ec90c-c7cf-48be-b805-588372d05c3c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:59.416574 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c74ec90c-c7cf-48be-b805-588372d05c3c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:59.417006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c74ec90c-c7cf-48be-b805-588372d05c3c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:59.419475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c563a1fe-bfe5-40de-8f4d-14b74c2e46cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:55:59.420092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c563a1fe-bfe5-40de-8f4d-14b74c2e46cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:55:59.426854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c563a1fe-bfe5-40de-8f4d-14b74c2e46cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:59.427345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c563a1fe-bfe5-40de-8f4d-14b74c2e46cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:59.427791 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c563a1fe-bfe5-40de-8f4d-14b74c2e46cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:55:59.428908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c563a1fe-bfe5-40de-8f4d-14b74c2e46cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:55:59.619081 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c74ec90c-c7cf-48be-b805-588372d05c3c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:59.623321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c563a1fe-bfe5-40de-8f4d-14b74c2e46cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:59.627638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c74ec90c-c7cf-48be-b805-588372d05c3c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.224312 Aug 01 15:55:59.628285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1118/2562] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:55:59 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:55:59.632524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c563a1fe-bfe5-40de-8f4d-14b74c2e46cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:59.634049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c563a1fe-bfe5-40de-8f4d-14b74c2e46cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:55:59.635263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c563a1fe-bfe5-40de-8f4d-14b74c2e46cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.219664 Aug 01 15:55:59.636059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1445/2563] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:55:59 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:00.649200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bf711cde-b8ce-4227-98d0-8f98a7f04675 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:00.649783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bf711cde-b8ce-4227-98d0-8f98a7f04675 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:00.656703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf711cde-b8ce-4227-98d0-8f98a7f04675 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:00.657156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf711cde-b8ce-4227-98d0-8f98a7f04675 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:00.657950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf711cde-b8ce-4227-98d0-8f98a7f04675 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:00.658388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf711cde-b8ce-4227-98d0-8f98a7f04675 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:00.662070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-684ee9b4-bd1c-4c44-b0a2-1d5b9e438f18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:00.663006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-684ee9b4-bd1c-4c44-b0a2-1d5b9e438f18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:00.669738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-684ee9b4-bd1c-4c44-b0a2-1d5b9e438f18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:00.670219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-684ee9b4-bd1c-4c44-b0a2-1d5b9e438f18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:00.670992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-684ee9b4-bd1c-4c44-b0a2-1d5b9e438f18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:00.671420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-684ee9b4-bd1c-4c44-b0a2-1d5b9e438f18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:00.863024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bf711cde-b8ce-4227-98d0-8f98a7f04675 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:00.866680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-684ee9b4-bd1c-4c44-b0a2-1d5b9e438f18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:00.872187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bf711cde-b8ce-4227-98d0-8f98a7f04675 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.227328 Aug 01 15:56:00.872696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1119/2564] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:00 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:00.876014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-684ee9b4-bd1c-4c44-b0a2-1d5b9e438f18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:00.877559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-684ee9b4-bd1c-4c44-b0a2-1d5b9e438f18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:00.878767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-684ee9b4-bd1c-4c44-b0a2-1d5b9e438f18 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.220923 Aug 01 15:56:00.879315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1446/2565] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:01.845616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:56:01.846298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 15:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:56:01.895644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d187e970-ad14-4109-a74f-89cc23b6960f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:01.897063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d187e970-ad14-4109-a74f-89cc23b6960f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:01.904137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d187e970-ad14-4109-a74f-89cc23b6960f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:01.904758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d187e970-ad14-4109-a74f-89cc23b6960f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:01.905571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d187e970-ad14-4109-a74f-89cc23b6960f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:01.906033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d187e970-ad14-4109-a74f-89cc23b6960f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:01.906175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7e75db84-cdb1-4fab-b274-e8b7f74802e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:01.907113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7e75db84-cdb1-4fab-b274-e8b7f74802e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:01.911149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=50 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:01.917909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e75db84-cdb1-4fab-b274-e8b7f74802e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:01.918372 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e75db84-cdb1-4fab-b274-e8b7f74802e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:01.919151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e75db84-cdb1-4fab-b274-e8b7f74802e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:01.919585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e75db84-cdb1-4fab-b274-e8b7f74802e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:02.111704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d187e970-ad14-4109-a74f-89cc23b6960f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:02.119375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7e75db84-cdb1-4fab-b274-e8b7f74802e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:02.119922 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d187e970-ad14-4109-a74f-89cc23b6960f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.228482 Aug 01 15:56:02.120500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1120/2566] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:01 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:02.128309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7e75db84-cdb1-4fab-b274-e8b7f74802e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:02.129903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7e75db84-cdb1-4fab-b274-e8b7f74802e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:02.131697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7e75db84-cdb1-4fab-b274-e8b7f74802e9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.231216 Aug 01 15:56:02.132539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1447/2567] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:02.790382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:56:02.790567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:56:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:56:03.142343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f2152d77-e441-4841-b99d-c415347ff64a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:03.142983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f2152d77-e441-4841-b99d-c415347ff64a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:03.149823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f2152d77-e441-4841-b99d-c415347ff64a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:03.150303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f2152d77-e441-4841-b99d-c415347ff64a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:03.151074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f2152d77-e441-4841-b99d-c415347ff64a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:03.151509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f2152d77-e441-4841-b99d-c415347ff64a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:03.156060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-40d0f08d-5803-4161-8ea2-ec37710b7ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:03.156666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:03.156773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-40d0f08d-5803-4161-8ea2-ec37710b7ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:03.165063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-40d0f08d-5803-4161-8ea2-ec37710b7ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:03.165360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-40d0f08d-5803-4161-8ea2-ec37710b7ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:03.166181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-40d0f08d-5803-4161-8ea2-ec37710b7ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:03.166767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-40d0f08d-5803-4161-8ea2-ec37710b7ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:03.361617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-40d0f08d-5803-4161-8ea2-ec37710b7ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:03.364422 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f2152d77-e441-4841-b99d-c415347ff64a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:03.370441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-40d0f08d-5803-4161-8ea2-ec37710b7ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:03.371937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-40d0f08d-5803-4161-8ea2-ec37710b7ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:03.372626 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f2152d77-e441-4841-b99d-c415347ff64a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.234093 Aug 01 15:56:03.373093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-40d0f08d-5803-4161-8ea2-ec37710b7ace tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.221117 Aug 01 15:56:03.373269 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1121/2568] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:03 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:03.373630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1448/2569] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:04.395603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d525a73d-c2e1-4740-86e1-fdc760f84db5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:04.396237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d525a73d-c2e1-4740-86e1-fdc760f84db5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:04.399224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-26c7a70f-c9c6-4256-8c75-d1175f08a87f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:04.400221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-26c7a70f-c9c6-4256-8c75-d1175f08a87f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:04.405727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d525a73d-c2e1-4740-86e1-fdc760f84db5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:04.406574 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d525a73d-c2e1-4740-86e1-fdc760f84db5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:04.407375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d525a73d-c2e1-4740-86e1-fdc760f84db5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:04.407818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d525a73d-c2e1-4740-86e1-fdc760f84db5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:04.408236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26c7a70f-c9c6-4256-8c75-d1175f08a87f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:04.408690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26c7a70f-c9c6-4256-8c75-d1175f08a87f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:04.409473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26c7a70f-c9c6-4256-8c75-d1175f08a87f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:04.410180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26c7a70f-c9c6-4256-8c75-d1175f08a87f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:04.846324 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d525a73d-c2e1-4740-86e1-fdc760f84db5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:04.852056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-26c7a70f-c9c6-4256-8c75-d1175f08a87f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:04.856303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d525a73d-c2e1-4740-86e1-fdc760f84db5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.464742 Aug 01 15:56:04.856864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1122/2570] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:04 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:04.863501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-26c7a70f-c9c6-4256-8c75-d1175f08a87f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:04.865920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-26c7a70f-c9c6-4256-8c75-d1175f08a87f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:04.867258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-26c7a70f-c9c6-4256-8c75-d1175f08a87f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.475319 Aug 01 15:56:04.867826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1449/2571] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:04 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:05.878776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-aef578d6-75d0-4fce-b0f5-b0e9a3cfb4e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:05.879430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-aef578d6-75d0-4fce-b0f5-b0e9a3cfb4e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:05.889764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aef578d6-75d0-4fce-b0f5-b0e9a3cfb4e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:05.890507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aef578d6-75d0-4fce-b0f5-b0e9a3cfb4e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:05.891682 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aef578d6-75d0-4fce-b0f5-b0e9a3cfb4e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:05.892356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aef578d6-75d0-4fce-b0f5-b0e9a3cfb4e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:05.892537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eae0079e-64dd-46af-9945-05fb4fe79c57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:05.893466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eae0079e-64dd-46af-9945-05fb4fe79c57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:05.902651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eae0079e-64dd-46af-9945-05fb4fe79c57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:05.903112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eae0079e-64dd-46af-9945-05fb4fe79c57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:05.903913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eae0079e-64dd-46af-9945-05fb4fe79c57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:05.904359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eae0079e-64dd-46af-9945-05fb4fe79c57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:05.909987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:06.127036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-aef578d6-75d0-4fce-b0f5-b0e9a3cfb4e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:06.139092 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-aef578d6-75d0-4fce-b0f5-b0e9a3cfb4e3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.263894 Aug 01 15:56:06.139837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1123/2572] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:05 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:06.143137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eae0079e-64dd-46af-9945-05fb4fe79c57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:06.151893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eae0079e-64dd-46af-9945-05fb4fe79c57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:06.153419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eae0079e-64dd-46af-9945-05fb4fe79c57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:06.154713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eae0079e-64dd-46af-9945-05fb4fe79c57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.267381 Aug 01 15:56:06.155268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1450/2573] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:07.160598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-062db0c5-6cf1-4509-9652-a49fe910166b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:07.161200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-062db0c5-6cf1-4509-9652-a49fe910166b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:07.168365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-062db0c5-6cf1-4509-9652-a49fe910166b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:07.168802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-062db0c5-6cf1-4509-9652-a49fe910166b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:07.169556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-062db0c5-6cf1-4509-9652-a49fe910166b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:07.170011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-062db0c5-6cf1-4509-9652-a49fe910166b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:07.188726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1646c72e-fc76-4d35-88cb-1a169fbb1ebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:07.189420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1646c72e-fc76-4d35-88cb-1a169fbb1ebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:07.196003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1646c72e-fc76-4d35-88cb-1a169fbb1ebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:07.196445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1646c72e-fc76-4d35-88cb-1a169fbb1ebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:07.197206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1646c72e-fc76-4d35-88cb-1a169fbb1ebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:07.197643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1646c72e-fc76-4d35-88cb-1a169fbb1ebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:07.387371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-062db0c5-6cf1-4509-9652-a49fe910166b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:07.398285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1646c72e-fc76-4d35-88cb-1a169fbb1ebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:07.401340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-062db0c5-6cf1-4509-9652-a49fe910166b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.244139 Aug 01 15:56:07.402301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1124/2574] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:07 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:07.407153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1646c72e-fc76-4d35-88cb-1a169fbb1ebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:07.408666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1646c72e-fc76-4d35-88cb-1a169fbb1ebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:07.409903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1646c72e-fc76-4d35-88cb-1a169fbb1ebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.225112 Aug 01 15:56:07.410461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1451/2575] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:07 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:08.433411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-09391982-f3a1-4bbc-9898-cdb00c99b643 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:08.434052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-09391982-f3a1-4bbc-9898-cdb00c99b643 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:08.434907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ae2e3183-14e5-462a-8367-d9dfedaab7a7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:08.435626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ae2e3183-14e5-462a-8367-d9dfedaab7a7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:08.441135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09391982-f3a1-4bbc-9898-cdb00c99b643 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:08.441588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09391982-f3a1-4bbc-9898-cdb00c99b643 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:08.442364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae2e3183-14e5-462a-8367-d9dfedaab7a7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:08.442510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09391982-f3a1-4bbc-9898-cdb00c99b643 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:08.442813 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae2e3183-14e5-462a-8367-d9dfedaab7a7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:08.442934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09391982-f3a1-4bbc-9898-cdb00c99b643 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:08.443592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae2e3183-14e5-462a-8367-d9dfedaab7a7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:08.444023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae2e3183-14e5-462a-8367-d9dfedaab7a7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:08.656933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-09391982-f3a1-4bbc-9898-cdb00c99b643 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:08.664686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ae2e3183-14e5-462a-8367-d9dfedaab7a7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:08.666275 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-09391982-f3a1-4bbc-9898-cdb00c99b643 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:08.667794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-09391982-f3a1-4bbc-9898-cdb00c99b643 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:08.668977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-09391982-f3a1-4bbc-9898-cdb00c99b643 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.239532 Aug 01 15:56:08.669539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1125/2576] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:08.673027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ae2e3183-14e5-462a-8367-d9dfedaab7a7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.241965 Aug 01 15:56:08.673591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1452/2577] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:08 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:56:09.692639 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-39e1047f-8089-41d7-aa03-bed58b050728 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:09.693272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-39e1047f-8089-41d7-aa03-bed58b050728 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:09.697377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2f38b434-93f7-4274-8d88-4dad5253c428 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:09.698019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2f38b434-93f7-4274-8d88-4dad5253c428 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:09.700138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39e1047f-8089-41d7-aa03-bed58b050728 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:09.700630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39e1047f-8089-41d7-aa03-bed58b050728 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:09.701358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39e1047f-8089-41d7-aa03-bed58b050728 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:09.701793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39e1047f-8089-41d7-aa03-bed58b050728 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:09.703971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f38b434-93f7-4274-8d88-4dad5253c428 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:09.704422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f38b434-93f7-4274-8d88-4dad5253c428 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:09.705188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f38b434-93f7-4274-8d88-4dad5253c428 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:09.705760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f38b434-93f7-4274-8d88-4dad5253c428 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:09.905860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2f38b434-93f7-4274-8d88-4dad5253c428 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:09.908351 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-39e1047f-8089-41d7-aa03-bed58b050728 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:09.919170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-39e1047f-8089-41d7-aa03-bed58b050728 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:09.919861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2f38b434-93f7-4274-8d88-4dad5253c428 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.229342 Aug 01 15:56:09.920539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1453/2578] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:09 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:56:09.920723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-39e1047f-8089-41d7-aa03-bed58b050728 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:09.921850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-39e1047f-8089-41d7-aa03-bed58b050728 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.233276 Aug 01 15:56:09.922432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1126/2579] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:10.944331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8ae2467e-4046-448a-be65-3d27058ce737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:10.944932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8ae2467e-4046-448a-be65-3d27058ce737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:10.949565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-510944de-7a3b-4bf0-9b75-c83c54f78c77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:10.950880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-510944de-7a3b-4bf0-9b75-c83c54f78c77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:10.951510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ae2467e-4046-448a-be65-3d27058ce737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:10.951964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ae2467e-4046-448a-be65-3d27058ce737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:10.952738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ae2467e-4046-448a-be65-3d27058ce737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:10.953167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ae2467e-4046-448a-be65-3d27058ce737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:10.962727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-510944de-7a3b-4bf0-9b75-c83c54f78c77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:10.963704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-510944de-7a3b-4bf0-9b75-c83c54f78c77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:10.965094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-510944de-7a3b-4bf0-9b75-c83c54f78c77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:10.965913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-510944de-7a3b-4bf0-9b75-c83c54f78c77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:11.161546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8ae2467e-4046-448a-be65-3d27058ce737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:11.170021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-510944de-7a3b-4bf0-9b75-c83c54f78c77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:11.170264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8ae2467e-4046-448a-be65-3d27058ce737 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.231393 Aug 01 15:56:11.171183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1454/2580] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:10 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:11.180967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-510944de-7a3b-4bf0-9b75-c83c54f78c77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:11.182525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-510944de-7a3b-4bf0-9b75-c83c54f78c77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:11.183705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-510944de-7a3b-4bf0-9b75-c83c54f78c77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.242300 Aug 01 15:56:11.184262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1127/2581] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:10 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:12.193972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-33e48275-c351-4dbf-ab9d-9efe0820efda tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:12.195121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-33e48275-c351-4dbf-ab9d-9efe0820efda tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:12.201719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33e48275-c351-4dbf-ab9d-9efe0820efda tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:12.202217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33e48275-c351-4dbf-ab9d-9efe0820efda tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:12.202980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33e48275-c351-4dbf-ab9d-9efe0820efda tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:12.203422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-33e48275-c351-4dbf-ab9d-9efe0820efda tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:12.207094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a025dada-5365-4db5-aa32-6600dae419d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:12.207839 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a025dada-5365-4db5-aa32-6600dae419d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:12.214772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a025dada-5365-4db5-aa32-6600dae419d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:12.215207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a025dada-5365-4db5-aa32-6600dae419d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:12.215961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a025dada-5365-4db5-aa32-6600dae419d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:12.216386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a025dada-5365-4db5-aa32-6600dae419d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:12.411844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a025dada-5365-4db5-aa32-6600dae419d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:12.419707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-33e48275-c351-4dbf-ab9d-9efe0820efda tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:12.420690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a025dada-5365-4db5-aa32-6600dae419d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:12.422256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a025dada-5365-4db5-aa32-6600dae419d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:12.423445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a025dada-5365-4db5-aa32-6600dae419d7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.220144 Aug 01 15:56:12.424014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1128/2582] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:12.430214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-33e48275-c351-4dbf-ab9d-9efe0820efda tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.239767 Aug 01 15:56:12.431037 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1455/2583] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:12 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:13.448429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5e6cb231-f086-4f76-ade5-99cae83799bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:13.449045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5e6cb231-f086-4f76-ade5-99cae83799bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:13.451650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a289f2d5-018d-4e1b-9dfb-74d799a10c0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:13.452267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a289f2d5-018d-4e1b-9dfb-74d799a10c0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:13.455776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e6cb231-f086-4f76-ade5-99cae83799bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:13.456228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e6cb231-f086-4f76-ade5-99cae83799bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:13.457002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e6cb231-f086-4f76-ade5-99cae83799bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:13.457439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e6cb231-f086-4f76-ade5-99cae83799bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:13.459003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a289f2d5-018d-4e1b-9dfb-74d799a10c0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:13.459458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a289f2d5-018d-4e1b-9dfb-74d799a10c0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:13.460894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a289f2d5-018d-4e1b-9dfb-74d799a10c0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:13.461342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a289f2d5-018d-4e1b-9dfb-74d799a10c0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:13.667430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5e6cb231-f086-4f76-ade5-99cae83799bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:13.671400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a289f2d5-018d-4e1b-9dfb-74d799a10c0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:13.676883 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5e6cb231-f086-4f76-ade5-99cae83799bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:13.678500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5e6cb231-f086-4f76-ade5-99cae83799bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:13.679676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5e6cb231-f086-4f76-ade5-99cae83799bc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.235674 Aug 01 15:56:13.679839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a289f2d5-018d-4e1b-9dfb-74d799a10c0f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.231798 Aug 01 15:56:13.680424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1129/2584] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:13.680555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1456/2585] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:13 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:56:14.703493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5881faa2-73dd-42e8-afe7-2e64107f1110 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:14.704050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5881faa2-73dd-42e8-afe7-2e64107f1110 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:14.704710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-73a18e2d-b22d-418b-9283-c94224dfdee5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:14.705486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-73a18e2d-b22d-418b-9283-c94224dfdee5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:14.708034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=48 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:14.713737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73a18e2d-b22d-418b-9283-c94224dfdee5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:14.714166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5881faa2-73dd-42e8-afe7-2e64107f1110 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:14.714283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73a18e2d-b22d-418b-9283-c94224dfdee5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:14.714618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5881faa2-73dd-42e8-afe7-2e64107f1110 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:14.714962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73a18e2d-b22d-418b-9283-c94224dfdee5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:14.715387 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5881faa2-73dd-42e8-afe7-2e64107f1110 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:14.715489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73a18e2d-b22d-418b-9283-c94224dfdee5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:14.715823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5881faa2-73dd-42e8-afe7-2e64107f1110 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:14.924049 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5881faa2-73dd-42e8-afe7-2e64107f1110 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:14.927270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-73a18e2d-b22d-418b-9283-c94224dfdee5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:14.934442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5881faa2-73dd-42e8-afe7-2e64107f1110 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:14.936116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5881faa2-73dd-42e8-afe7-2e64107f1110 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:14.937246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-73a18e2d-b22d-418b-9283-c94224dfdee5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.236213 Aug 01 15:56:14.937356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5881faa2-73dd-42e8-afe7-2e64107f1110 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.238072 Aug 01 15:56:14.937834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1130/2587] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:14.938042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1457/2587] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:14 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:56:15.959820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e2463f33-9038-4f7b-9f4c-9cf96a6a51a4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:15.960959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e2463f33-9038-4f7b-9f4c-9cf96a6a51a4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:15.963519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-34a84987-fa41-4e63-9440-3bb785aba3b3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:15.964136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-34a84987-fa41-4e63-9440-3bb785aba3b3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:15.967585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2463f33-9038-4f7b-9f4c-9cf96a6a51a4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:15.968042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2463f33-9038-4f7b-9f4c-9cf96a6a51a4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:15.968821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2463f33-9038-4f7b-9f4c-9cf96a6a51a4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:15.969260 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2463f33-9038-4f7b-9f4c-9cf96a6a51a4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:15.972066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-34a84987-fa41-4e63-9440-3bb785aba3b3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:15.972667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-34a84987-fa41-4e63-9440-3bb785aba3b3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:15.973665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-34a84987-fa41-4e63-9440-3bb785aba3b3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:15.974504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-34a84987-fa41-4e63-9440-3bb785aba3b3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:16.180413 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e2463f33-9038-4f7b-9f4c-9cf96a6a51a4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:16.187451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-34a84987-fa41-4e63-9440-3bb785aba3b3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:16.188781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e2463f33-9038-4f7b-9f4c-9cf96a6a51a4 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.232937 Aug 01 15:56:16.189360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1131/2588] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:15 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:16.196895 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-34a84987-fa41-4e63-9440-3bb785aba3b3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:16.198429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-34a84987-fa41-4e63-9440-3bb785aba3b3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:16.199756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-34a84987-fa41-4e63-9440-3bb785aba3b3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.240823 Aug 01 15:56:16.200318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1458/2589] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:17.210412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-42dd7c55-c67a-4b78-8697-d4af503b1ada tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:17.211058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-42dd7c55-c67a-4b78-8697-d4af503b1ada tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:17.217661 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42dd7c55-c67a-4b78-8697-d4af503b1ada tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:17.218141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42dd7c55-c67a-4b78-8697-d4af503b1ada tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:17.218950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42dd7c55-c67a-4b78-8697-d4af503b1ada tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:17.219387 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42dd7c55-c67a-4b78-8697-d4af503b1ada tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:17.222521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7024897a-76d4-451d-bf01-a395575bb290 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:17.223148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7024897a-76d4-451d-bf01-a395575bb290 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:17.230569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7024897a-76d4-451d-bf01-a395575bb290 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:17.231014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7024897a-76d4-451d-bf01-a395575bb290 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:17.231778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7024897a-76d4-451d-bf01-a395575bb290 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:17.232207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7024897a-76d4-451d-bf01-a395575bb290 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:17.438011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-42dd7c55-c67a-4b78-8697-d4af503b1ada tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:17.439747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7024897a-76d4-451d-bf01-a395575bb290 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:17.446285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-42dd7c55-c67a-4b78-8697-d4af503b1ada tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.239703 Aug 01 15:56:17.446861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1132/2590] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:17 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:17.449367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7024897a-76d4-451d-bf01-a395575bb290 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:17.450898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7024897a-76d4-451d-bf01-a395575bb290 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:17.452076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7024897a-76d4-451d-bf01-a395575bb290 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.233476 Aug 01 15:56:17.452630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1459/2591] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:18.469913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-43d0a72f-520b-4547-a2b0-c090919f656d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:18.470575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-43d0a72f-520b-4547-a2b0-c090919f656d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:18.476364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7f89da21-3a22-45b1-8326-d029580e9276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:18.476980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7f89da21-3a22-45b1-8326-d029580e9276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:18.478825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43d0a72f-520b-4547-a2b0-c090919f656d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:18.479278 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43d0a72f-520b-4547-a2b0-c090919f656d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:18.480055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43d0a72f-520b-4547-a2b0-c090919f656d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:18.480486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43d0a72f-520b-4547-a2b0-c090919f656d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:18.484709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f89da21-3a22-45b1-8326-d029580e9276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:18.485153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f89da21-3a22-45b1-8326-d029580e9276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:18.485983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f89da21-3a22-45b1-8326-d029580e9276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:18.486413 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7f89da21-3a22-45b1-8326-d029580e9276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:18.712217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7f89da21-3a22-45b1-8326-d029580e9276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:18.721358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7f89da21-3a22-45b1-8326-d029580e9276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:18.721577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-43d0a72f-520b-4547-a2b0-c090919f656d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:18.723042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7f89da21-3a22-45b1-8326-d029580e9276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:18.724669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7f89da21-3a22-45b1-8326-d029580e9276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.253053 Aug 01 15:56:18.733529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1460/2592] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:18.733785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-43d0a72f-520b-4547-a2b0-c090919f656d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.265620 Aug 01 15:56:18.733785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1133/2593] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:18 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:19.753026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0e0202de-c998-4bd9-b1a9-cf0eda1a5378 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:19.754165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0e0202de-c998-4bd9-b1a9-cf0eda1a5378 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:19.756944 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a4688c05-732b-4f5e-a9d6-1162cc030266 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:19.757619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a4688c05-732b-4f5e-a9d6-1162cc030266 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:19.761823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e0202de-c998-4bd9-b1a9-cf0eda1a5378 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:19.762328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e0202de-c998-4bd9-b1a9-cf0eda1a5378 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:19.763178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e0202de-c998-4bd9-b1a9-cf0eda1a5378 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:19.763626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e0202de-c998-4bd9-b1a9-cf0eda1a5378 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:19.765010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a4688c05-732b-4f5e-a9d6-1162cc030266 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:19.765455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a4688c05-732b-4f5e-a9d6-1162cc030266 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:19.766244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a4688c05-732b-4f5e-a9d6-1162cc030266 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:19.766886 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a4688c05-732b-4f5e-a9d6-1162cc030266 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:19.968244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0e0202de-c998-4bd9-b1a9-cf0eda1a5378 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:19.971228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a4688c05-732b-4f5e-a9d6-1162cc030266 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:19.978021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0e0202de-c998-4bd9-b1a9-cf0eda1a5378 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:19.979524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0e0202de-c998-4bd9-b1a9-cf0eda1a5378 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:19.980696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0e0202de-c998-4bd9-b1a9-cf0eda1a5378 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.231741 Aug 01 15:56:19.980831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a4688c05-732b-4f5e-a9d6-1162cc030266 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.228222 Aug 01 15:56:19.981256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1461/2594] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:19.981408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1134/2595] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:19 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:56:20.945718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:56:20.946467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 15:56:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:56:21.003331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-671324b5-d06e-483d-acd3-15520ffebe75 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:21.003835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9aaef30e-4255-4180-be23-85ab9a8c4f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:21.004319 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-671324b5-d06e-483d-acd3-15520ffebe75 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:21.004434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9aaef30e-4255-4180-be23-85ab9a8c4f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:21.011117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-671324b5-d06e-483d-acd3-15520ffebe75 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:21.011565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-671324b5-d06e-483d-acd3-15520ffebe75 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:21.012357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-671324b5-d06e-483d-acd3-15520ffebe75 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:21.012800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-671324b5-d06e-483d-acd3-15520ffebe75 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:21.015391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9aaef30e-4255-4180-be23-85ab9a8c4f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:21.015843 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9aaef30e-4255-4180-be23-85ab9a8c4f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:21.016663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9aaef30e-4255-4180-be23-85ab9a8c4f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:21.017155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9aaef30e-4255-4180-be23-85ab9a8c4f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:21.217821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-671324b5-d06e-483d-acd3-15520ffebe75 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:21.225315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9aaef30e-4255-4180-be23-85ab9a8c4f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:21.227318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-671324b5-d06e-483d-acd3-15520ffebe75 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.227911 Aug 01 15:56:21.227905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1462/2596] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:20 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:21.235015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9aaef30e-4255-4180-be23-85ab9a8c4f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:21.236505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9aaef30e-4255-4180-be23-85ab9a8c4f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:21.237655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9aaef30e-4255-4180-be23-85ab9a8c4f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.237980 Aug 01 15:56:21.238234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1135/2597] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:22.249129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9aa9c866-368c-4f54-8e2f-696596b30ed5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:22.249751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9aa9c866-368c-4f54-8e2f-696596b30ed5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:22.256659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aa9c866-368c-4f54-8e2f-696596b30ed5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:22.257745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aa9c866-368c-4f54-8e2f-696596b30ed5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:22.258551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aa9c866-368c-4f54-8e2f-696596b30ed5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:22.258991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aa9c866-368c-4f54-8e2f-696596b30ed5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:22.264802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cccaa8f7-37b1-469e-b2e4-f4e227a3eebe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:22.265423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cccaa8f7-37b1-469e-b2e4-f4e227a3eebe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:22.272396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cccaa8f7-37b1-469e-b2e4-f4e227a3eebe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:22.272861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cccaa8f7-37b1-469e-b2e4-f4e227a3eebe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:22.273753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cccaa8f7-37b1-469e-b2e4-f4e227a3eebe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:22.274241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cccaa8f7-37b1-469e-b2e4-f4e227a3eebe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:22.457021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9aa9c866-368c-4f54-8e2f-696596b30ed5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:22.465255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9aa9c866-368c-4f54-8e2f-696596b30ed5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.219991 Aug 01 15:56:22.465854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1463/2598] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:22 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:22.470942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cccaa8f7-37b1-469e-b2e4-f4e227a3eebe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:22.482031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cccaa8f7-37b1-469e-b2e4-f4e227a3eebe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:22.483547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cccaa8f7-37b1-469e-b2e4-f4e227a3eebe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:22.484857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cccaa8f7-37b1-469e-b2e4-f4e227a3eebe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.224345 Aug 01 15:56:22.485358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1136/2599] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:22 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:23.487512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-55c0b5fc-9d55-4daa-89b5-99e31cf552a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:23.488123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-55c0b5fc-9d55-4daa-89b5-99e31cf552a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:23.495241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55c0b5fc-9d55-4daa-89b5-99e31cf552a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:23.495690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55c0b5fc-9d55-4daa-89b5-99e31cf552a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:23.496454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55c0b5fc-9d55-4daa-89b5-99e31cf552a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:23.496887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55c0b5fc-9d55-4daa-89b5-99e31cf552a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:23.509392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1ccb1624-26ee-4888-980c-399e9b0c43fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:23.510054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1ccb1624-26ee-4888-980c-399e9b0c43fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:23.516608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ccb1624-26ee-4888-980c-399e9b0c43fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:23.517060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ccb1624-26ee-4888-980c-399e9b0c43fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:23.517833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ccb1624-26ee-4888-980c-399e9b0c43fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:23.518296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ccb1624-26ee-4888-980c-399e9b0c43fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:23.687201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-55c0b5fc-9d55-4daa-89b5-99e31cf552a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:23.696744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-55c0b5fc-9d55-4daa-89b5-99e31cf552a9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.213096 Aug 01 15:56:23.697329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1464/2600] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:23 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:23.704166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1ccb1624-26ee-4888-980c-399e9b0c43fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:23.707559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:23.712903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1ccb1624-26ee-4888-980c-399e9b0c43fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:23.714423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1ccb1624-26ee-4888-980c-399e9b0c43fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:23.715584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1ccb1624-26ee-4888-980c-399e9b0c43fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.210845 Aug 01 15:56:23.716140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1137/2601] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:24.718806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1522d153-d4f7-4fbf-a8f7-8f9e118e7845 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:24.719493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1522d153-d4f7-4fbf-a8f7-8f9e118e7845 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:24.727169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1522d153-d4f7-4fbf-a8f7-8f9e118e7845 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:24.727624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1522d153-d4f7-4fbf-a8f7-8f9e118e7845 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:24.728408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1522d153-d4f7-4fbf-a8f7-8f9e118e7845 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:24.728860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1522d153-d4f7-4fbf-a8f7-8f9e118e7845 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:24.742249 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-52ef51a4-f262-419f-923a-dfa47f116d4b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:24.742853 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-52ef51a4-f262-419f-923a-dfa47f116d4b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:24.750824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52ef51a4-f262-419f-923a-dfa47f116d4b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:24.751557 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52ef51a4-f262-419f-923a-dfa47f116d4b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:24.752463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52ef51a4-f262-419f-923a-dfa47f116d4b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:24.753562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52ef51a4-f262-419f-923a-dfa47f116d4b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:24.945722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1522d153-d4f7-4fbf-a8f7-8f9e118e7845 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:24.953634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1522d153-d4f7-4fbf-a8f7-8f9e118e7845 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.238859 Aug 01 15:56:24.954239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1465/2602] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:24 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:24.973870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-52ef51a4-f262-419f-923a-dfa47f116d4b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:24.983392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-52ef51a4-f262-419f-923a-dfa47f116d4b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:24.984903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-52ef51a4-f262-419f-923a-dfa47f116d4b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:24.986114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-52ef51a4-f262-419f-923a-dfa47f116d4b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.250462 Aug 01 15:56:24.986671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1138/2603] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:25.977695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-886aff6a-f55b-4b0b-a584-26719b530d39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:25.978363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-886aff6a-f55b-4b0b-a584-26719b530d39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:25.985280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-886aff6a-f55b-4b0b-a584-26719b530d39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:25.985727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-886aff6a-f55b-4b0b-a584-26719b530d39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:25.986527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-886aff6a-f55b-4b0b-a584-26719b530d39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:25.987046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-886aff6a-f55b-4b0b-a584-26719b530d39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:26.009256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-04f83a20-4528-4ef4-a95d-e41e24d6eec0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:26.009952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-04f83a20-4528-4ef4-a95d-e41e24d6eec0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:26.016561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04f83a20-4528-4ef4-a95d-e41e24d6eec0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:26.017006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04f83a20-4528-4ef4-a95d-e41e24d6eec0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:26.017772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04f83a20-4528-4ef4-a95d-e41e24d6eec0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:26.018249 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-04f83a20-4528-4ef4-a95d-e41e24d6eec0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:26.199094 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-886aff6a-f55b-4b0b-a584-26719b530d39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:26.202679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:26.203099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-04f83a20-4528-4ef4-a95d-e41e24d6eec0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:26.208463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-886aff6a-f55b-4b0b-a584-26719b530d39 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.235978 Aug 01 15:56:26.209262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1466/2604] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:25 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:56:26.212798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-04f83a20-4528-4ef4-a95d-e41e24d6eec0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:26.214309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-04f83a20-4528-4ef4-a95d-e41e24d6eec0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:26.215478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-04f83a20-4528-4ef4-a95d-e41e24d6eec0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.210695 Aug 01 15:56:26.216023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1139/2605] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:27.231760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-77aca223-30a8-4060-9ad4-c31643813fee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:27.232384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-77aca223-30a8-4060-9ad4-c31643813fee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:27.239365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-47f41339-95e5-445c-b6a4-afe73c2d022e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:27.240208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77aca223-30a8-4060-9ad4-c31643813fee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:27.240341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-47f41339-95e5-445c-b6a4-afe73c2d022e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:27.240598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77aca223-30a8-4060-9ad4-c31643813fee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:27.242129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77aca223-30a8-4060-9ad4-c31643813fee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:27.242541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77aca223-30a8-4060-9ad4-c31643813fee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:27.246897 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-47f41339-95e5-445c-b6a4-afe73c2d022e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:27.247294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-47f41339-95e5-445c-b6a4-afe73c2d022e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:27.248060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-47f41339-95e5-445c-b6a4-afe73c2d022e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:27.248490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-47f41339-95e5-445c-b6a4-afe73c2d022e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:27.447879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-47f41339-95e5-445c-b6a4-afe73c2d022e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:27.451023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-77aca223-30a8-4060-9ad4-c31643813fee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:27.456621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-47f41339-95e5-445c-b6a4-afe73c2d022e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:27.458147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-47f41339-95e5-445c-b6a4-afe73c2d022e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:27.459331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-47f41339-95e5-445c-b6a4-afe73c2d022e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.224849 Aug 01 15:56:27.459879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-77aca223-30a8-4060-9ad4-c31643813fee tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.231479 Aug 01 15:56:27.460011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1140/2606] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:27.460464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1467/2607] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:27 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:28.483622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-07d6a21d-08ee-4f0b-b241-e105eb719744 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:28.484427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-80b9cf67-4bcf-4132-a33a-2ab1cd25aee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:28.485026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-07d6a21d-08ee-4f0b-b241-e105eb719744 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:28.485185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-80b9cf67-4bcf-4132-a33a-2ab1cd25aee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:28.491017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07d6a21d-08ee-4f0b-b241-e105eb719744 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:28.491233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-80b9cf67-4bcf-4132-a33a-2ab1cd25aee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:28.491350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07d6a21d-08ee-4f0b-b241-e105eb719744 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:28.491464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-80b9cf67-4bcf-4132-a33a-2ab1cd25aee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:28.492112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07d6a21d-08ee-4f0b-b241-e105eb719744 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:28.492305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-80b9cf67-4bcf-4132-a33a-2ab1cd25aee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:28.492545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-07d6a21d-08ee-4f0b-b241-e105eb719744 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:28.492689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-80b9cf67-4bcf-4132-a33a-2ab1cd25aee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:28.692816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-07d6a21d-08ee-4f0b-b241-e105eb719744 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:28.696860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-80b9cf67-4bcf-4132-a33a-2ab1cd25aee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:28.704109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-07d6a21d-08ee-4f0b-b241-e105eb719744 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.224219 Aug 01 15:56:28.704694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1141/2608] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:28 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:56:28.706098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-80b9cf67-4bcf-4132-a33a-2ab1cd25aee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:28.707724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-80b9cf67-4bcf-4132-a33a-2ab1cd25aee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:28.709136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-80b9cf67-4bcf-4132-a33a-2ab1cd25aee9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.229272 Aug 01 15:56:28.710327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1468/2609] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:29.728281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-43434ffb-4f80-4bcd-bae0-28694574c202 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:29.729030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-43434ffb-4f80-4bcd-bae0-28694574c202 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:29.732137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-deae6745-1578-4db1-9b6d-da7cd62eab3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:29.732751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-deae6745-1578-4db1-9b6d-da7cd62eab3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:29.736231 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43434ffb-4f80-4bcd-bae0-28694574c202 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:29.736727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43434ffb-4f80-4bcd-bae0-28694574c202 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:29.737633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43434ffb-4f80-4bcd-bae0-28694574c202 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:29.738169 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-43434ffb-4f80-4bcd-bae0-28694574c202 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:29.739499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-deae6745-1578-4db1-9b6d-da7cd62eab3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:29.739951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-deae6745-1578-4db1-9b6d-da7cd62eab3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:29.740719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-deae6745-1578-4db1-9b6d-da7cd62eab3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:29.741155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-deae6745-1578-4db1-9b6d-da7cd62eab3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:29.946682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-deae6745-1578-4db1-9b6d-da7cd62eab3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:29.950657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-43434ffb-4f80-4bcd-bae0-28694574c202 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:29.959118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-deae6745-1578-4db1-9b6d-da7cd62eab3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:29.959505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-43434ffb-4f80-4bcd-bae0-28694574c202 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.236159 Aug 01 15:56:29.964034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1142/2610] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:29 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:29.964362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-deae6745-1578-4db1-9b6d-da7cd62eab3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:29.964362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-deae6745-1578-4db1-9b6d-da7cd62eab3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.234721 Aug 01 15:56:29.964362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1469/2611] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:30.987951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2cf1c1c9-f3c7-4dfc-828d-5259fcb1978f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:30.988877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-202cbbcf-9de8-4256-9cf7-41b5806c7d36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:30.989390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2cf1c1c9-f3c7-4dfc-828d-5259fcb1978f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:30.989536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-202cbbcf-9de8-4256-9cf7-41b5806c7d36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:30.995392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-202cbbcf-9de8-4256-9cf7-41b5806c7d36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:30.995838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-202cbbcf-9de8-4256-9cf7-41b5806c7d36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:30.996040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2cf1c1c9-f3c7-4dfc-828d-5259fcb1978f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:30.996634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-202cbbcf-9de8-4256-9cf7-41b5806c7d36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:30.996748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2cf1c1c9-f3c7-4dfc-828d-5259fcb1978f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:30.997063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-202cbbcf-9de8-4256-9cf7-41b5806c7d36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:30.997498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2cf1c1c9-f3c7-4dfc-828d-5259fcb1978f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:30.997956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2cf1c1c9-f3c7-4dfc-828d-5259fcb1978f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:31.200446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-202cbbcf-9de8-4256-9cf7-41b5806c7d36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:31.204827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2cf1c1c9-f3c7-4dfc-828d-5259fcb1978f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:31.209464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-202cbbcf-9de8-4256-9cf7-41b5806c7d36 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.225013 Aug 01 15:56:31.210109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1470/2612] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:30 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:56:31.214028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2cf1c1c9-f3c7-4dfc-828d-5259fcb1978f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:31.215516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2cf1c1c9-f3c7-4dfc-828d-5259fcb1978f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:31.216667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2cf1c1c9-f3c7-4dfc-828d-5259fcb1978f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.233533 Aug 01 15:56:31.217207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1143/2613] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:32.236449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b7c17d4f-7560-4954-bf26-9cc2748ca447 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:32.237277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b7c17d4f-7560-4954-bf26-9cc2748ca447 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:32.239390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=48 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:32.240517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f3170e6c-fe33-46d6-bf0e-309234431c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:32.241239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f3170e6c-fe33-46d6-bf0e-309234431c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:32.245840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b7c17d4f-7560-4954-bf26-9cc2748ca447 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:32.246324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b7c17d4f-7560-4954-bf26-9cc2748ca447 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:32.247100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b7c17d4f-7560-4954-bf26-9cc2748ca447 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:32.247540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b7c17d4f-7560-4954-bf26-9cc2748ca447 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:32.248238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f3170e6c-fe33-46d6-bf0e-309234431c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:32.248692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f3170e6c-fe33-46d6-bf0e-309234431c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:32.249462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f3170e6c-fe33-46d6-bf0e-309234431c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:32.249913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f3170e6c-fe33-46d6-bf0e-309234431c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:32.442549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b7c17d4f-7560-4954-bf26-9cc2748ca447 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:32.446447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f3170e6c-fe33-46d6-bf0e-309234431c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:32.450863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b7c17d4f-7560-4954-bf26-9cc2748ca447 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.218333 Aug 01 15:56:32.451450 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1471/2614] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:32 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:32.454825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f3170e6c-fe33-46d6-bf0e-309234431c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:32.456333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f3170e6c-fe33-46d6-bf0e-309234431c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:32.457498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f3170e6c-fe33-46d6-bf0e-309234431c12 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.220904 Aug 01 15:56:32.458129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1144/2615] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:33.472771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-87c786d0-56c1-47dd-9ba9-a5555d6758f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:33.473381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-87c786d0-56c1-47dd-9ba9-a5555d6758f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:33.480559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-88f4a730-395c-43be-8a0e-8cbe26c1ee0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:33.481077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87c786d0-56c1-47dd-9ba9-a5555d6758f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:33.481077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87c786d0-56c1-47dd-9ba9-a5555d6758f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:33.481292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-88f4a730-395c-43be-8a0e-8cbe26c1ee0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:33.481760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87c786d0-56c1-47dd-9ba9-a5555d6758f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:33.482245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87c786d0-56c1-47dd-9ba9-a5555d6758f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:33.487324 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-88f4a730-395c-43be-8a0e-8cbe26c1ee0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:33.487777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-88f4a730-395c-43be-8a0e-8cbe26c1ee0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:33.488536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-88f4a730-395c-43be-8a0e-8cbe26c1ee0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:33.488971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-88f4a730-395c-43be-8a0e-8cbe26c1ee0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:33.684215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-87c786d0-56c1-47dd-9ba9-a5555d6758f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:33.688048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-88f4a730-395c-43be-8a0e-8cbe26c1ee0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:33.693203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-87c786d0-56c1-47dd-9ba9-a5555d6758f0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.224257 Aug 01 15:56:33.693878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1472/2616] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:33 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:33.696602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-88f4a730-395c-43be-8a0e-8cbe26c1ee0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:33.698140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-88f4a730-395c-43be-8a0e-8cbe26c1ee0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:33.699312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-88f4a730-395c-43be-8a0e-8cbe26c1ee0f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.222492 Aug 01 15:56:33.699861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1145/2617] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:34.715666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-72acbb78-332f-43ce-98ec-8ad48909fe26 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:34.716480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-72acbb78-332f-43ce-98ec-8ad48909fe26 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:34.722518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7a1c6186-d475-4bc2-abf5-a9fd233734e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:34.723309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7a1c6186-d475-4bc2-abf5-a9fd233734e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:34.723799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72acbb78-332f-43ce-98ec-8ad48909fe26 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:34.724274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72acbb78-332f-43ce-98ec-8ad48909fe26 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:34.725291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72acbb78-332f-43ce-98ec-8ad48909fe26 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:34.725733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72acbb78-332f-43ce-98ec-8ad48909fe26 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:34.730626 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7a1c6186-d475-4bc2-abf5-a9fd233734e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:34.731099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7a1c6186-d475-4bc2-abf5-a9fd233734e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:34.731924 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7a1c6186-d475-4bc2-abf5-a9fd233734e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:34.732409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7a1c6186-d475-4bc2-abf5-a9fd233734e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:34.928987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-72acbb78-332f-43ce-98ec-8ad48909fe26 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:34.932873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7a1c6186-d475-4bc2-abf5-a9fd233734e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:34.937770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-72acbb78-332f-43ce-98ec-8ad48909fe26 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.226772 Aug 01 15:56:34.938478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1473/2618] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:34 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:34.941684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7a1c6186-d475-4bc2-abf5-a9fd233734e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:34.943205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7a1c6186-d475-4bc2-abf5-a9fd233734e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:34.944420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7a1c6186-d475-4bc2-abf5-a9fd233734e5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.226025 Aug 01 15:56:34.946140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1146/2619] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:35.960362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dc109ba3-1076-4cc7-affe-cdc94ad9fc72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:35.961251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dc109ba3-1076-4cc7-affe-cdc94ad9fc72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:35.967722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc109ba3-1076-4cc7-affe-cdc94ad9fc72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:35.968001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0ad70cf0-b1fa-41ce-ae29-d9998afeef8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:35.968438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc109ba3-1076-4cc7-affe-cdc94ad9fc72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:35.968624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0ad70cf0-b1fa-41ce-ae29-d9998afeef8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:35.968929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc109ba3-1076-4cc7-affe-cdc94ad9fc72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:35.969363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc109ba3-1076-4cc7-affe-cdc94ad9fc72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:35.976174 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ad70cf0-b1fa-41ce-ae29-d9998afeef8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:35.976625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ad70cf0-b1fa-41ce-ae29-d9998afeef8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:35.978048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ad70cf0-b1fa-41ce-ae29-d9998afeef8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:35.978656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ad70cf0-b1fa-41ce-ae29-d9998afeef8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:36.432802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dc109ba3-1076-4cc7-affe-cdc94ad9fc72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:36.436147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0ad70cf0-b1fa-41ce-ae29-d9998afeef8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:36.442792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dc109ba3-1076-4cc7-affe-cdc94ad9fc72 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.486206 Aug 01 15:56:36.444138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1474/2620] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:35 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:36.445701 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0ad70cf0-b1fa-41ce-ae29-d9998afeef8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:36.447266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0ad70cf0-b1fa-41ce-ae29-d9998afeef8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:36.448452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0ad70cf0-b1fa-41ce-ae29-d9998afeef8e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.484335 Aug 01 15:56:36.449040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1147/2621] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:37.465686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0e4a9c46-9204-4892-bbe9-35024f5e8569 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:37.466313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0e4a9c46-9204-4892-bbe9-35024f5e8569 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:37.471874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-828114e6-0ab7-4481-af16-712ff079ade7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:37.472507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-828114e6-0ab7-4481-af16-712ff079ade7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:37.473283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e4a9c46-9204-4892-bbe9-35024f5e8569 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:37.473700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e4a9c46-9204-4892-bbe9-35024f5e8569 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:37.474874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e4a9c46-9204-4892-bbe9-35024f5e8569 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:37.475275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e4a9c46-9204-4892-bbe9-35024f5e8569 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:37.479993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-828114e6-0ab7-4481-af16-712ff079ade7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:37.480415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-828114e6-0ab7-4481-af16-712ff079ade7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:37.481181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-828114e6-0ab7-4481-af16-712ff079ade7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:37.481642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-828114e6-0ab7-4481-af16-712ff079ade7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:37.669754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-828114e6-0ab7-4481-af16-712ff079ade7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:37.673640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0e4a9c46-9204-4892-bbe9-35024f5e8569 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:37.678636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-828114e6-0ab7-4481-af16-712ff079ade7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:37.680788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-828114e6-0ab7-4481-af16-712ff079ade7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:37.682031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-828114e6-0ab7-4481-af16-712ff079ade7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.214088 Aug 01 15:56:37.682590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1148/2622] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:37.682837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0e4a9c46-9204-4892-bbe9-35024f5e8569 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.221572 Aug 01 15:56:37.683391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1475/2623] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:37 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:38.705290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-46f2f20d-7abc-4990-8e67-2a2230a16755 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:38.707784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-46f2f20d-7abc-4990-8e67-2a2230a16755 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:38.707956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-16bd2359-174d-40bd-96e1-ef185f930075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:38.708837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-16bd2359-174d-40bd-96e1-ef185f930075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:38.713169 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-46f2f20d-7abc-4990-8e67-2a2230a16755 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:38.713617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-46f2f20d-7abc-4990-8e67-2a2230a16755 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:38.714430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-46f2f20d-7abc-4990-8e67-2a2230a16755 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:38.714870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-46f2f20d-7abc-4990-8e67-2a2230a16755 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:38.716180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16bd2359-174d-40bd-96e1-ef185f930075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:38.716625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16bd2359-174d-40bd-96e1-ef185f930075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:38.717389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16bd2359-174d-40bd-96e1-ef185f930075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:38.717851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16bd2359-174d-40bd-96e1-ef185f930075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:38.915568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-16bd2359-174d-40bd-96e1-ef185f930075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:38.920088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-46f2f20d-7abc-4990-8e67-2a2230a16755 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:38.925438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-16bd2359-174d-40bd-96e1-ef185f930075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:38.927077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-16bd2359-174d-40bd-96e1-ef185f930075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:38.928296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-16bd2359-174d-40bd-96e1-ef185f930075 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.226850 Aug 01 15:56:38.928431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-46f2f20d-7abc-4990-8e67-2a2230a16755 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.227233 Aug 01 15:56:38.928906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1476/2624] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:38.929064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1149/2625] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:38 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:39.950324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ce725b7f-5b0a-484a-9734-ddd921a84af9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:39.950914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-baa08318-a561-49b1-9c55-05e39bcdfff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:39.951291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ce725b7f-5b0a-484a-9734-ddd921a84af9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:39.951403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-baa08318-a561-49b1-9c55-05e39bcdfff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:39.957754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce725b7f-5b0a-484a-9734-ddd921a84af9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:39.958237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce725b7f-5b0a-484a-9734-ddd921a84af9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:39.958375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-baa08318-a561-49b1-9c55-05e39bcdfff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:39.958747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-baa08318-a561-49b1-9c55-05e39bcdfff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:39.959095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce725b7f-5b0a-484a-9734-ddd921a84af9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:39.959528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-baa08318-a561-49b1-9c55-05e39bcdfff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:39.959717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce725b7f-5b0a-484a-9734-ddd921a84af9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:39.959973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-baa08318-a561-49b1-9c55-05e39bcdfff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:40.168226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ce725b7f-5b0a-484a-9734-ddd921a84af9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:40.171575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-baa08318-a561-49b1-9c55-05e39bcdfff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:40.176928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ce725b7f-5b0a-484a-9734-ddd921a84af9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:40.178479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ce725b7f-5b0a-484a-9734-ddd921a84af9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:40.179655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ce725b7f-5b0a-484a-9734-ddd921a84af9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.233371 Aug 01 15:56:40.179840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-baa08318-a561-49b1-9c55-05e39bcdfff9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.233628 Aug 01 15:56:40.180214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1477/2626] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:40.180394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1150/2627] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:39 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:41.201392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e34ba65d-7a3b-40bd-9ef7-c277bbdf17ac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:41.202384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e34ba65d-7a3b-40bd-9ef7-c277bbdf17ac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:41.206844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a9443d68-89e6-4eb7-b7c0-df9c40542e29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:41.207920 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a9443d68-89e6-4eb7-b7c0-df9c40542e29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:41.213576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e34ba65d-7a3b-40bd-9ef7-c277bbdf17ac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:41.214365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e34ba65d-7a3b-40bd-9ef7-c277bbdf17ac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:41.215637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e34ba65d-7a3b-40bd-9ef7-c277bbdf17ac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:41.216369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e34ba65d-7a3b-40bd-9ef7-c277bbdf17ac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:41.219008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9443d68-89e6-4eb7-b7c0-df9c40542e29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:41.219746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9443d68-89e6-4eb7-b7c0-df9c40542e29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:41.220994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9443d68-89e6-4eb7-b7c0-df9c40542e29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:41.221719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9443d68-89e6-4eb7-b7c0-df9c40542e29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:41.439474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e34ba65d-7a3b-40bd-9ef7-c277bbdf17ac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:41.444051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a9443d68-89e6-4eb7-b7c0-df9c40542e29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:41.449772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e34ba65d-7a3b-40bd-9ef7-c277bbdf17ac tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.252899 Aug 01 15:56:41.450441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1478/2628] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:41 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:56:41.459299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a9443d68-89e6-4eb7-b7c0-df9c40542e29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:41.460752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a9443d68-89e6-4eb7-b7c0-df9c40542e29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:41.462125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a9443d68-89e6-4eb7-b7c0-df9c40542e29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.261948 Aug 01 15:56:41.462832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1151/2629] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:42.471752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5e32fc69-4022-4f49-a8bc-270be7b3cdff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:42.472359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5e32fc69-4022-4f49-a8bc-270be7b3cdff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:42.479858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e32fc69-4022-4f49-a8bc-270be7b3cdff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:42.480296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e32fc69-4022-4f49-a8bc-270be7b3cdff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:42.481052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e32fc69-4022-4f49-a8bc-270be7b3cdff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:42.481520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e32fc69-4022-4f49-a8bc-270be7b3cdff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:42.487315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e2f210c2-d008-4783-b1ad-fcec7c634c3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:42.488008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e2f210c2-d008-4783-b1ad-fcec7c634c3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:42.495350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2f210c2-d008-4783-b1ad-fcec7c634c3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:42.495801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2f210c2-d008-4783-b1ad-fcec7c634c3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:42.496592 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2f210c2-d008-4783-b1ad-fcec7c634c3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:42.497024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e2f210c2-d008-4783-b1ad-fcec7c634c3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:42.696224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5e32fc69-4022-4f49-a8bc-270be7b3cdff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:42.700218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e2f210c2-d008-4783-b1ad-fcec7c634c3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:42.705097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5e32fc69-4022-4f49-a8bc-270be7b3cdff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.237110 Aug 01 15:56:42.705666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1479/2630] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:42 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:42.709269 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e2f210c2-d008-4783-b1ad-fcec7c634c3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:42.710900 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e2f210c2-d008-4783-b1ad-fcec7c634c3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:42.712181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e2f210c2-d008-4783-b1ad-fcec7c634c3f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.229252 Aug 01 15:56:42.713445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1152/2631] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:42 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:43.727846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c03ca44d-cafe-4bd4-9f74-c71be4ffe974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:43.729091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c03ca44d-cafe-4bd4-9f74-c71be4ffe974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:43.736110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c03ca44d-cafe-4bd4-9f74-c71be4ffe974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:43.736558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c03ca44d-cafe-4bd4-9f74-c71be4ffe974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:43.736682 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-39bc47d6-ec22-43c4-a912-f35150a7a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:43.737271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-39bc47d6-ec22-43c4-a912-f35150a7a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:43.737377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c03ca44d-cafe-4bd4-9f74-c71be4ffe974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:43.737753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c03ca44d-cafe-4bd4-9f74-c71be4ffe974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:43.744877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39bc47d6-ec22-43c4-a912-f35150a7a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:43.745339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39bc47d6-ec22-43c4-a912-f35150a7a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:43.746154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39bc47d6-ec22-43c4-a912-f35150a7a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:43.746590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39bc47d6-ec22-43c4-a912-f35150a7a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:43.944751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c03ca44d-cafe-4bd4-9f74-c71be4ffe974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:43.949867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-39bc47d6-ec22-43c4-a912-f35150a7a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:43.956620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c03ca44d-cafe-4bd4-9f74-c71be4ffe974 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.232839 Aug 01 15:56:43.957623 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1480/2632] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:43 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:43.959970 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-39bc47d6-ec22-43c4-a912-f35150a7a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:43.961614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-39bc47d6-ec22-43c4-a912-f35150a7a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:43.963357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-39bc47d6-ec22-43c4-a912-f35150a7a86f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.230184 Aug 01 15:56:43.963895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1153/2633] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:44.985538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-54a7f0b5-134f-4900-b9b3-441637df56fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:44.986182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-54a7f0b5-134f-4900-b9b3-441637df56fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:44.987907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-503b58eb-db80-479c-ba68-90d6064d7421 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:44.988865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-503b58eb-db80-479c-ba68-90d6064d7421 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:44.991438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=48 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:44.992810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54a7f0b5-134f-4900-b9b3-441637df56fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:44.993343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54a7f0b5-134f-4900-b9b3-441637df56fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:44.994782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54a7f0b5-134f-4900-b9b3-441637df56fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:44.995215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54a7f0b5-134f-4900-b9b3-441637df56fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:44.997784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-503b58eb-db80-479c-ba68-90d6064d7421 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:44.998268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-503b58eb-db80-479c-ba68-90d6064d7421 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:44.999045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-503b58eb-db80-479c-ba68-90d6064d7421 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:44.999485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-503b58eb-db80-479c-ba68-90d6064d7421 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:45.017715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:45.192919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-54a7f0b5-134f-4900-b9b3-441637df56fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:45.196117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-503b58eb-db80-479c-ba68-90d6064d7421 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:45.201005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-54a7f0b5-134f-4900-b9b3-441637df56fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.219614 Aug 01 15:56:45.201662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1481/2634] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:44 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:45.204489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-503b58eb-db80-479c-ba68-90d6064d7421 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:45.206000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-503b58eb-db80-479c-ba68-90d6064d7421 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:45.207275 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-503b58eb-db80-479c-ba68-90d6064d7421 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.223701 Aug 01 15:56:45.207829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1154/2635] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:46.223057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1907ae63-b229-4d37-b8d8-8328adf91642 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:46.223660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1907ae63-b229-4d37-b8d8-8328adf91642 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:46.230242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1907ae63-b229-4d37-b8d8-8328adf91642 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:46.230432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7453a113-0e2d-4df7-8608-49ffc3275379 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:46.230859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1907ae63-b229-4d37-b8d8-8328adf91642 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:46.231032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7453a113-0e2d-4df7-8608-49ffc3275379 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:46.231425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1907ae63-b229-4d37-b8d8-8328adf91642 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:46.231856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1907ae63-b229-4d37-b8d8-8328adf91642 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:46.237514 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7453a113-0e2d-4df7-8608-49ffc3275379 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:46.237995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7453a113-0e2d-4df7-8608-49ffc3275379 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:46.238772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7453a113-0e2d-4df7-8608-49ffc3275379 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:46.239414 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7453a113-0e2d-4df7-8608-49ffc3275379 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:46.433189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1907ae63-b229-4d37-b8d8-8328adf91642 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:46.440043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7453a113-0e2d-4df7-8608-49ffc3275379 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:46.442085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1907ae63-b229-4d37-b8d8-8328adf91642 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.222641 Aug 01 15:56:46.442858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1482/2636] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:46 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:46.453294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7453a113-0e2d-4df7-8608-49ffc3275379 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:46.453294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7453a113-0e2d-4df7-8608-49ffc3275379 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:46.453294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7453a113-0e2d-4df7-8608-49ffc3275379 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.225984 Aug 01 15:56:46.453662 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1155/2637] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:47.464430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-acfe1b27-e581-40e0-a268-0651153fbe6b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:47.465049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-acfe1b27-e581-40e0-a268-0651153fbe6b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:47.471951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-acfe1b27-e581-40e0-a268-0651153fbe6b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:47.472407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-acfe1b27-e581-40e0-a268-0651153fbe6b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:47.473221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-acfe1b27-e581-40e0-a268-0651153fbe6b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:47.473714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-acfe1b27-e581-40e0-a268-0651153fbe6b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:47.475585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-18e106b2-c1a7-4c60-851d-7d71f195ea7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:47.476255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-18e106b2-c1a7-4c60-851d-7d71f195ea7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:47.483021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18e106b2-c1a7-4c60-851d-7d71f195ea7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:47.483475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18e106b2-c1a7-4c60-851d-7d71f195ea7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:47.484253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18e106b2-c1a7-4c60-851d-7d71f195ea7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:47.484694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-18e106b2-c1a7-4c60-851d-7d71f195ea7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:47.496133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:56:47.676687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-18e106b2-c1a7-4c60-851d-7d71f195ea7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:47.679949 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-acfe1b27-e581-40e0-a268-0651153fbe6b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:47.686527 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-18e106b2-c1a7-4c60-851d-7d71f195ea7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:47.688044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-18e106b2-c1a7-4c60-851d-7d71f195ea7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:47.688549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-acfe1b27-e581-40e0-a268-0651153fbe6b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.227954 Aug 01 15:56:47.689120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1483/2638] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:47 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:47.689282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-18e106b2-c1a7-4c60-851d-7d71f195ea7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.218296 Aug 01 15:56:47.689747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1156/2639] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:48.710539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0b73a604-9f26-40e5-bcd9-81018b276393 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:48.711097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0b73a604-9f26-40e5-bcd9-81018b276393 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:48.712395 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8e920dfd-deb9-4444-995e-62f4d8906ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:48.713011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8e920dfd-deb9-4444-995e-62f4d8906ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:48.719616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b73a604-9f26-40e5-bcd9-81018b276393 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:48.720090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e920dfd-deb9-4444-995e-62f4d8906ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:48.720239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b73a604-9f26-40e5-bcd9-81018b276393 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:48.720542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e920dfd-deb9-4444-995e-62f4d8906ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:48.721050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b73a604-9f26-40e5-bcd9-81018b276393 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:48.721303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e920dfd-deb9-4444-995e-62f4d8906ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:48.721556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b73a604-9f26-40e5-bcd9-81018b276393 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:48.722029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e920dfd-deb9-4444-995e-62f4d8906ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:48.926582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8e920dfd-deb9-4444-995e-62f4d8906ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:48.935981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0b73a604-9f26-40e5-bcd9-81018b276393 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:48.936164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8e920dfd-deb9-4444-995e-62f4d8906ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:48.937630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8e920dfd-deb9-4444-995e-62f4d8906ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:48.939040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8e920dfd-deb9-4444-995e-62f4d8906ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.230296 Aug 01 15:56:48.939744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1157/2640] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:48.944711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0b73a604-9f26-40e5-bcd9-81018b276393 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.238202 Aug 01 15:56:48.945283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1484/2641] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:48 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:49.962551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d6c6a236-d21d-45d4-8954-17a5235c6f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:49.963146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d6c6a236-d21d-45d4-8954-17a5235c6f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:49.967622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4a79c7fe-4e22-459a-b2f8-03d16efc7a08 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:49.968230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4a79c7fe-4e22-459a-b2f8-03d16efc7a08 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:49.969803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6c6a236-d21d-45d4-8954-17a5235c6f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:49.970272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6c6a236-d21d-45d4-8954-17a5235c6f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:49.971030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6c6a236-d21d-45d4-8954-17a5235c6f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:49.971465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6c6a236-d21d-45d4-8954-17a5235c6f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:49.975214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a79c7fe-4e22-459a-b2f8-03d16efc7a08 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:49.975669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a79c7fe-4e22-459a-b2f8-03d16efc7a08 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:49.976452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a79c7fe-4e22-459a-b2f8-03d16efc7a08 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:49.976889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4a79c7fe-4e22-459a-b2f8-03d16efc7a08 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:50.177548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d6c6a236-d21d-45d4-8954-17a5235c6f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:50.182179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4a79c7fe-4e22-459a-b2f8-03d16efc7a08 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:50.187117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d6c6a236-d21d-45d4-8954-17a5235c6f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:50.188872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d6c6a236-d21d-45d4-8954-17a5235c6f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:50.189969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d6c6a236-d21d-45d4-8954-17a5235c6f34 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.231307 Aug 01 15:56:50.190532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1158/2642] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:50.191633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4a79c7fe-4e22-459a-b2f8-03d16efc7a08 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.228063 Aug 01 15:56:50.192201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1485/2643] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:49 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:56:51.212786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-22419108-5853-4afa-8a64-254e3589f520 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:51.213431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-22419108-5853-4afa-8a64-254e3589f520 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:51.213765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-84e400e1-15ae-4ae0-a9e8-d3ea5784ea1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:51.214460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-84e400e1-15ae-4ae0-a9e8-d3ea5784ea1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:51.220267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22419108-5853-4afa-8a64-254e3589f520 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:51.220745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22419108-5853-4afa-8a64-254e3589f520 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:51.221522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22419108-5853-4afa-8a64-254e3589f520 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:51.221795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84e400e1-15ae-4ae0-a9e8-d3ea5784ea1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:51.222006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22419108-5853-4afa-8a64-254e3589f520 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:51.222566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84e400e1-15ae-4ae0-a9e8-d3ea5784ea1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:51.223480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84e400e1-15ae-4ae0-a9e8-d3ea5784ea1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:51.223966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84e400e1-15ae-4ae0-a9e8-d3ea5784ea1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:51.442448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-22419108-5853-4afa-8a64-254e3589f520 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:51.447424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-84e400e1-15ae-4ae0-a9e8-d3ea5784ea1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:51.451762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-22419108-5853-4afa-8a64-254e3589f520 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.242277 Aug 01 15:56:51.452346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1159/2644] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:51 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:51.457403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-84e400e1-15ae-4ae0-a9e8-d3ea5784ea1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:51.459167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-84e400e1-15ae-4ae0-a9e8-d3ea5784ea1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:51.460348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-84e400e1-15ae-4ae0-a9e8-d3ea5784ea1b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.251345 Aug 01 15:56:51.460918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1486/2645] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:52.474143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-891adaf0-04e2-4768-9b7e-576d65af0a1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:52.475136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-891adaf0-04e2-4768-9b7e-576d65af0a1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:52.481601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-891adaf0-04e2-4768-9b7e-576d65af0a1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:52.482087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-891adaf0-04e2-4768-9b7e-576d65af0a1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:52.482843 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-891adaf0-04e2-4768-9b7e-576d65af0a1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:52.483279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-891adaf0-04e2-4768-9b7e-576d65af0a1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:52.488028 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d1bb92b7-c43a-4280-8fc5-dbf0a853bb2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:52.488642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d1bb92b7-c43a-4280-8fc5-dbf0a853bb2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:52.495171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d1bb92b7-c43a-4280-8fc5-dbf0a853bb2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:52.495619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d1bb92b7-c43a-4280-8fc5-dbf0a853bb2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:52.496384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d1bb92b7-c43a-4280-8fc5-dbf0a853bb2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:52.496815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d1bb92b7-c43a-4280-8fc5-dbf0a853bb2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:52.696280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-891adaf0-04e2-4768-9b7e-576d65af0a1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:52.700928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d1bb92b7-c43a-4280-8fc5-dbf0a853bb2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:52.705160 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-891adaf0-04e2-4768-9b7e-576d65af0a1c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.234873 Aug 01 15:56:52.705735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1160/2646] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:52 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:52.710125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d1bb92b7-c43a-4280-8fc5-dbf0a853bb2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:52.711630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d1bb92b7-c43a-4280-8fc5-dbf0a853bb2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:52.712805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d1bb92b7-c43a-4280-8fc5-dbf0a853bb2a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.228630 Aug 01 15:56:52.713362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1487/2647] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:53.727330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-65f5fd68-39bb-4d03-97cc-855c9c40d496 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:53.727974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-65f5fd68-39bb-4d03-97cc-855c9c40d496 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:53.735418 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f5fd68-39bb-4d03-97cc-855c9c40d496 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:53.735874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f5fd68-39bb-4d03-97cc-855c9c40d496 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:53.736647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f5fd68-39bb-4d03-97cc-855c9c40d496 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:53.736914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3568a66d-41d6-416a-b03b-6b2ff1de3638 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:53.737353 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f5fd68-39bb-4d03-97cc-855c9c40d496 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:53.737562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3568a66d-41d6-416a-b03b-6b2ff1de3638 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:53.744576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3568a66d-41d6-416a-b03b-6b2ff1de3638 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:53.745451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3568a66d-41d6-416a-b03b-6b2ff1de3638 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:53.746243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3568a66d-41d6-416a-b03b-6b2ff1de3638 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:53.746685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3568a66d-41d6-416a-b03b-6b2ff1de3638 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:53.949417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-65f5fd68-39bb-4d03-97cc-855c9c40d496 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:53.954142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3568a66d-41d6-416a-b03b-6b2ff1de3638 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:53.957916 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-65f5fd68-39bb-4d03-97cc-855c9c40d496 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.234605 Aug 01 15:56:53.958505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1161/2648] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:53 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:53.963047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3568a66d-41d6-416a-b03b-6b2ff1de3638 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:53.965144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3568a66d-41d6-416a-b03b-6b2ff1de3638 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:53.966839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3568a66d-41d6-416a-b03b-6b2ff1de3638 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.234274 Aug 01 15:56:53.973510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1488/2649] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:56:54.981045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-031b1aa5-0d66-41f6-b767-165005438682 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:54.982358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-031b1aa5-0d66-41f6-b767-165005438682 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:54.989492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-031b1aa5-0d66-41f6-b767-165005438682 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:54.990004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-031b1aa5-0d66-41f6-b767-165005438682 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:54.990758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-031b1aa5-0d66-41f6-b767-165005438682 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:54.991212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-031b1aa5-0d66-41f6-b767-165005438682 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:54.992144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c775d988-410d-4c27-8f15-e1637ff18441 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:54.993178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c775d988-410d-4c27-8f15-e1637ff18441 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:55.001877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c775d988-410d-4c27-8f15-e1637ff18441 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:55.002349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c775d988-410d-4c27-8f15-e1637ff18441 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:55.003309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c775d988-410d-4c27-8f15-e1637ff18441 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:55.003765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c775d988-410d-4c27-8f15-e1637ff18441 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:55.230492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-031b1aa5-0d66-41f6-b767-165005438682 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:55.240682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c775d988-410d-4c27-8f15-e1637ff18441 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:55.240982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-031b1aa5-0d66-41f6-b767-165005438682 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.263682 Aug 01 15:56:55.241937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1162/2650] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:54 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:55.258363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c775d988-410d-4c27-8f15-e1637ff18441 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:55.260253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c775d988-410d-4c27-8f15-e1637ff18441 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:55.262165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c775d988-410d-4c27-8f15-e1637ff18441 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.275507 Aug 01 15:56:55.262775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1489/2651] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:56.263180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-dbafd545-a112-4851-96ea-7016c2cb07dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:56.263889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-dbafd545-a112-4851-96ea-7016c2cb07dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:56.270916 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dbafd545-a112-4851-96ea-7016c2cb07dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:56.271356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dbafd545-a112-4851-96ea-7016c2cb07dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:56.272155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dbafd545-a112-4851-96ea-7016c2cb07dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:56.272585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dbafd545-a112-4851-96ea-7016c2cb07dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:56.288538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7d195879-7b33-454f-b322-faf1abf33669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:56.289401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7d195879-7b33-454f-b322-faf1abf33669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:56.296733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d195879-7b33-454f-b322-faf1abf33669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:56.297261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d195879-7b33-454f-b322-faf1abf33669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:56.298204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d195879-7b33-454f-b322-faf1abf33669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:56.298699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d195879-7b33-454f-b322-faf1abf33669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:56.513992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dbafd545-a112-4851-96ea-7016c2cb07dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:56.528225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-dbafd545-a112-4851-96ea-7016c2cb07dc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.268776 Aug 01 15:56:56.529184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1163/2652] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:56 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:56.541687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7d195879-7b33-454f-b322-faf1abf33669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:56.556995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7d195879-7b33-454f-b322-faf1abf33669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:56.559519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7d195879-7b33-454f-b322-faf1abf33669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:56.561340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7d195879-7b33-454f-b322-faf1abf33669 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.276824 Aug 01 15:56:56.562213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1490/2653] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:57.558898 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-76e15f2f-1d73-4d29-a5fa-9b023f0203f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:57.559807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-76e15f2f-1d73-4d29-a5fa-9b023f0203f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:57.566392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-76e15f2f-1d73-4d29-a5fa-9b023f0203f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:57.566838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-76e15f2f-1d73-4d29-a5fa-9b023f0203f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:57.567626 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-76e15f2f-1d73-4d29-a5fa-9b023f0203f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:57.568059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-76e15f2f-1d73-4d29-a5fa-9b023f0203f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:57.592741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-31f652e8-0f78-443c-b2ec-dd62781879f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:57.593351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-31f652e8-0f78-443c-b2ec-dd62781879f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:57.600436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31f652e8-0f78-443c-b2ec-dd62781879f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:57.600807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31f652e8-0f78-443c-b2ec-dd62781879f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:57.601653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31f652e8-0f78-443c-b2ec-dd62781879f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:57.602121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-31f652e8-0f78-443c-b2ec-dd62781879f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:57.785910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-76e15f2f-1d73-4d29-a5fa-9b023f0203f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:57.795335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-76e15f2f-1d73-4d29-a5fa-9b023f0203f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.240912 Aug 01 15:56:57.796037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1164/2654] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:57 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:57.809704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-31f652e8-0f78-443c-b2ec-dd62781879f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:57.818768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-31f652e8-0f78-443c-b2ec-dd62781879f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:57.820271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-31f652e8-0f78-443c-b2ec-dd62781879f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:57.821439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-31f652e8-0f78-443c-b2ec-dd62781879f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.232655 Aug 01 15:56:57.822015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1491/2655] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:56:58.820226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d89cbf49-2d80-47b4-bc27-7e2ee828b3df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:58.820777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d89cbf49-2d80-47b4-bc27-7e2ee828b3df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:58.827563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d89cbf49-2d80-47b4-bc27-7e2ee828b3df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:58.828079 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d89cbf49-2d80-47b4-bc27-7e2ee828b3df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:58.828779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d89cbf49-2d80-47b4-bc27-7e2ee828b3df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:58.829211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d89cbf49-2d80-47b4-bc27-7e2ee828b3df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:58.846182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8f01a792-2826-448a-b1fe-967633079319 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:56:58.846855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8f01a792-2826-448a-b1fe-967633079319 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:56:58.853920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f01a792-2826-448a-b1fe-967633079319 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:58.854350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f01a792-2826-448a-b1fe-967633079319 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:58.855743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f01a792-2826-448a-b1fe-967633079319 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:56:58.856186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f01a792-2826-448a-b1fe-967633079319 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:56:59.051048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d89cbf49-2d80-47b4-bc27-7e2ee828b3df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:59.060336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d89cbf49-2d80-47b4-bc27-7e2ee828b3df tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.244098 Aug 01 15:56:59.060924 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1165/2656] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:56:58 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:56:59.067139 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f01a792-2826-448a-b1fe-967633079319 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:59.076526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f01a792-2826-448a-b1fe-967633079319 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:59.077989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f01a792-2826-448a-b1fe-967633079319 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:56:59.079156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8f01a792-2826-448a-b1fe-967633079319 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.237079 Aug 01 15:56:59.079711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1492/2657] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:56:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:00.082901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1c416568-1a90-4934-b590-219a88990bd9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:00.083520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1c416568-1a90-4934-b590-219a88990bd9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:00.090740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c416568-1a90-4934-b590-219a88990bd9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:00.091195 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c416568-1a90-4934-b590-219a88990bd9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:00.091969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c416568-1a90-4934-b590-219a88990bd9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:00.092407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c416568-1a90-4934-b590-219a88990bd9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:00.106149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-34afb933-c9aa-4098-a17d-11a8c6d85e28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:00.107134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-34afb933-c9aa-4098-a17d-11a8c6d85e28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:00.115583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-34afb933-c9aa-4098-a17d-11a8c6d85e28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:00.115811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-34afb933-c9aa-4098-a17d-11a8c6d85e28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:00.116584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-34afb933-c9aa-4098-a17d-11a8c6d85e28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:00.117026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-34afb933-c9aa-4098-a17d-11a8c6d85e28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:00.313442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c416568-1a90-4934-b590-219a88990bd9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:00.320711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-34afb933-c9aa-4098-a17d-11a8c6d85e28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:00.321768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1c416568-1a90-4934-b590-219a88990bd9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.242923 Aug 01 15:57:00.322448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1166/2658] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:00 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:00.329913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-34afb933-c9aa-4098-a17d-11a8c6d85e28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:00.331438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-34afb933-c9aa-4098-a17d-11a8c6d85e28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:00.332600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-34afb933-c9aa-4098-a17d-11a8c6d85e28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.232844 Aug 01 15:57:00.333193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1493/2659] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:01.346284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0186d537-d2a5-4b8c-81de-d1da2dfe25af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:01.347023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0186d537-d2a5-4b8c-81de-d1da2dfe25af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:01.354266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0186d537-d2a5-4b8c-81de-d1da2dfe25af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:01.355213 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0186d537-d2a5-4b8c-81de-d1da2dfe25af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:01.355990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0186d537-d2a5-4b8c-81de-d1da2dfe25af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:01.356571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0186d537-d2a5-4b8c-81de-d1da2dfe25af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:01.359611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bbbb500f-ac72-4e46-afb1-7f631e61f8bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:01.361792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bbbb500f-ac72-4e46-afb1-7f631e61f8bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:01.372876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bbbb500f-ac72-4e46-afb1-7f631e61f8bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:01.373580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bbbb500f-ac72-4e46-afb1-7f631e61f8bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:01.375371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bbbb500f-ac72-4e46-afb1-7f631e61f8bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:01.376053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bbbb500f-ac72-4e46-afb1-7f631e61f8bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:01.578289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0186d537-d2a5-4b8c-81de-d1da2dfe25af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:01.586630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0186d537-d2a5-4b8c-81de-d1da2dfe25af tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.246104 Aug 01 15:57:01.587899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1167/2660] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:01 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:01.590516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bbbb500f-ac72-4e46-afb1-7f631e61f8bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:01.599531 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bbbb500f-ac72-4e46-afb1-7f631e61f8bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:01.601215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bbbb500f-ac72-4e46-afb1-7f631e61f8bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:01.602449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bbbb500f-ac72-4e46-afb1-7f631e61f8bb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.249357 Aug 01 15:57:01.603020 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1494/2661] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:02.610934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-398e8f4c-aa6a-4ff3-96b2-7f25315953be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:02.611554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-398e8f4c-aa6a-4ff3-96b2-7f25315953be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:02.618284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-398e8f4c-aa6a-4ff3-96b2-7f25315953be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:02.618764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-398e8f4c-aa6a-4ff3-96b2-7f25315953be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:02.619519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-398e8f4c-aa6a-4ff3-96b2-7f25315953be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:02.619960 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-398e8f4c-aa6a-4ff3-96b2-7f25315953be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:02.628082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-442725d6-a90d-4e77-939e-a20d848e4d1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:02.629146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-442725d6-a90d-4e77-939e-a20d848e4d1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:02.632913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=48 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:02.637670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-442725d6-a90d-4e77-939e-a20d848e4d1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:02.638136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-442725d6-a90d-4e77-939e-a20d848e4d1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:02.638928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-442725d6-a90d-4e77-939e-a20d848e4d1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:02.639359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-442725d6-a90d-4e77-939e-a20d848e4d1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:02.839835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-398e8f4c-aa6a-4ff3-96b2-7f25315953be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:02.844049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-442725d6-a90d-4e77-939e-a20d848e4d1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:02.853446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-442725d6-a90d-4e77-939e-a20d848e4d1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:02.854012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-398e8f4c-aa6a-4ff3-96b2-7f25315953be tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.246551 Aug 01 15:57:02.855390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1168/2662] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:02 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:02.855772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-442725d6-a90d-4e77-939e-a20d848e4d1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:02.857047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-442725d6-a90d-4e77-939e-a20d848e4d1c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.233761 Aug 01 15:57:02.857682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1495/2663] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:03.877941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-11d162f8-1d3b-4443-9e40-0c0970aa427f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:03.879397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-11d162f8-1d3b-4443-9e40-0c0970aa427f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:03.882451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-968c46a5-bbd1-44c6-b412-9cdb73d39678 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:03.883201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-968c46a5-bbd1-44c6-b412-9cdb73d39678 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:03.887446 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-11d162f8-1d3b-4443-9e40-0c0970aa427f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:03.887887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-11d162f8-1d3b-4443-9e40-0c0970aa427f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:03.888901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-11d162f8-1d3b-4443-9e40-0c0970aa427f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:03.889586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-11d162f8-1d3b-4443-9e40-0c0970aa427f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:03.891494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-968c46a5-bbd1-44c6-b412-9cdb73d39678 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:03.891913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-968c46a5-bbd1-44c6-b412-9cdb73d39678 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:03.892990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-968c46a5-bbd1-44c6-b412-9cdb73d39678 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:03.893495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-968c46a5-bbd1-44c6-b412-9cdb73d39678 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:04.105707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-968c46a5-bbd1-44c6-b412-9cdb73d39678 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:04.114957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-968c46a5-bbd1-44c6-b412-9cdb73d39678 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:04.116359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-968c46a5-bbd1-44c6-b412-9cdb73d39678 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:04.117647 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-968c46a5-bbd1-44c6-b412-9cdb73d39678 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.240966 Aug 01 15:57:04.118149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1496/2664] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:04.118297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-11d162f8-1d3b-4443-9e40-0c0970aa427f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:04.127566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-11d162f8-1d3b-4443-9e40-0c0970aa427f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.254140 Aug 01 15:57:04.128143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1169/2665] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:03 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:05.143482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6c506366-10b6-47a7-a28e-f9f95c3359ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:05.144209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6c506366-10b6-47a7-a28e-f9f95c3359ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:05.151175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-337dd58d-e9d0-479f-809b-aeb371f22577 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:05.152652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c506366-10b6-47a7-a28e-f9f95c3359ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:05.152652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c506366-10b6-47a7-a28e-f9f95c3359ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:05.152963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-337dd58d-e9d0-479f-809b-aeb371f22577 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:05.153237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c506366-10b6-47a7-a28e-f9f95c3359ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:05.153635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c506366-10b6-47a7-a28e-f9f95c3359ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:05.159585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-337dd58d-e9d0-479f-809b-aeb371f22577 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:05.160045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-337dd58d-e9d0-479f-809b-aeb371f22577 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:05.160829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-337dd58d-e9d0-479f-809b-aeb371f22577 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:05.161275 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-337dd58d-e9d0-479f-809b-aeb371f22577 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:05.374271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6c506366-10b6-47a7-a28e-f9f95c3359ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:05.377995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-337dd58d-e9d0-479f-809b-aeb371f22577 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:05.387381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-337dd58d-e9d0-479f-809b-aeb371f22577 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.240002 Aug 01 15:57:05.388267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1170/2666] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:05 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:05.388848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6c506366-10b6-47a7-a28e-f9f95c3359ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:05.390997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6c506366-10b6-47a7-a28e-f9f95c3359ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:05.392467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6c506366-10b6-47a7-a28e-f9f95c3359ca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.253066 Aug 01 15:57:05.393004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1497/2667] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:06.410490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3fb9d459-355b-4937-adcb-32f6985d1576 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:06.411531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3fb9d459-355b-4937-adcb-32f6985d1576 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:06.416099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d5d04a24-bb79-4e44-9f60-733b439ee746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:06.416770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d5d04a24-bb79-4e44-9f60-733b439ee746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:06.419548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3fb9d459-355b-4937-adcb-32f6985d1576 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:06.420005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3fb9d459-355b-4937-adcb-32f6985d1576 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:06.421129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3fb9d459-355b-4937-adcb-32f6985d1576 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:06.421581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3fb9d459-355b-4937-adcb-32f6985d1576 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:06.424215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5d04a24-bb79-4e44-9f60-733b439ee746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:06.424689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5d04a24-bb79-4e44-9f60-733b439ee746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:06.425564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5d04a24-bb79-4e44-9f60-733b439ee746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:06.425916 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:06.426049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5d04a24-bb79-4e44-9f60-733b439ee746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:06.633682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d5d04a24-bb79-4e44-9f60-733b439ee746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:06.638668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3fb9d459-355b-4937-adcb-32f6985d1576 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:06.644128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d5d04a24-bb79-4e44-9f60-733b439ee746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:06.645991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d5d04a24-bb79-4e44-9f60-733b439ee746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:06.647181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d5d04a24-bb79-4e44-9f60-733b439ee746 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.235735 Aug 01 15:57:06.647845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1498/2668] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:06.650117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3fb9d459-355b-4937-adcb-32f6985d1576 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.243743 Aug 01 15:57:06.650787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1171/2669] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:06 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:07.673414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1c69895a-9920-4148-9141-28c244a9a71a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:07.674249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1c69895a-9920-4148-9141-28c244a9a71a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:07.677999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a2353fed-a701-4f1d-acb6-f8d8e6d41f72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:07.678977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a2353fed-a701-4f1d-acb6-f8d8e6d41f72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:07.682360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c69895a-9920-4148-9141-28c244a9a71a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:07.683624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c69895a-9920-4148-9141-28c244a9a71a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:07.684448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c69895a-9920-4148-9141-28c244a9a71a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:07.684914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1c69895a-9920-4148-9141-28c244a9a71a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:07.687130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a2353fed-a701-4f1d-acb6-f8d8e6d41f72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:07.687774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a2353fed-a701-4f1d-acb6-f8d8e6d41f72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:07.688590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a2353fed-a701-4f1d-acb6-f8d8e6d41f72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:07.689019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a2353fed-a701-4f1d-acb6-f8d8e6d41f72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:08.162632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1c69895a-9920-4148-9141-28c244a9a71a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:08.168307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a2353fed-a701-4f1d-acb6-f8d8e6d41f72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:08.171746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1c69895a-9920-4148-9141-28c244a9a71a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.503370 Aug 01 15:57:08.172326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1499/2670] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:07 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:08.184951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a2353fed-a701-4f1d-acb6-f8d8e6d41f72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:08.186598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a2353fed-a701-4f1d-acb6-f8d8e6d41f72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:08.187800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a2353fed-a701-4f1d-acb6-f8d8e6d41f72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.516487 Aug 01 15:57:08.188365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1172/2671] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:07 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:09.194123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-83ccbdca-d2cf-4ffe-aa12-ec9b5e413220 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:09.194740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-83ccbdca-d2cf-4ffe-aa12-ec9b5e413220 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:09.201996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83ccbdca-d2cf-4ffe-aa12-ec9b5e413220 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:09.202397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83ccbdca-d2cf-4ffe-aa12-ec9b5e413220 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:09.203165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83ccbdca-d2cf-4ffe-aa12-ec9b5e413220 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:09.203597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83ccbdca-d2cf-4ffe-aa12-ec9b5e413220 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:09.208001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:09.213523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-500a179b-06dd-478f-a812-a2bbdf87fef0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:09.214513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-500a179b-06dd-478f-a812-a2bbdf87fef0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:09.221306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-500a179b-06dd-478f-a812-a2bbdf87fef0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:09.222370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-500a179b-06dd-478f-a812-a2bbdf87fef0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:09.223045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-500a179b-06dd-478f-a812-a2bbdf87fef0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:09.223045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-500a179b-06dd-478f-a812-a2bbdf87fef0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:09.423679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-83ccbdca-d2cf-4ffe-aa12-ec9b5e413220 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:09.431485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-500a179b-06dd-478f-a812-a2bbdf87fef0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:09.432358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-83ccbdca-d2cf-4ffe-aa12-ec9b5e413220 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.242277 Aug 01 15:57:09.433461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1500/2672] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:09 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:09.440899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-500a179b-06dd-478f-a812-a2bbdf87fef0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:09.442454 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-500a179b-06dd-478f-a812-a2bbdf87fef0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:09.445637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-500a179b-06dd-478f-a812-a2bbdf87fef0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.235316 Aug 01 15:57:09.445637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1173/2673] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:10.455435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aab98642-d767-447c-858e-45dd4c0c0a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:10.456034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aab98642-d767-447c-858e-45dd4c0c0a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:10.463714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aab98642-d767-447c-858e-45dd4c0c0a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:10.464271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aab98642-d767-447c-858e-45dd4c0c0a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:10.465592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aab98642-d767-447c-858e-45dd4c0c0a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:10.466063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aab98642-d767-447c-858e-45dd4c0c0a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:10.467381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2bf742dc-de7f-47ac-a29f-dd4936372e3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:10.467999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2bf742dc-de7f-47ac-a29f-dd4936372e3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:10.475388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2bf742dc-de7f-47ac-a29f-dd4936372e3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:10.475831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2bf742dc-de7f-47ac-a29f-dd4936372e3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:10.476599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2bf742dc-de7f-47ac-a29f-dd4936372e3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:10.477031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2bf742dc-de7f-47ac-a29f-dd4936372e3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:10.669953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aab98642-d767-447c-858e-45dd4c0c0a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:10.677281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2bf742dc-de7f-47ac-a29f-dd4936372e3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:10.679104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aab98642-d767-447c-858e-45dd4c0c0a8d tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.227452 Aug 01 15:57:10.680189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1501/2674] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:10 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:10.687169 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2bf742dc-de7f-47ac-a29f-dd4936372e3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:10.688672 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2bf742dc-de7f-47ac-a29f-dd4936372e3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:10.689968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2bf742dc-de7f-47ac-a29f-dd4936372e3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.227225 Aug 01 15:57:10.690647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1174/2675] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:10 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:11.702509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a0dbcba2-1555-4e5a-a582-28151906b400 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:11.703131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a0dbcba2-1555-4e5a-a582-28151906b400 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:11.709788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a0dbcba2-1555-4e5a-a582-28151906b400 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:11.710297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a0dbcba2-1555-4e5a-a582-28151906b400 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:11.711082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a0dbcba2-1555-4e5a-a582-28151906b400 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:11.711521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a0dbcba2-1555-4e5a-a582-28151906b400 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:11.714763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-af23f1aa-dc41-4396-a495-b4f0b11bc06f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:11.715459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-af23f1aa-dc41-4396-a495-b4f0b11bc06f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:11.722732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af23f1aa-dc41-4396-a495-b4f0b11bc06f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:11.723182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af23f1aa-dc41-4396-a495-b4f0b11bc06f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:11.723963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af23f1aa-dc41-4396-a495-b4f0b11bc06f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:11.724510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af23f1aa-dc41-4396-a495-b4f0b11bc06f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:11.920292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a0dbcba2-1555-4e5a-a582-28151906b400 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:11.928028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-af23f1aa-dc41-4396-a495-b4f0b11bc06f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:11.930429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a0dbcba2-1555-4e5a-a582-28151906b400 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.232311 Aug 01 15:57:11.931027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1502/2676] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:11 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:11.938027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-af23f1aa-dc41-4396-a495-b4f0b11bc06f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:11.939519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-af23f1aa-dc41-4396-a495-b4f0b11bc06f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:11.940685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-af23f1aa-dc41-4396-a495-b4f0b11bc06f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.230064 Aug 01 15:57:11.941238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1175/2677] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:11 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:12.957003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fe96e04b-4a72-4789-8ec5-d82a739c21db tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:12.957539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fe96e04b-4a72-4789-8ec5-d82a739c21db tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:12.963869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c0a28410-61af-4cfa-b56f-2f1823cbe460 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:12.964568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c0a28410-61af-4cfa-b56f-2f1823cbe460 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:12.964861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe96e04b-4a72-4789-8ec5-d82a739c21db tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:12.965345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe96e04b-4a72-4789-8ec5-d82a739c21db tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:12.966136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe96e04b-4a72-4789-8ec5-d82a739c21db tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:12.966575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe96e04b-4a72-4789-8ec5-d82a739c21db tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:12.971304 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0a28410-61af-4cfa-b56f-2f1823cbe460 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:12.971749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0a28410-61af-4cfa-b56f-2f1823cbe460 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:12.972523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0a28410-61af-4cfa-b56f-2f1823cbe460 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:12.972952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0a28410-61af-4cfa-b56f-2f1823cbe460 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:13.177037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c0a28410-61af-4cfa-b56f-2f1823cbe460 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:13.179533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fe96e04b-4a72-4789-8ec5-d82a739c21db tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:13.186293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c0a28410-61af-4cfa-b56f-2f1823cbe460 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:13.187800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c0a28410-61af-4cfa-b56f-2f1823cbe460 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:13.188585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fe96e04b-4a72-4789-8ec5-d82a739c21db tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.235661 Aug 01 15:57:13.188975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c0a28410-61af-4cfa-b56f-2f1823cbe460 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.228974 Aug 01 15:57:13.189282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1503/2678] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:12 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:13.189679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1176/2679] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:14.211218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2ca23400-f9a5-4229-b964-4ae4a62cf558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:14.211832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2ca23400-f9a5-4229-b964-4ae4a62cf558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:14.218406 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-689251f0-f863-4750-897b-27c850acf1d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:14.218962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ca23400-f9a5-4229-b964-4ae4a62cf558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:14.219089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-689251f0-f863-4750-897b-27c850acf1d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:14.219406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ca23400-f9a5-4229-b964-4ae4a62cf558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:14.220223 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ca23400-f9a5-4229-b964-4ae4a62cf558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:14.220668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ca23400-f9a5-4229-b964-4ae4a62cf558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:14.226942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-689251f0-f863-4750-897b-27c850acf1d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:14.227397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-689251f0-f863-4750-897b-27c850acf1d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:14.228179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-689251f0-f863-4750-897b-27c850acf1d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:14.228636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-689251f0-f863-4750-897b-27c850acf1d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:14.426995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-689251f0-f863-4750-897b-27c850acf1d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:14.431684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2ca23400-f9a5-4229-b964-4ae4a62cf558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:14.435928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-689251f0-f863-4750-897b-27c850acf1d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:14.437456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-689251f0-f863-4750-897b-27c850acf1d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:14.438708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-689251f0-f863-4750-897b-27c850acf1d2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.224327 Aug 01 15:57:14.439575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1177/2680] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:14.440432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2ca23400-f9a5-4229-b964-4ae4a62cf558 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.233061 Aug 01 15:57:14.441091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1504/2681] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:14 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:15.462042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2f9cf45e-c4c4-4fa9-9a34-5fa141e21dec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:15.462642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ecfc332d-59f2-4daa-8fe0-0f35ee87c45e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:15.463018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2f9cf45e-c4c4-4fa9-9a34-5fa141e21dec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:15.463128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ecfc332d-59f2-4daa-8fe0-0f35ee87c45e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:15.464777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=48 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:15.470153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecfc332d-59f2-4daa-8fe0-0f35ee87c45e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:15.470610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecfc332d-59f2-4daa-8fe0-0f35ee87c45e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:15.470729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f9cf45e-c4c4-4fa9-9a34-5fa141e21dec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:15.471118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f9cf45e-c4c4-4fa9-9a34-5fa141e21dec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:15.471399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecfc332d-59f2-4daa-8fe0-0f35ee87c45e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:15.471844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecfc332d-59f2-4daa-8fe0-0f35ee87c45e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:15.471984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f9cf45e-c4c4-4fa9-9a34-5fa141e21dec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:15.472321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f9cf45e-c4c4-4fa9-9a34-5fa141e21dec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:15.689881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ecfc332d-59f2-4daa-8fe0-0f35ee87c45e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:15.699083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2f9cf45e-c4c4-4fa9-9a34-5fa141e21dec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:15.709488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ecfc332d-59f2-4daa-8fe0-0f35ee87c45e tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.251317 Aug 01 15:57:15.709746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2f9cf45e-c4c4-4fa9-9a34-5fa141e21dec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:15.719023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1505/2682] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:15 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:15.719261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2f9cf45e-c4c4-4fa9-9a34-5fa141e21dec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:15.719261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2f9cf45e-c4c4-4fa9-9a34-5fa141e21dec tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.254268 Aug 01 15:57:15.719261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1178/2683] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:16.732441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-da1b9f05-897d-4c4a-b6f9-279300646632 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:16.732970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-da1b9f05-897d-4c4a-b6f9-279300646632 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:16.735621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-983c1e8c-234f-4795-aeea-22e6c65dca21 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:16.736240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-983c1e8c-234f-4795-aeea-22e6c65dca21 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:16.741220 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da1b9f05-897d-4c4a-b6f9-279300646632 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:16.741672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da1b9f05-897d-4c4a-b6f9-279300646632 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:16.742477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da1b9f05-897d-4c4a-b6f9-279300646632 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:16.743174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da1b9f05-897d-4c4a-b6f9-279300646632 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:16.743839 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-983c1e8c-234f-4795-aeea-22e6c65dca21 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:16.744297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-983c1e8c-234f-4795-aeea-22e6c65dca21 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:16.745571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-983c1e8c-234f-4795-aeea-22e6c65dca21 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:16.746136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-983c1e8c-234f-4795-aeea-22e6c65dca21 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:16.952066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-983c1e8c-234f-4795-aeea-22e6c65dca21 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:16.955516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-da1b9f05-897d-4c4a-b6f9-279300646632 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:16.960942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-983c1e8c-234f-4795-aeea-22e6c65dca21 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:16.962568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-983c1e8c-234f-4795-aeea-22e6c65dca21 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:16.963796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-983c1e8c-234f-4795-aeea-22e6c65dca21 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.232212 Aug 01 15:57:16.964073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-da1b9f05-897d-4c4a-b6f9-279300646632 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.235671 Aug 01 15:57:16.964365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1179/2684] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:16 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:16.964910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1506/2685] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:16 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:17.987696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-82e58a45-6300-4b17-8612-b7c36ac9de44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:17.988268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-968f0778-7b79-4f45-8069-19cdfd1a5c44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:17.988687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-82e58a45-6300-4b17-8612-b7c36ac9de44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:17.989053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-968f0778-7b79-4f45-8069-19cdfd1a5c44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:17.995230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-82e58a45-6300-4b17-8612-b7c36ac9de44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:17.995668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-82e58a45-6300-4b17-8612-b7c36ac9de44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:17.996438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-82e58a45-6300-4b17-8612-b7c36ac9de44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:17.996580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-968f0778-7b79-4f45-8069-19cdfd1a5c44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:17.996870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-82e58a45-6300-4b17-8612-b7c36ac9de44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:17.997059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-968f0778-7b79-4f45-8069-19cdfd1a5c44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:17.997772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-968f0778-7b79-4f45-8069-19cdfd1a5c44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:17.998251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-968f0778-7b79-4f45-8069-19cdfd1a5c44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:18.222163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-968f0778-7b79-4f45-8069-19cdfd1a5c44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:18.229514 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-82e58a45-6300-4b17-8612-b7c36ac9de44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:18.230754 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-968f0778-7b79-4f45-8069-19cdfd1a5c44 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.246336 Aug 01 15:57:18.231559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1507/2686] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:17 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:18.238330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-82e58a45-6300-4b17-8612-b7c36ac9de44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:18.239833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-82e58a45-6300-4b17-8612-b7c36ac9de44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:18.241012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-82e58a45-6300-4b17-8612-b7c36ac9de44 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.257480 Aug 01 15:57:18.241564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1180/2687] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:19.252678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ed3fbbc2-9246-459a-8036-6c640992982f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:19.253278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ed3fbbc2-9246-459a-8036-6c640992982f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:19.259860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed3fbbc2-9246-459a-8036-6c640992982f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:19.260310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed3fbbc2-9246-459a-8036-6c640992982f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:19.261580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed3fbbc2-9246-459a-8036-6c640992982f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:19.262056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed3fbbc2-9246-459a-8036-6c640992982f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:19.272355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5bfa63d5-3f1b-459b-81ed-56269bcf4807 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:19.272950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5bfa63d5-3f1b-459b-81ed-56269bcf4807 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:19.280637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5bfa63d5-3f1b-459b-81ed-56269bcf4807 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:19.281086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5bfa63d5-3f1b-459b-81ed-56269bcf4807 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:19.281865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5bfa63d5-3f1b-459b-81ed-56269bcf4807 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:19.282327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5bfa63d5-3f1b-459b-81ed-56269bcf4807 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:19.462443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ed3fbbc2-9246-459a-8036-6c640992982f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:19.471065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ed3fbbc2-9246-459a-8036-6c640992982f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.222401 Aug 01 15:57:19.471838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1508/2688] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:19 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:19.480600 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5bfa63d5-3f1b-459b-81ed-56269bcf4807 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:19.489509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5bfa63d5-3f1b-459b-81ed-56269bcf4807 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:19.491171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5bfa63d5-3f1b-459b-81ed-56269bcf4807 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:19.492362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5bfa63d5-3f1b-459b-81ed-56269bcf4807 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.223962 Aug 01 15:57:19.493252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1181/2689] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:20.493392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-91dffc9a-8dfc-4183-ad9e-765fc4d996fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:20.494118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-91dffc9a-8dfc-4183-ad9e-765fc4d996fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:20.501351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91dffc9a-8dfc-4183-ad9e-765fc4d996fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:20.501879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91dffc9a-8dfc-4183-ad9e-765fc4d996fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:20.502811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91dffc9a-8dfc-4183-ad9e-765fc4d996fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:20.503415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-91dffc9a-8dfc-4183-ad9e-765fc4d996fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:20.516103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-daea894f-dcab-45a0-a3e6-fa4ddf5c8ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:20.516945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-daea894f-dcab-45a0-a3e6-fa4ddf5c8ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:20.525650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-daea894f-dcab-45a0-a3e6-fa4ddf5c8ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:20.526779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-daea894f-dcab-45a0-a3e6-fa4ddf5c8ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:20.527942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-daea894f-dcab-45a0-a3e6-fa4ddf5c8ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:20.528764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-daea894f-dcab-45a0-a3e6-fa4ddf5c8ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:20.753091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-91dffc9a-8dfc-4183-ad9e-765fc4d996fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:20.755924 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-daea894f-dcab-45a0-a3e6-fa4ddf5c8ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:20.763201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-91dffc9a-8dfc-4183-ad9e-765fc4d996fd tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 200 len: 1728 microversion: 2.1 time: 0.274018 Aug 01 15:57:20.763899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1509/2690] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:20 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 1728 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:20.772119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-daea894f-dcab-45a0-a3e6-fa4ddf5c8ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:20.773654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-daea894f-dcab-45a0-a3e6-fa4ddf5c8ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:20.774873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-daea894f-dcab-45a0-a3e6-fa4ddf5c8ee8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.262846 Aug 01 15:57:20.775443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1182/2691] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:20.787561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c20af9e8-7227-440c-bf30-0079716cfba0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '.version_select at 0x7feb1a93d8b0>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:20.811803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c20af9e8-7227-440c-bf30-0079716cfba0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148462189" status: 202 len: 0 microversion: 2.1 time: 0.028094 Aug 01 15:57:20.812416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1510/2692] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 1 15:57:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148462189 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:57:21.687479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a5e90c3a-c0ff-4501-a415-ff1daea21e95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:21.688419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a5e90c3a-c0ff-4501-a415-ff1daea21e95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:21.695130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a5e90c3a-c0ff-4501-a415-ff1daea21e95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:21.695577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a5e90c3a-c0ff-4501-a415-ff1daea21e95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:21.696369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a5e90c3a-c0ff-4501-a415-ff1daea21e95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:21.696846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a5e90c3a-c0ff-4501-a415-ff1daea21e95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:21.735690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a5e90c3a-c0ff-4501-a415-ff1daea21e95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Going to try to terminate instance {{(pid=124527) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:57:21.763043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-083c2afd-9f6a-4372-8dfe-671e970ef25e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:21.764336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-083c2afd-9f6a-4372-8dfe-671e970ef25e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:21.774991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-083c2afd-9f6a-4372-8dfe-671e970ef25e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:21.776959 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-083c2afd-9f6a-4372-8dfe-671e970ef25e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:21.778132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-083c2afd-9f6a-4372-8dfe-671e970ef25e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:21.778988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-083c2afd-9f6a-4372-8dfe-671e970ef25e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:21.830817 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-083c2afd-9f6a-4372-8dfe-671e970ef25e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:57:21.898289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a5e90c3a-c0ff-4501-a415-ff1daea21e95 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 204 len: 0 microversion: 2.1 time: 0.209247 Aug 01 15:57:21.898289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1183/2693] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 15:57:21 2022] DELETE /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:57:21.914152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-06c3d680-910c-4ef4-a859-5b1dae9fddc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:21.916192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-06c3d680-910c-4ef4-a859-5b1dae9fddc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:21.928495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06c3d680-910c-4ef4-a859-5b1dae9fddc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:21.929708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06c3d680-910c-4ef4-a859-5b1dae9fddc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:21.931834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06c3d680-910c-4ef4-a859-5b1dae9fddc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:21.933480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06c3d680-910c-4ef4-a859-5b1dae9fddc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:21.963397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-083c2afd-9f6a-4372-8dfe-671e970ef25e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 204 len: 0 microversion: 2.1 time: 0.204872 Aug 01 15:57:21.964907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1511/2694] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 15:57:21 2022] DELETE /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:57:21.973158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-322f33f9-207c-4734-a9e5-a49828772869 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:21.974893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-322f33f9-207c-4734-a9e5-a49828772869 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:21.983802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-322f33f9-207c-4734-a9e5-a49828772869 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:21.985506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-322f33f9-207c-4734-a9e5-a49828772869 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:21.986776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-322f33f9-207c-4734-a9e5-a49828772869 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:21.988325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-322f33f9-207c-4734-a9e5-a49828772869 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:22.311465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-322f33f9-207c-4734-a9e5-a49828772869 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:22.322080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-06c3d680-910c-4ef4-a859-5b1dae9fddc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:22.330435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-322f33f9-207c-4734-a9e5-a49828772869 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1720 microversion: 2.1 time: 0.363136 Aug 01 15:57:22.330710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1512/2695] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:21 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1720 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:22.334502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-06c3d680-910c-4ef4-a859-5b1dae9fddc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:22.336051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fb3fde41-7a2f-41b7-ac3f-da7140e69942 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:22.336486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-06c3d680-910c-4ef4-a859-5b1dae9fddc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:22.336662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fb3fde41-7a2f-41b7-ac3f-da7140e69942 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:22.338394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-06c3d680-910c-4ef4-a859-5b1dae9fddc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.439402 Aug 01 15:57:22.339212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1184/2696] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:22.364173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb3fde41-7a2f-41b7-ac3f-da7140e69942 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:22.367743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb3fde41-7a2f-41b7-ac3f-da7140e69942 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:22.371424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb3fde41-7a2f-41b7-ac3f-da7140e69942 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:22.375198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fb3fde41-7a2f-41b7-ac3f-da7140e69942 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:22.611002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-c2d2ae13-22ff-42ea-abb1-e3804d592887 req-5ab2cee1-7252-447b-9fbe-febc521b0b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2122c9a8-db75-40b5-bbbe-9c83c983d961", "tag": "419fa20b-5321-45c3-bf43-01c4530aa3fc"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:57:22.621299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-c2d2ae13-22ff-42ea-abb1-e3804d592887 req-5ab2cee1-7252-447b-9fbe-febc521b0b86 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:22.621757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-c2d2ae13-22ff-42ea-abb1-e3804d592887 req-5ab2cee1-7252-447b-9fbe-febc521b0b86 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:22.634125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-c2d2ae13-22ff-42ea-abb1-e3804d592887 req-5ab2cee1-7252-447b-9fbe-febc521b0b86 service nova] Creating event network-changed:419fa20b-5321-45c3-bf43-01c4530aa3fc for instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 on hv-cinder-84753 Aug 01 15:57:22.639754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-c2d2ae13-22ff-42ea-abb1-e3804d592887 req-5ab2cee1-7252-447b-9fbe-febc521b0b86 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292321 Aug 01 15:57:22.640576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1185/2697] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:57:22.652105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d313d002-36c9-4d8b-8079-8efb2f443cc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Action: 'create', calling method: .version_select at 0x7feb1a98fe50>, body: {"keypair": {"name": "tempest-keypair-2145842920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj8ArML2E3qiT5Yah1/oMwK0X3+9vZboM5zyBPFKZCPR8f3l8gWvkBjHbcG9J7t9suNQj0EySCm0zN6d68CCOjk72HGSQW6zgSMYsefwhJJUK23W3n1x74YY2vjaIWAAw=="}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:57:22.677453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-d313d002-36c9-4d8b-8079-8efb2f443cc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'key_pairs'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:57:22.682509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-d313d002-36c9-4d8b-8079-8efb2f443cc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for user 4001e8ec57b34f57aae1654fad9217f8 and project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'key_pairs'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:57:22.735280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d313d002-36c9-4d8b-8079-8efb2f443cc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092190 Aug 01 15:57:22.736032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fb3fde41-7a2f-41b7-ac3f-da7140e69942 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:22.737514 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1186/2698] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 1 15:57:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:57:22.744762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fb3fde41-7a2f-41b7-ac3f-da7140e69942 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.412322 Aug 01 15:57:22.745659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1513/2699] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:22 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:23.381389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c43c6ba1-1a73-4373-b406-638508f2f30f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:23.385298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c43c6ba1-1a73-4373-b406-638508f2f30f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:23.387744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ab866b18-55e6-49a6-af6b-f577bd71a8fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:23.388888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ab866b18-55e6-49a6-af6b-f577bd71a8fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:23.399643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab866b18-55e6-49a6-af6b-f577bd71a8fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:23.400105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab866b18-55e6-49a6-af6b-f577bd71a8fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:23.400963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab866b18-55e6-49a6-af6b-f577bd71a8fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:23.401460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab866b18-55e6-49a6-af6b-f577bd71a8fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:23.402848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c43c6ba1-1a73-4373-b406-638508f2f30f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:23.403712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c43c6ba1-1a73-4373-b406-638508f2f30f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:23.412963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c43c6ba1-1a73-4373-b406-638508f2f30f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:23.413863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c43c6ba1-1a73-4373-b406-638508f2f30f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:23.847857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ab866b18-55e6-49a6-af6b-f577bd71a8fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:23.865211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ab866b18-55e6-49a6-af6b-f577bd71a8fd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1720 microversion: 2.1 time: 0.482694 Aug 01 15:57:23.866980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1514/2700] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:23 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1720 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:23.872727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d2837097-5a0b-4b40-997a-883a6c2478a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:23.873908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d2837097-5a0b-4b40-997a-883a6c2478a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:23.886156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2837097-5a0b-4b40-997a-883a6c2478a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:23.887813 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2837097-5a0b-4b40-997a-883a6c2478a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:23.888207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c43c6ba1-1a73-4373-b406-638508f2f30f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:23.889838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2837097-5a0b-4b40-997a-883a6c2478a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:23.890558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2837097-5a0b-4b40-997a-883a6c2478a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:23.893477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:23.905938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c43c6ba1-1a73-4373-b406-638508f2f30f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:23.908014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c43c6ba1-1a73-4373-b406-638508f2f30f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:23.909318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c43c6ba1-1a73-4373-b406-638508f2f30f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.535180 Aug 01 15:57:23.910473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1187/2701] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:24.405728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d2837097-5a0b-4b40-997a-883a6c2478a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:24.418561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d2837097-5a0b-4b40-997a-883a6c2478a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.549736 Aug 01 15:57:24.431682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1515/2702] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:23 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:24.888777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-eb8e96b7-8ca2-4af5-a098-0581aa6f6708 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:24.889513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-eb8e96b7-8ca2-4af5-a098-0581aa6f6708 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:24.904274 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eb8e96b7-8ca2-4af5-a098-0581aa6f6708 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:24.904655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eb8e96b7-8ca2-4af5-a098-0581aa6f6708 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:24.906220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eb8e96b7-8ca2-4af5-a098-0581aa6f6708 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:24.906600 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eb8e96b7-8ca2-4af5-a098-0581aa6f6708 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:24.932612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-818444ca-1895-4ca4-b395-a75565980d77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:24.934408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-818444ca-1895-4ca4-b395-a75565980d77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:24.945380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-818444ca-1895-4ca4-b395-a75565980d77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:24.946150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-818444ca-1895-4ca4-b395-a75565980d77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:24.947169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-818444ca-1895-4ca4-b395-a75565980d77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:24.948970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-818444ca-1895-4ca4-b395-a75565980d77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:24.959876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:25.005764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-eb8e96b7-8ca2-4af5-a098-0581aa6f6708 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:25.021209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-eb8e96b7-8ca2-4af5-a098-0581aa6f6708 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1653 microversion: 2.1 time: 0.136372 Aug 01 15:57:25.037055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1188/2703] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:24 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1653 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:25.166532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-818444ca-1895-4ca4-b395-a75565980d77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:25.176519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-818444ca-1895-4ca4-b395-a75565980d77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:25.178123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-818444ca-1895-4ca4-b395-a75565980d77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:25.179610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-818444ca-1895-4ca4-b395-a75565980d77 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.250867 Aug 01 15:57:25.180703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1516/2704] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:25.456346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fe0f16ed-061b-4cf2-912f-570e4fa569ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:25.457473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fe0f16ed-061b-4cf2-912f-570e4fa569ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:25.468980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe0f16ed-061b-4cf2-912f-570e4fa569ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:25.469436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe0f16ed-061b-4cf2-912f-570e4fa569ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:25.470979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe0f16ed-061b-4cf2-912f-570e4fa569ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:25.471667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe0f16ed-061b-4cf2-912f-570e4fa569ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:25.619150 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-40a331a3-9513-4951-adbd-b7c04f8b87cf req-e0143c62-f6a8-4ae5-8d4a-b4f7d8ca537b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c377fe1d-1c49-46de-87e3-4a70f1253e63", "name": "network-vif-deleted", "tag": "77c1695c-6c2d-450f-9b6b-5a55c9a1bf2f"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:57:25.630623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-40a331a3-9513-4951-adbd-b7c04f8b87cf req-e0143c62-f6a8-4ae5-8d4a-b4f7d8ca537b service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:25.631340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-40a331a3-9513-4951-adbd-b7c04f8b87cf req-e0143c62-f6a8-4ae5-8d4a-b4f7d8ca537b service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:25.644697 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-40a331a3-9513-4951-adbd-b7c04f8b87cf req-e0143c62-f6a8-4ae5-8d4a-b4f7d8ca537b service nova] Creating event network-vif-deleted:77c1695c-6c2d-450f-9b6b-5a55c9a1bf2f for instance c377fe1d-1c49-46de-87e3-4a70f1253e63 on hv-cinder-84753 Aug 01 15:57:25.651728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-40a331a3-9513-4951-adbd-b7c04f8b87cf req-e0143c62-f6a8-4ae5-8d4a-b4f7d8ca537b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.360159 Aug 01 15:57:25.652759 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1189/2705] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:57:25.674518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fe0f16ed-061b-4cf2-912f-570e4fa569ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:25.686329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fe0f16ed-061b-4cf2-912f-570e4fa569ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.233948 Aug 01 15:57:25.687886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1517/2706] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:25 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:26.045778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f38bd84e-19ab-4773-bef1-e3f883cd56c6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:26.047487 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f38bd84e-19ab-4773-bef1-e3f883cd56c6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:26.056407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1854413431", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f1bed6a-c264-454e-855c-f998e359854d"}], "security_groups": [{"name": "tempest-securitygroup--221712770"}], "key_name": "tempest-keypair-2145842920", "user_data": "}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:57:26.056987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f38bd84e-19ab-4773-bef1-e3f883cd56c6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:26.058062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f38bd84e-19ab-4773-bef1-e3f883cd56c6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:26.058942 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f38bd84e-19ab-4773-bef1-e3f883cd56c6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:26.059567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f38bd84e-19ab-4773-bef1-e3f883cd56c6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:26.144640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f38bd84e-19ab-4773-bef1-e3f883cd56c6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:26.157362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f38bd84e-19ab-4773-bef1-e3f883cd56c6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.115912 Aug 01 15:57:26.158696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1190/2707] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:26 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:26.207099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.network.neutron [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] validate_networks() for [('2f1bed6a-c264-454e-855c-f998e359854d', None, None, None, None, None)] {{(pid=124526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:57:26.217239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5dbc11d1-2ff8-4464-a22f-80a9739a67c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:26.217864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5dbc11d1-2ff8-4464-a22f-80a9739a67c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:26.224849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5dbc11d1-2ff8-4464-a22f-80a9739a67c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:26.225952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5dbc11d1-2ff8-4464-a22f-80a9739a67c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:26.226943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5dbc11d1-2ff8-4464-a22f-80a9739a67c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:26.227437 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5dbc11d1-2ff8-4464-a22f-80a9739a67c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:26.520107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5dbc11d1-2ff8-4464-a22f-80a9739a67c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:26.531399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5dbc11d1-2ff8-4464-a22f-80a9739a67c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:26.532990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5dbc11d1-2ff8-4464-a22f-80a9739a67c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:26.534266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5dbc11d1-2ff8-4464-a22f-80a9739a67c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.333440 Aug 01 15:57:26.535763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1191/2708] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:26.716352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-45f79c4d-d8e3-4c68-925d-2d1bbdff566a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:26.717116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-45f79c4d-d8e3-4c68-925d-2d1bbdff566a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:26.728422 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45f79c4d-d8e3-4c68-925d-2d1bbdff566a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:26.729227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45f79c4d-d8e3-4c68-925d-2d1bbdff566a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:26.730759 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45f79c4d-d8e3-4c68-925d-2d1bbdff566a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:26.731601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45f79c4d-d8e3-4c68-925d-2d1bbdff566a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:26.978470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-45f79c4d-d8e3-4c68-925d-2d1bbdff566a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:26.986958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-45f79c4d-d8e3-4c68-925d-2d1bbdff566a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.275639 Aug 01 15:57:26.988597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1192/2709] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:26 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:27.021449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Flavor limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:57:27.022008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Image limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:57:27.022461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Flavor pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:57:27.022864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Image pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:57:27.023313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:57:27.033777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:27.034278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:27.035074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:27.035504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:27.053918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:57:27.058984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for user 4001e8ec57b34f57aae1654fad9217f8 and project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:57:27.071134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Going to run 1 instances... {{(pid=124526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:57:27.074028 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:57:27.126233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-92a2a45f-00dd-4b56-a55b-8c581ea4c55f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.078759 Aug 01 15:57:27.126591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1518/2710] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 15:57:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:57:27.138187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ae5d071b-9748-4d6e-a760-ad5faece2803 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:27.138883 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ae5d071b-9748-4d6e-a760-ad5faece2803 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:27.184692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2c664fbf-67a2-4fb3-a68a-e45480f7c789 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:27.186199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2c664fbf-67a2-4fb3-a68a-e45480f7c789 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:27.194166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2c664fbf-67a2-4fb3-a68a-e45480f7c789 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:27.194699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2c664fbf-67a2-4fb3-a68a-e45480f7c789 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:27.195751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2c664fbf-67a2-4fb3-a68a-e45480f7c789 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:27.196256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2c664fbf-67a2-4fb3-a68a-e45480f7c789 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:27.204588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ae5d071b-9748-4d6e-a760-ad5faece2803 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:27.212096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ae5d071b-9748-4d6e-a760-ad5faece2803 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 200 len: 1242 microversion: 2.1 time: 0.078292 Aug 01 15:57:27.230010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1193/2711] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:27 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:27.283190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2c664fbf-67a2-4fb3-a68a-e45480f7c789 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:27.297933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2c664fbf-67a2-4fb3-a68a-e45480f7c789 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.117715 Aug 01 15:57:27.298904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1519/2712] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:27 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:27.561811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-05e996cb-d669-4e19-b609-7cf47e138771 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:27.562637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-05e996cb-d669-4e19-b609-7cf47e138771 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:27.572008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-05e996cb-d669-4e19-b609-7cf47e138771 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:27.572913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-05e996cb-d669-4e19-b609-7cf47e138771 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:27.574059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-05e996cb-d669-4e19-b609-7cf47e138771 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:27.574808 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-05e996cb-d669-4e19-b609-7cf47e138771 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:27.729935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-05e996cb-d669-4e19-b609-7cf47e138771 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:27.740616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-05e996cb-d669-4e19-b609-7cf47e138771 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:27.742408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-05e996cb-d669-4e19-b609-7cf47e138771 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:27.743823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-05e996cb-d669-4e19-b609-7cf47e138771 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.186717 Aug 01 15:57:27.744590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1194/2713] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:28.010406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6ae9d417-c4b9-4f1a-806b-9288f4fb055d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:28.011049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6ae9d417-c4b9-4f1a-806b-9288f4fb055d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:28.017735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ae9d417-c4b9-4f1a-806b-9288f4fb055d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:28.018219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ae9d417-c4b9-4f1a-806b-9288f4fb055d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:28.019023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ae9d417-c4b9-4f1a-806b-9288f4fb055d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:28.019519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6ae9d417-c4b9-4f1a-806b-9288f4fb055d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:28.176089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6ae9d417-c4b9-4f1a-806b-9288f4fb055d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:28.184960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6ae9d417-c4b9-4f1a-806b-9288f4fb055d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.178531 Aug 01 15:57:28.185544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1520/2714] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:28 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:28.242048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a7591501-b948-4a97-bc8e-25937c4ad2f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:28.242643 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a7591501-b948-4a97-bc8e-25937c4ad2f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:28.250048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7591501-b948-4a97-bc8e-25937c4ad2f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:28.250494 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7591501-b948-4a97-bc8e-25937c4ad2f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:28.251259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7591501-b948-4a97-bc8e-25937c4ad2f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:28.251687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7591501-b948-4a97-bc8e-25937c4ad2f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:28.322735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a7591501-b948-4a97-bc8e-25937c4ad2f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:28.325789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-27e2630a-3f23-4f7b-ba29-f47fd1ecc4f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:28.326787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-27e2630a-3f23-4f7b-ba29-f47fd1ecc4f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:28.333381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a7591501-b948-4a97-bc8e-25937c4ad2f8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 200 len: 1294 microversion: 2.1 time: 0.095981 Aug 01 15:57:28.333708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-27e2630a-3f23-4f7b-ba29-f47fd1ecc4f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:28.334030 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-27e2630a-3f23-4f7b-ba29-f47fd1ecc4f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:28.334725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1195/2715] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:28 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:28.334950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-27e2630a-3f23-4f7b-ba29-f47fd1ecc4f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:28.335424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-27e2630a-3f23-4f7b-ba29-f47fd1ecc4f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:28.408840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-27e2630a-3f23-4f7b-ba29-f47fd1ecc4f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:28.417545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-27e2630a-3f23-4f7b-ba29-f47fd1ecc4f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.098129 Aug 01 15:57:28.418431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1521/2716] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:28 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:28.769654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-628dd7d0-e5b0-4225-acf5-d411427791d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:28.770809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-628dd7d0-e5b0-4225-acf5-d411427791d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:28.777714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-628dd7d0-e5b0-4225-acf5-d411427791d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:28.778067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-628dd7d0-e5b0-4225-acf5-d411427791d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:28.778824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-628dd7d0-e5b0-4225-acf5-d411427791d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:28.779260 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-628dd7d0-e5b0-4225-acf5-d411427791d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:28.935747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-628dd7d0-e5b0-4225-acf5-d411427791d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:28.953496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-628dd7d0-e5b0-4225-acf5-d411427791d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:28.956031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-628dd7d0-e5b0-4225-acf5-d411427791d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:28.957997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-628dd7d0-e5b0-4225-acf5-d411427791d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.193064 Aug 01 15:57:28.958823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1196/2717] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:29.208990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dcdef8f6-93b0-47d9-afe6-dd2430e0692e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:29.209767 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dcdef8f6-93b0-47d9-afe6-dd2430e0692e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:29.217598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcdef8f6-93b0-47d9-afe6-dd2430e0692e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:29.218180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcdef8f6-93b0-47d9-afe6-dd2430e0692e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:29.219052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcdef8f6-93b0-47d9-afe6-dd2430e0692e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:29.219564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dcdef8f6-93b0-47d9-afe6-dd2430e0692e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:29.367420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d7738097-36f5-4d6e-86ed-042665f9ee9a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:29.369619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d7738097-36f5-4d6e-86ed-042665f9ee9a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:29.381982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d7738097-36f5-4d6e-86ed-042665f9ee9a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:29.383025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d7738097-36f5-4d6e-86ed-042665f9ee9a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:29.384734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d7738097-36f5-4d6e-86ed-042665f9ee9a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:29.385928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d7738097-36f5-4d6e-86ed-042665f9ee9a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:29.444367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dcdef8f6-93b0-47d9-afe6-dd2430e0692e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:29.463433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dcdef8f6-93b0-47d9-afe6-dd2430e0692e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.258569 Aug 01 15:57:29.477917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1522/2718] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:29 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:29.485688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-48810628-8d84-439d-b2dc-bc270505ed58 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:29.486766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-48810628-8d84-439d-b2dc-bc270505ed58 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:29.496482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48810628-8d84-439d-b2dc-bc270505ed58 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:29.496942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48810628-8d84-439d-b2dc-bc270505ed58 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:29.497804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48810628-8d84-439d-b2dc-bc270505ed58 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:29.498280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48810628-8d84-439d-b2dc-bc270505ed58 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:29.616360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48810628-8d84-439d-b2dc-bc270505ed58 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:29.635332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-48810628-8d84-439d-b2dc-bc270505ed58 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.163785 Aug 01 15:57:29.635332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1523/2719] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:29 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:29.646979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d7738097-36f5-4d6e-86ed-042665f9ee9a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:29.664390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d7738097-36f5-4d6e-86ed-042665f9ee9a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 200 len: 1367 microversion: 2.1 time: 0.311756 Aug 01 15:57:29.665135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1197/2720] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:29 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:29.991969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fedf28ee-41d5-47b0-b98b-e2346a451947 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:29.993219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fedf28ee-41d5-47b0-b98b-e2346a451947 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:30.001085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fedf28ee-41d5-47b0-b98b-e2346a451947 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:30.002312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fedf28ee-41d5-47b0-b98b-e2346a451947 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:30.003750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fedf28ee-41d5-47b0-b98b-e2346a451947 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:30.004221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fedf28ee-41d5-47b0-b98b-e2346a451947 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:30.103834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-dad1fff7-63a8-45cf-b715-61f5ec1efb4a req-af493a3f-4a31-4688-9947-57cc847d23c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e9f2d5-3104-4eec-aa3b-2fc8e8956479", "tag": "f4b3e301-08cd-454d-92ff-e609d0607ab8"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:57:30.114751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-dad1fff7-63a8-45cf-b715-61f5ec1efb4a req-af493a3f-4a31-4688-9947-57cc847d23c6 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:30.115203 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-dad1fff7-63a8-45cf-b715-61f5ec1efb4a req-af493a3f-4a31-4688-9947-57cc847d23c6 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:30.130441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-dad1fff7-63a8-45cf-b715-61f5ec1efb4a req-af493a3f-4a31-4688-9947-57cc847d23c6 service nova] Creating event network-changed:f4b3e301-08cd-454d-92ff-e609d0607ab8 for instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 on hv-cinder-84753 Aug 01 15:57:30.138823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-dad1fff7-63a8-45cf-b715-61f5ec1efb4a req-af493a3f-4a31-4688-9947-57cc847d23c6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039023 Aug 01 15:57:30.139655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1198/2721] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:57:30.174373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fedf28ee-41d5-47b0-b98b-e2346a451947 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:30.185577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fedf28ee-41d5-47b0-b98b-e2346a451947 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:30.187314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fedf28ee-41d5-47b0-b98b-e2346a451947 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:30.188605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fedf28ee-41d5-47b0-b98b-e2346a451947 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.205822 Aug 01 15:57:30.189313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1524/2722] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:30.488071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9c4b9672-40ce-442e-9603-5c1d78c81b41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:30.489365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9c4b9672-40ce-442e-9603-5c1d78c81b41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:30.496199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c4b9672-40ce-442e-9603-5c1d78c81b41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:30.496762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c4b9672-40ce-442e-9603-5c1d78c81b41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:30.497556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c4b9672-40ce-442e-9603-5c1d78c81b41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:30.498021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c4b9672-40ce-442e-9603-5c1d78c81b41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:30.639691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9c4b9672-40ce-442e-9603-5c1d78c81b41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:30.648588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9c4b9672-40ce-442e-9603-5c1d78c81b41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.165487 Aug 01 15:57:30.649172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1199/2723] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:30 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:30.652945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7380b1ad-8593-4764-9dff-c9e8fad1b50b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:30.653565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7380b1ad-8593-4764-9dff-c9e8fad1b50b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:30.660370 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7380b1ad-8593-4764-9dff-c9e8fad1b50b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:30.660821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7380b1ad-8593-4764-9dff-c9e8fad1b50b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:30.661588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7380b1ad-8593-4764-9dff-c9e8fad1b50b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:30.662056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7380b1ad-8593-4764-9dff-c9e8fad1b50b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:30.688526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b88c471c-cced-47fb-9e50-6eb208e72ef0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:30.689160 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b88c471c-cced-47fb-9e50-6eb208e72ef0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:30.695418 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b88c471c-cced-47fb-9e50-6eb208e72ef0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:30.695964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b88c471c-cced-47fb-9e50-6eb208e72ef0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:30.696659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b88c471c-cced-47fb-9e50-6eb208e72ef0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:30.697080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b88c471c-cced-47fb-9e50-6eb208e72ef0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:30.728633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7380b1ad-8593-4764-9dff-c9e8fad1b50b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:30.738193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7380b1ad-8593-4764-9dff-c9e8fad1b50b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.089247 Aug 01 15:57:30.738798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1525/2724] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:30 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:30.837626 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b88c471c-cced-47fb-9e50-6eb208e72ef0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:30.849833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b88c471c-cced-47fb-9e50-6eb208e72ef0 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 200 len: 1367 microversion: 2.1 time: 0.165199 Aug 01 15:57:30.850695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1200/2725] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:30 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:31.215438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-53fef4ae-9fdc-45bb-8613-36b7ae6f09bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:31.216062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-53fef4ae-9fdc-45bb-8613-36b7ae6f09bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:31.222934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53fef4ae-9fdc-45bb-8613-36b7ae6f09bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:31.223367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53fef4ae-9fdc-45bb-8613-36b7ae6f09bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:31.224338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53fef4ae-9fdc-45bb-8613-36b7ae6f09bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:31.224605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-53fef4ae-9fdc-45bb-8613-36b7ae6f09bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:31.392449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-53fef4ae-9fdc-45bb-8613-36b7ae6f09bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:31.402245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-53fef4ae-9fdc-45bb-8613-36b7ae6f09bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:31.404016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-53fef4ae-9fdc-45bb-8613-36b7ae6f09bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:31.405228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-53fef4ae-9fdc-45bb-8613-36b7ae6f09bf tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.194411 Aug 01 15:57:31.405841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1526/2726] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:31.671200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-11068766-1c00-4f39-bc77-0401feb0764c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:31.671858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-11068766-1c00-4f39-bc77-0401feb0764c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:31.678769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-11068766-1c00-4f39-bc77-0401feb0764c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:31.679202 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-11068766-1c00-4f39-bc77-0401feb0764c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:31.679985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-11068766-1c00-4f39-bc77-0401feb0764c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:31.680423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-11068766-1c00-4f39-bc77-0401feb0764c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:31.760145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-492c94de-c8ba-48de-9762-68a3e9ed1eaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:31.760796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-492c94de-c8ba-48de-9762-68a3e9ed1eaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:31.769212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-492c94de-c8ba-48de-9762-68a3e9ed1eaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:31.769672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-492c94de-c8ba-48de-9762-68a3e9ed1eaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:31.770506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-492c94de-c8ba-48de-9762-68a3e9ed1eaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:31.771352 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-492c94de-c8ba-48de-9762-68a3e9ed1eaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:31.852391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-492c94de-c8ba-48de-9762-68a3e9ed1eaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:31.856768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-11068766-1c00-4f39-bc77-0401feb0764c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:31.861780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-492c94de-c8ba-48de-9762-68a3e9ed1eaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.105418 Aug 01 15:57:31.862464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1527/2727] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:31 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:31.867690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-11068766-1c00-4f39-bc77-0401feb0764c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.200860 Aug 01 15:57:31.868434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1201/2728] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:31 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:31.881896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-deb4d29e-7767-418b-8ce9-069e13ca69ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:31.882833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-deb4d29e-7767-418b-8ce9-069e13ca69ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:31.889611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-deb4d29e-7767-418b-8ce9-069e13ca69ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:31.889908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-deb4d29e-7767-418b-8ce9-069e13ca69ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:31.890710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-deb4d29e-7767-418b-8ce9-069e13ca69ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:31.891147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-deb4d29e-7767-418b-8ce9-069e13ca69ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:32.046009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-deb4d29e-7767-418b-8ce9-069e13ca69ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:32.060618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-deb4d29e-7767-418b-8ce9-069e13ca69ea tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 200 len: 1367 microversion: 2.1 time: 0.182118 Aug 01 15:57:32.061275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1528/2729] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:31 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:32.428849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-743f1c80-3281-453e-9237-295aeb342ded tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:32.429618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-743f1c80-3281-453e-9237-295aeb342ded tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:32.436034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-743f1c80-3281-453e-9237-295aeb342ded tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:32.436476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-743f1c80-3281-453e-9237-295aeb342ded tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:32.437237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-743f1c80-3281-453e-9237-295aeb342ded tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:32.437673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-743f1c80-3281-453e-9237-295aeb342ded tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:32.576661 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-743f1c80-3281-453e-9237-295aeb342ded tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:32.585014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-743f1c80-3281-453e-9237-295aeb342ded tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:32.586541 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-743f1c80-3281-453e-9237-295aeb342ded tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:32.587698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-743f1c80-3281-453e-9237-295aeb342ded tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.163297 Aug 01 15:57:32.588254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1202/2730] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:32.883263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-10802f40-2a6d-4b20-926c-7d28ec3026f5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:32.883862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-10802f40-2a6d-4b20-926c-7d28ec3026f5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:32.886781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:32.890043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9c18bd21-72e6-4bd9-9b29-01b9e0dd8a10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:32.890666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9c18bd21-72e6-4bd9-9b29-01b9e0dd8a10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:32.892111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10802f40-2a6d-4b20-926c-7d28ec3026f5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:32.892565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10802f40-2a6d-4b20-926c-7d28ec3026f5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:32.893336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10802f40-2a6d-4b20-926c-7d28ec3026f5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:32.893772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10802f40-2a6d-4b20-926c-7d28ec3026f5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:32.897326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c18bd21-72e6-4bd9-9b29-01b9e0dd8a10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:32.898106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c18bd21-72e6-4bd9-9b29-01b9e0dd8a10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:32.898864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c18bd21-72e6-4bd9-9b29-01b9e0dd8a10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:32.899301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c18bd21-72e6-4bd9-9b29-01b9e0dd8a10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:32.971718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-10802f40-2a6d-4b20-926c-7d28ec3026f5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:32.980143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-10802f40-2a6d-4b20-926c-7d28ec3026f5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.100690 Aug 01 15:57:32.980727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1529/2731] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:32 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:33.061599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9c18bd21-72e6-4bd9-9b29-01b9e0dd8a10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:33.070486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9c18bd21-72e6-4bd9-9b29-01b9e0dd8a10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.184952 Aug 01 15:57:33.071055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1203/2732] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:32 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:33.091447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-615b663d-c3ae-4d32-9eaf-b1a16175cf11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:33.091965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-615b663d-c3ae-4d32-9eaf-b1a16175cf11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:33.098423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-615b663d-c3ae-4d32-9eaf-b1a16175cf11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:33.098874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-615b663d-c3ae-4d32-9eaf-b1a16175cf11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:33.099653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-615b663d-c3ae-4d32-9eaf-b1a16175cf11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:33.100092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-615b663d-c3ae-4d32-9eaf-b1a16175cf11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:33.245683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-615b663d-c3ae-4d32-9eaf-b1a16175cf11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:33.253211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-615b663d-c3ae-4d32-9eaf-b1a16175cf11 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 200 len: 1367 microversion: 2.1 time: 0.166356 Aug 01 15:57:33.253776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1530/2733] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:33 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:33.613103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7094735f-3afa-4b16-b67e-0e3dce83b301 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:33.613910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7094735f-3afa-4b16-b67e-0e3dce83b301 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:33.621972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7094735f-3afa-4b16-b67e-0e3dce83b301 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:33.621972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7094735f-3afa-4b16-b67e-0e3dce83b301 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:33.622743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7094735f-3afa-4b16-b67e-0e3dce83b301 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:33.623273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7094735f-3afa-4b16-b67e-0e3dce83b301 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:33.771191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7094735f-3afa-4b16-b67e-0e3dce83b301 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:33.780418 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7094735f-3afa-4b16-b67e-0e3dce83b301 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:33.781950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7094735f-3afa-4b16-b67e-0e3dce83b301 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:33.783140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7094735f-3afa-4b16-b67e-0e3dce83b301 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.174318 Aug 01 15:57:33.783699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1204/2734] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:34.002146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dd38baad-ffdb-4412-9b8f-80fcdebeacde tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:34.002844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dd38baad-ffdb-4412-9b8f-80fcdebeacde tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:34.009723 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd38baad-ffdb-4412-9b8f-80fcdebeacde tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:34.010391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd38baad-ffdb-4412-9b8f-80fcdebeacde tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:34.010957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd38baad-ffdb-4412-9b8f-80fcdebeacde tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:34.011396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd38baad-ffdb-4412-9b8f-80fcdebeacde tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:34.080948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dd38baad-ffdb-4412-9b8f-80fcdebeacde tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:34.089833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dd38baad-ffdb-4412-9b8f-80fcdebeacde tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.091623 Aug 01 15:57:34.090452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1531/2735] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:33 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:34.093106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4950891b-beb3-4579-8de4-92054b40c5a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:34.093729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4950891b-beb3-4579-8de4-92054b40c5a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:34.101395 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4950891b-beb3-4579-8de4-92054b40c5a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:34.101863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4950891b-beb3-4579-8de4-92054b40c5a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:34.102663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4950891b-beb3-4579-8de4-92054b40c5a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:34.103124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4950891b-beb3-4579-8de4-92054b40c5a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:34.251944 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4950891b-beb3-4579-8de4-92054b40c5a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:34.261246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4950891b-beb3-4579-8de4-92054b40c5a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.171866 Aug 01 15:57:34.261731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1205/2736] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:34 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:34.277871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-96a22c73-6368-45f6-ae2c-641f50b19e41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:34.278660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-96a22c73-6368-45f6-ae2c-641f50b19e41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:34.285252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-96a22c73-6368-45f6-ae2c-641f50b19e41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:34.285700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-96a22c73-6368-45f6-ae2c-641f50b19e41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:34.286499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-96a22c73-6368-45f6-ae2c-641f50b19e41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:34.286938 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-96a22c73-6368-45f6-ae2c-641f50b19e41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:34.424880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-96a22c73-6368-45f6-ae2c-641f50b19e41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:34.433004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-96a22c73-6368-45f6-ae2c-641f50b19e41 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 200 len: 1367 microversion: 2.1 time: 0.159843 Aug 01 15:57:34.433591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1532/2737] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:34 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:34.807563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-57008da5-ba6f-4244-be08-ce934fc89fc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:34.808196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-57008da5-ba6f-4244-be08-ce934fc89fc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:34.815120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-57008da5-ba6f-4244-be08-ce934fc89fc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:34.815576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-57008da5-ba6f-4244-be08-ce934fc89fc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:34.816381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-57008da5-ba6f-4244-be08-ce934fc89fc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:34.816803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-57008da5-ba6f-4244-be08-ce934fc89fc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:34.955663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-57008da5-ba6f-4244-be08-ce934fc89fc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:34.959432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:34.966071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-57008da5-ba6f-4244-be08-ce934fc89fc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:34.967589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-57008da5-ba6f-4244-be08-ce934fc89fc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:34.968763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-57008da5-ba6f-4244-be08-ce934fc89fc3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.165696 Aug 01 15:57:34.969337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1206/2738] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:35.113184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b899436d-df09-480b-9539-0bfd989419c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:35.113755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b899436d-df09-480b-9539-0bfd989419c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:35.121586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b899436d-df09-480b-9539-0bfd989419c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:35.122152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b899436d-df09-480b-9539-0bfd989419c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:35.122989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b899436d-df09-480b-9539-0bfd989419c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:35.123473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b899436d-df09-480b-9539-0bfd989419c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:35.145816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:35.198350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b899436d-df09-480b-9539-0bfd989419c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:35.207583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b899436d-df09-480b-9539-0bfd989419c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.098313 Aug 01 15:57:35.208198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1533/2739] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:35 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:35.286315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-99ce894a-189e-4820-883b-634e05ee26b3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:35.286931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-99ce894a-189e-4820-883b-634e05ee26b3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:35.296018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-99ce894a-189e-4820-883b-634e05ee26b3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:35.296847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-99ce894a-189e-4820-883b-634e05ee26b3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:35.297866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-99ce894a-189e-4820-883b-634e05ee26b3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:35.298336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-99ce894a-189e-4820-883b-634e05ee26b3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:35.454478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7513d0d3-9bca-4b65-b771-58fac72894f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:35.455156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7513d0d3-9bca-4b65-b771-58fac72894f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:35.462529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7513d0d3-9bca-4b65-b771-58fac72894f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:35.462964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7513d0d3-9bca-4b65-b771-58fac72894f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:35.463998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-99ce894a-189e-4820-883b-634e05ee26b3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:35.464269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7513d0d3-9bca-4b65-b771-58fac72894f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:35.464700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7513d0d3-9bca-4b65-b771-58fac72894f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:35.475917 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-99ce894a-189e-4820-883b-634e05ee26b3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.194050 Aug 01 15:57:35.476882 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1207/2740] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:35 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:35.607922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7513d0d3-9bca-4b65-b771-58fac72894f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:35.616572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7513d0d3-9bca-4b65-b771-58fac72894f2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 200 len: 1367 microversion: 2.1 time: 0.166195 Aug 01 15:57:35.617156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1534/2741] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:35 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:35.706741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-768dfd6e-90dd-4a7f-aee3-702cbd782888 req-fb0c89c4-2790-4509-9b86-2cf4a2c9d45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e9f2d5-3104-4eec-aa3b-2fc8e8956479", "name": "network-vif-plugged", "status": "completed", "tag": "f4b3e301-08cd-454d-92ff-e609d0607ab8"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:57:35.717743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-768dfd6e-90dd-4a7f-aee3-702cbd782888 req-fb0c89c4-2790-4509-9b86-2cf4a2c9d45a service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:35.718218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-768dfd6e-90dd-4a7f-aee3-702cbd782888 req-fb0c89c4-2790-4509-9b86-2cf4a2c9d45a service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:35.732866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-768dfd6e-90dd-4a7f-aee3-702cbd782888 req-fb0c89c4-2790-4509-9b86-2cf4a2c9d45a service nova] Creating event network-vif-plugged:f4b3e301-08cd-454d-92ff-e609d0607ab8 for instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 on hv-cinder-84753 Aug 01 15:57:35.738455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-768dfd6e-90dd-4a7f-aee3-702cbd782888 req-fb0c89c4-2790-4509-9b86-2cf4a2c9d45a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105345 Aug 01 15:57:35.739065 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1208/2742] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:57:35.992903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5a1459f3-b496-48aa-a664-0db09af2c3e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:35.993515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5a1459f3-b496-48aa-a664-0db09af2c3e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:36.000025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a1459f3-b496-48aa-a664-0db09af2c3e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:36.000466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a1459f3-b496-48aa-a664-0db09af2c3e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:36.001275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a1459f3-b496-48aa-a664-0db09af2c3e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:36.001721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a1459f3-b496-48aa-a664-0db09af2c3e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:36.139548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5a1459f3-b496-48aa-a664-0db09af2c3e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:36.148808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5a1459f3-b496-48aa-a664-0db09af2c3e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:36.150342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5a1459f3-b496-48aa-a664-0db09af2c3e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:36.151868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5a1459f3-b496-48aa-a664-0db09af2c3e2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.163017 Aug 01 15:57:36.152440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1535/2743] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:36.229859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7ec4c8ad-a1c9-4425-a27c-430f37a71362 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:36.230517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7ec4c8ad-a1c9-4425-a27c-430f37a71362 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:36.237354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ec4c8ad-a1c9-4425-a27c-430f37a71362 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:36.237812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ec4c8ad-a1c9-4425-a27c-430f37a71362 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:36.238614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ec4c8ad-a1c9-4425-a27c-430f37a71362 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:36.239055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ec4c8ad-a1c9-4425-a27c-430f37a71362 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:36.304407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7ec4c8ad-a1c9-4425-a27c-430f37a71362 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:36.313106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7ec4c8ad-a1c9-4425-a27c-430f37a71362 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088512 Aug 01 15:57:36.313680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1209/2744] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:36 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:36.500394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-38eb2819-2c36-410f-a44f-128703ec52ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:36.500930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-38eb2819-2c36-410f-a44f-128703ec52ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:36.507251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38eb2819-2c36-410f-a44f-128703ec52ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:36.507703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38eb2819-2c36-410f-a44f-128703ec52ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:36.508491 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38eb2819-2c36-410f-a44f-128703ec52ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:36.508937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38eb2819-2c36-410f-a44f-128703ec52ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:36.639061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f8942b95-9179-4656-8de9-bed2e835acf7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:36.639814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f8942b95-9179-4656-8de9-bed2e835acf7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:36.646160 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8942b95-9179-4656-8de9-bed2e835acf7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:36.646344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-38eb2819-2c36-410f-a44f-128703ec52ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:36.646758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8942b95-9179-4656-8de9-bed2e835acf7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:36.647585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8942b95-9179-4656-8de9-bed2e835acf7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:36.648021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8942b95-9179-4656-8de9-bed2e835acf7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:36.655175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-38eb2819-2c36-410f-a44f-128703ec52ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.158667 Aug 01 15:57:36.655764 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1536/2745] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:36 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:36.781742 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f8942b95-9179-4656-8de9-bed2e835acf7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:36.789267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f8942b95-9179-4656-8de9-bed2e835acf7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 200 len: 1367 microversion: 2.1 time: 0.154134 Aug 01 15:57:36.789831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1210/2746] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:36 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:37.174841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-29246f23-226b-4152-bb36-93c4e6c0a1cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:37.175446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-29246f23-226b-4152-bb36-93c4e6c0a1cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:37.177338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=2 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:37.178019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=6 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:37.184832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29246f23-226b-4152-bb36-93c4e6c0a1cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:37.185279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29246f23-226b-4152-bb36-93c4e6c0a1cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:37.186079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29246f23-226b-4152-bb36-93c4e6c0a1cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:37.186512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29246f23-226b-4152-bb36-93c4e6c0a1cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:37.333057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-29246f23-226b-4152-bb36-93c4e6c0a1cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:37.335758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e066ceb3-9ec5-4faf-b6de-8be9d9d78a94 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:37.336389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e066ceb3-9ec5-4faf-b6de-8be9d9d78a94 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:37.339171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=6 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:37.344700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-29246f23-226b-4152-bb36-93c4e6c0a1cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:37.345543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e066ceb3-9ec5-4faf-b6de-8be9d9d78a94 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:37.346021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e066ceb3-9ec5-4faf-b6de-8be9d9d78a94 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:37.346599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-29246f23-226b-4152-bb36-93c4e6c0a1cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:37.346803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e066ceb3-9ec5-4faf-b6de-8be9d9d78a94 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:37.347242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e066ceb3-9ec5-4faf-b6de-8be9d9d78a94 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:37.347792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-29246f23-226b-4152-bb36-93c4e6c0a1cc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.176906 Aug 01 15:57:37.348350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1537/2747] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:37.415726 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e066ceb3-9ec5-4faf-b6de-8be9d9d78a94 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:37.424782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e066ceb3-9ec5-4faf-b6de-8be9d9d78a94 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.092838 Aug 01 15:57:37.425368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1211/2748] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:37 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:37.680303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4534bbac-5dd6-404f-b6ce-d298a44de475 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:37.680915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4534bbac-5dd6-404f-b6ce-d298a44de475 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:37.687324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4534bbac-5dd6-404f-b6ce-d298a44de475 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:37.687774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4534bbac-5dd6-404f-b6ce-d298a44de475 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:37.688567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4534bbac-5dd6-404f-b6ce-d298a44de475 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:37.689005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4534bbac-5dd6-404f-b6ce-d298a44de475 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:37.811553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-084db3a1-4179-4dc9-b71a-74ca945a8263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:37.812195 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-084db3a1-4179-4dc9-b71a-74ca945a8263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:37.821358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-084db3a1-4179-4dc9-b71a-74ca945a8263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:37.821859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-084db3a1-4179-4dc9-b71a-74ca945a8263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:37.822803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-084db3a1-4179-4dc9-b71a-74ca945a8263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:37.823218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-084db3a1-4179-4dc9-b71a-74ca945a8263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:37.839682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4534bbac-5dd6-404f-b6ce-d298a44de475 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:37.849130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4534bbac-5dd6-404f-b6ce-d298a44de475 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.172710 Aug 01 15:57:37.849834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1538/2749] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:37 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:37.970584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-084db3a1-4179-4dc9-b71a-74ca945a8263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:37.979233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-084db3a1-4179-4dc9-b71a-74ca945a8263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 200 len: 1558 microversion: 2.1 time: 0.171987 Aug 01 15:57:37.979866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1212/2750] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:37 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:38.000331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8b1b10c4-8b49-492b-b77f-e19952cc8d16 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:38.000826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8b1b10c4-8b49-492b-b77f-e19952cc8d16 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:38.007217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b1b10c4-8b49-492b-b77f-e19952cc8d16 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:38.007663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b1b10c4-8b49-492b-b77f-e19952cc8d16 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:38.008444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b1b10c4-8b49-492b-b77f-e19952cc8d16 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:38.008884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b1b10c4-8b49-492b-b77f-e19952cc8d16 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:38.090551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8b1b10c4-8b49-492b-b77f-e19952cc8d16 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094104 Aug 01 15:57:38.091144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1539/2751] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 1 15:57:37 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:57:38.373172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-84cce100-9835-40f3-8794-eff15cc74c07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:38.373865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-84cce100-9835-40f3-8794-eff15cc74c07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:38.380881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84cce100-9835-40f3-8794-eff15cc74c07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:38.381343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84cce100-9835-40f3-8794-eff15cc74c07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:38.382166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84cce100-9835-40f3-8794-eff15cc74c07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:38.382620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84cce100-9835-40f3-8794-eff15cc74c07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:38.446532 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1554514e-a029-42e9-a08a-ce2983774d1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:38.447292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1554514e-a029-42e9-a08a-ce2983774d1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:38.458704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1554514e-a029-42e9-a08a-ce2983774d1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:38.458704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1554514e-a029-42e9-a08a-ce2983774d1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:38.458704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1554514e-a029-42e9-a08a-ce2983774d1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:38.458704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1554514e-a029-42e9-a08a-ce2983774d1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:38.570784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1554514e-a029-42e9-a08a-ce2983774d1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:38.579811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1554514e-a029-42e9-a08a-ce2983774d1c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.137454 Aug 01 15:57:38.580591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1540/2752] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:38 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:38.656427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-84cce100-9835-40f3-8794-eff15cc74c07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:38.665328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-84cce100-9835-40f3-8794-eff15cc74c07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:38.666975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-84cce100-9835-40f3-8794-eff15cc74c07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:38.668172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-84cce100-9835-40f3-8794-eff15cc74c07 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.299800 Aug 01 15:57:38.668751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1213/2753] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:57:38.873169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-efae3be2-6dc9-4f93-8778-29d97033ed43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:38.873801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-efae3be2-6dc9-4f93-8778-29d97033ed43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:38.881009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efae3be2-6dc9-4f93-8778-29d97033ed43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:38.881009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efae3be2-6dc9-4f93-8778-29d97033ed43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:38.881556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efae3be2-6dc9-4f93-8778-29d97033ed43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:38.882032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efae3be2-6dc9-4f93-8778-29d97033ed43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:39.354296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-efae3be2-6dc9-4f93-8778-29d97033ed43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:39.363932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-efae3be2-6dc9-4f93-8778-29d97033ed43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.495196 Aug 01 15:57:39.364523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1541/2754] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:38 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:39.517442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-bbd94345-5387-41f4-86ba-449234f7a038 req-3f298131-449d-443c-ab96-24be345e18e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e9f2d5-3104-4eec-aa3b-2fc8e8956479", "tag": "f4b3e301-08cd-454d-92ff-e609d0607ab8"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:57:39.528282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-bbd94345-5387-41f4-86ba-449234f7a038 req-3f298131-449d-443c-ab96-24be345e18e4 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:39.528732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-bbd94345-5387-41f4-86ba-449234f7a038 req-3f298131-449d-443c-ab96-24be345e18e4 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:39.542086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-bbd94345-5387-41f4-86ba-449234f7a038 req-3f298131-449d-443c-ab96-24be345e18e4 service nova] Creating event network-changed:f4b3e301-08cd-454d-92ff-e609d0607ab8 for instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 on hv-cinder-84753 Aug 01 15:57:39.547441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-bbd94345-5387-41f4-86ba-449234f7a038 req-3f298131-449d-443c-ab96-24be345e18e4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033657 Aug 01 15:57:39.548264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1214/2755] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:57:39.601636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d676eb0b-e214-44c5-a512-7176a48a8fc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:39.602259 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d676eb0b-e214-44c5-a512-7176a48a8fc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:39.610168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d676eb0b-e214-44c5-a512-7176a48a8fc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:39.610621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d676eb0b-e214-44c5-a512-7176a48a8fc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:39.611623 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d676eb0b-e214-44c5-a512-7176a48a8fc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:39.612047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d676eb0b-e214-44c5-a512-7176a48a8fc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:39.679154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d676eb0b-e214-44c5-a512-7176a48a8fc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:39.690353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d676eb0b-e214-44c5-a512-7176a48a8fc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.092866 Aug 01 15:57:39.691439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1542/2756] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:39 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:39.692175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f21aced4-3f7a-4c63-9545-e39dbf8dd080 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:39.693229 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f21aced4-3f7a-4c63-9545-e39dbf8dd080 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:39.711061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f21aced4-3f7a-4c63-9545-e39dbf8dd080 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:39.711928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f21aced4-3f7a-4c63-9545-e39dbf8dd080 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:39.713105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f21aced4-3f7a-4c63-9545-e39dbf8dd080 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:39.713811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f21aced4-3f7a-4c63-9545-e39dbf8dd080 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:39.866783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f21aced4-3f7a-4c63-9545-e39dbf8dd080 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:39.876199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f21aced4-3f7a-4c63-9545-e39dbf8dd080 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:39.877800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f21aced4-3f7a-4c63-9545-e39dbf8dd080 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:39.879089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f21aced4-3f7a-4c63-9545-e39dbf8dd080 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.191265 Aug 01 15:57:39.879728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1215/2757] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:40.386579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f4c58407-8f5c-4408-acd8-0b94a7b2ec23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:40.387201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f4c58407-8f5c-4408-acd8-0b94a7b2ec23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:40.393565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4c58407-8f5c-4408-acd8-0b94a7b2ec23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:40.394054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4c58407-8f5c-4408-acd8-0b94a7b2ec23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:40.394882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4c58407-8f5c-4408-acd8-0b94a7b2ec23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:40.395325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4c58407-8f5c-4408-acd8-0b94a7b2ec23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:40.545335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f4c58407-8f5c-4408-acd8-0b94a7b2ec23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:40.553601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f4c58407-8f5c-4408-acd8-0b94a7b2ec23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.171458 Aug 01 15:57:40.554204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1543/2758] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:40 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:40.711611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-34343215-06d5-4b9f-96b4-19b290c3515e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:40.712225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-34343215-06d5-4b9f-96b4-19b290c3515e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:40.719010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-34343215-06d5-4b9f-96b4-19b290c3515e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:40.719468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-34343215-06d5-4b9f-96b4-19b290c3515e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:40.720268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-34343215-06d5-4b9f-96b4-19b290c3515e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:40.720772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-34343215-06d5-4b9f-96b4-19b290c3515e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:40.785976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-34343215-06d5-4b9f-96b4-19b290c3515e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:40.794321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-34343215-06d5-4b9f-96b4-19b290c3515e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086559 Aug 01 15:57:40.794894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1216/2759] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:40 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:40.902177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7b019e45-0744-4306-9a1a-49a04082900b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:40.903492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7b019e45-0744-4306-9a1a-49a04082900b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:40.912802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b019e45-0744-4306-9a1a-49a04082900b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:40.913380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b019e45-0744-4306-9a1a-49a04082900b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:40.914230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b019e45-0744-4306-9a1a-49a04082900b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:40.914671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7b019e45-0744-4306-9a1a-49a04082900b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:41.053786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7b019e45-0744-4306-9a1a-49a04082900b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:41.064586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7b019e45-0744-4306-9a1a-49a04082900b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:41.066597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7b019e45-0744-4306-9a1a-49a04082900b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:41.067986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7b019e45-0744-4306-9a1a-49a04082900b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.169902 Aug 01 15:57:41.068730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1544/2760] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:41.575077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0854d6c9-a2c0-43a0-80db-04423b6c8458 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:41.575696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0854d6c9-a2c0-43a0-80db-04423b6c8458 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:41.582092 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0854d6c9-a2c0-43a0-80db-04423b6c8458 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:41.582515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0854d6c9-a2c0-43a0-80db-04423b6c8458 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:41.583327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0854d6c9-a2c0-43a0-80db-04423b6c8458 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:41.583760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0854d6c9-a2c0-43a0-80db-04423b6c8458 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:41.726170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0854d6c9-a2c0-43a0-80db-04423b6c8458 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:41.734761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0854d6c9-a2c0-43a0-80db-04423b6c8458 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.163455 Aug 01 15:57:41.735427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1217/2761] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:41 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:41.816692 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d5d73d38-9e69-46fa-8bf8-6c73625d1513 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:41.817217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d5d73d38-9e69-46fa-8bf8-6c73625d1513 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:41.823918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5d73d38-9e69-46fa-8bf8-6c73625d1513 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:41.824368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5d73d38-9e69-46fa-8bf8-6c73625d1513 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:41.825132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5d73d38-9e69-46fa-8bf8-6c73625d1513 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:41.825567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5d73d38-9e69-46fa-8bf8-6c73625d1513 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:41.889268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d5d73d38-9e69-46fa-8bf8-6c73625d1513 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:41.903021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d5d73d38-9e69-46fa-8bf8-6c73625d1513 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.090334 Aug 01 15:57:41.905950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1545/2762] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:41 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:42.093066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fa7a70a5-e71d-486e-996c-87f467e1e1e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:42.093596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fa7a70a5-e71d-486e-996c-87f467e1e1e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:42.100087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa7a70a5-e71d-486e-996c-87f467e1e1e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:42.100794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa7a70a5-e71d-486e-996c-87f467e1e1e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:42.101575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa7a70a5-e71d-486e-996c-87f467e1e1e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:42.102044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fa7a70a5-e71d-486e-996c-87f467e1e1e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:42.238134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fa7a70a5-e71d-486e-996c-87f467e1e1e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:42.247780 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fa7a70a5-e71d-486e-996c-87f467e1e1e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:42.249283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fa7a70a5-e71d-486e-996c-87f467e1e1e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:42.250519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fa7a70a5-e71d-486e-996c-87f467e1e1e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.162158 Aug 01 15:57:42.251112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1218/2763] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:42 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:42.757182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-48be26ab-6f9e-4c39-825e-5874ee2af65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:42.757701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-48be26ab-6f9e-4c39-825e-5874ee2af65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:42.764516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48be26ab-6f9e-4c39-825e-5874ee2af65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:42.764929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48be26ab-6f9e-4c39-825e-5874ee2af65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:42.765700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48be26ab-6f9e-4c39-825e-5874ee2af65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:42.766167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48be26ab-6f9e-4c39-825e-5874ee2af65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:42.904629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48be26ab-6f9e-4c39-825e-5874ee2af65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:42.912804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-48be26ab-6f9e-4c39-825e-5874ee2af65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159564 Aug 01 15:57:42.913358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1546/2764] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:42 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:42.925441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-821de895-7749-416f-8240-0982252c039d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:42.926391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-821de895-7749-416f-8240-0982252c039d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:42.929531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:42.936264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-821de895-7749-416f-8240-0982252c039d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:42.936713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-821de895-7749-416f-8240-0982252c039d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:42.937498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-821de895-7749-416f-8240-0982252c039d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:42.937947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-821de895-7749-416f-8240-0982252c039d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:43.003730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-821de895-7749-416f-8240-0982252c039d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:43.012384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-821de895-7749-416f-8240-0982252c039d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.091148 Aug 01 15:57:43.013109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1219/2765] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:42 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:43.274884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c473d8de-584d-4b1d-a354-ea080bf1d670 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:43.275487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c473d8de-584d-4b1d-a354-ea080bf1d670 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:43.283177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c473d8de-584d-4b1d-a354-ea080bf1d670 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:43.283659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c473d8de-584d-4b1d-a354-ea080bf1d670 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:43.284424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c473d8de-584d-4b1d-a354-ea080bf1d670 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:43.284859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c473d8de-584d-4b1d-a354-ea080bf1d670 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:43.421210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c473d8de-584d-4b1d-a354-ea080bf1d670 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:43.429865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c473d8de-584d-4b1d-a354-ea080bf1d670 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:43.431392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c473d8de-584d-4b1d-a354-ea080bf1d670 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:43.432561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c473d8de-584d-4b1d-a354-ea080bf1d670 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.161732 Aug 01 15:57:43.433123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1547/2766] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:43.938859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-23758f30-9406-4c98-8dc6-9b7ccd7c93f5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:43.939452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-23758f30-9406-4c98-8dc6-9b7ccd7c93f5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:43.946384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23758f30-9406-4c98-8dc6-9b7ccd7c93f5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:43.946830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23758f30-9406-4c98-8dc6-9b7ccd7c93f5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:43.947600 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23758f30-9406-4c98-8dc6-9b7ccd7c93f5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:43.948054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23758f30-9406-4c98-8dc6-9b7ccd7c93f5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:44.036451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1b700929-3047-44b0-817f-114f48343299 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:44.037475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1b700929-3047-44b0-817f-114f48343299 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:44.049453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b700929-3047-44b0-817f-114f48343299 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:44.050509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b700929-3047-44b0-817f-114f48343299 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:44.051840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b700929-3047-44b0-817f-114f48343299 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:44.052626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b700929-3047-44b0-817f-114f48343299 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:44.106667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-23758f30-9406-4c98-8dc6-9b7ccd7c93f5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:44.115481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-23758f30-9406-4c98-8dc6-9b7ccd7c93f5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.180426 Aug 01 15:57:44.121340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1220/2767] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:43 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:44.123642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1b700929-3047-44b0-817f-114f48343299 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:44.132551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1b700929-3047-44b0-817f-114f48343299 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.100875 Aug 01 15:57:44.133135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1548/2768] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:44 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:44.455764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-22aee4b2-a729-4f78-873d-1ad0f56f9a40 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:44.456386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-22aee4b2-a729-4f78-873d-1ad0f56f9a40 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:44.462855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22aee4b2-a729-4f78-873d-1ad0f56f9a40 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:44.463312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22aee4b2-a729-4f78-873d-1ad0f56f9a40 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:44.464588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22aee4b2-a729-4f78-873d-1ad0f56f9a40 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:44.465068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22aee4b2-a729-4f78-873d-1ad0f56f9a40 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:44.604976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-22aee4b2-a729-4f78-873d-1ad0f56f9a40 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:44.614046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-22aee4b2-a729-4f78-873d-1ad0f56f9a40 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:44.615535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-22aee4b2-a729-4f78-873d-1ad0f56f9a40 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:44.616698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-22aee4b2-a729-4f78-873d-1ad0f56f9a40 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.164973 Aug 01 15:57:44.617248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1221/2769] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:45.139353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-395d7434-7374-4ea6-90e2-e5685b655270 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:45.139969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-395d7434-7374-4ea6-90e2-e5685b655270 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:45.146825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-395d7434-7374-4ea6-90e2-e5685b655270 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:45.147283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-395d7434-7374-4ea6-90e2-e5685b655270 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:45.148076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-395d7434-7374-4ea6-90e2-e5685b655270 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:45.148518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-395d7434-7374-4ea6-90e2-e5685b655270 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:45.152632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0096d3f6-133c-4301-9826-14e713622879 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:45.153240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0096d3f6-133c-4301-9826-14e713622879 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:45.162414 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0096d3f6-133c-4301-9826-14e713622879 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:45.163261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0096d3f6-133c-4301-9826-14e713622879 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:45.164823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0096d3f6-133c-4301-9826-14e713622879 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:45.165651 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0096d3f6-133c-4301-9826-14e713622879 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:45.258851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0096d3f6-133c-4301-9826-14e713622879 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:45.267367 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0096d3f6-133c-4301-9826-14e713622879 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.118502 Aug 01 15:57:45.267939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1222/2770] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:45 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:45.319378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-395d7434-7374-4ea6-90e2-e5685b655270 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:45.329201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-395d7434-7374-4ea6-90e2-e5685b655270 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.194315 Aug 01 15:57:45.329774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1549/2771] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:45 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:45.640142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-90667267-30b9-465f-9b33-c5a54d35d5e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:45.640743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-90667267-30b9-465f-9b33-c5a54d35d5e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:45.647347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-90667267-30b9-465f-9b33-c5a54d35d5e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:45.647808 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-90667267-30b9-465f-9b33-c5a54d35d5e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:45.648608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-90667267-30b9-465f-9b33-c5a54d35d5e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:45.649036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-90667267-30b9-465f-9b33-c5a54d35d5e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:45.795101 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-90667267-30b9-465f-9b33-c5a54d35d5e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:45.803698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-90667267-30b9-465f-9b33-c5a54d35d5e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:45.805202 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-90667267-30b9-465f-9b33-c5a54d35d5e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:45.806416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-90667267-30b9-465f-9b33-c5a54d35d5e6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.170551 Aug 01 15:57:45.807244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1223/2772] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:46.290543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-30851325-304c-4994-a7fb-b48748f741cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:46.291133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-30851325-304c-4994-a7fb-b48748f741cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:46.297253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30851325-304c-4994-a7fb-b48748f741cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:46.297698 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30851325-304c-4994-a7fb-b48748f741cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:46.298492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30851325-304c-4994-a7fb-b48748f741cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:46.298928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-30851325-304c-4994-a7fb-b48748f741cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:46.317263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:46.350915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-462179dc-e8de-411c-b80d-fac78cf2df37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:46.351536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-462179dc-e8de-411c-b80d-fac78cf2df37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:46.357786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-462179dc-e8de-411c-b80d-fac78cf2df37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:46.358276 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-462179dc-e8de-411c-b80d-fac78cf2df37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:46.359058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-462179dc-e8de-411c-b80d-fac78cf2df37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:46.359693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-462179dc-e8de-411c-b80d-fac78cf2df37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:46.364385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-30851325-304c-4994-a7fb-b48748f741cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:46.372843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-30851325-304c-4994-a7fb-b48748f741cb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086674 Aug 01 15:57:46.373551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1550/2773] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:46 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:46.506431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-462179dc-e8de-411c-b80d-fac78cf2df37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:46.509954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:46.515808 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-462179dc-e8de-411c-b80d-fac78cf2df37 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.168890 Aug 01 15:57:46.516356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1224/2774] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:46 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:46.830303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-db5ce318-047e-42ac-9868-aee199d1b009 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:46.830916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-db5ce318-047e-42ac-9868-aee199d1b009 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:46.837476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db5ce318-047e-42ac-9868-aee199d1b009 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:46.837966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db5ce318-047e-42ac-9868-aee199d1b009 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:46.838903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db5ce318-047e-42ac-9868-aee199d1b009 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:46.839352 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db5ce318-047e-42ac-9868-aee199d1b009 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:46.980656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-db5ce318-047e-42ac-9868-aee199d1b009 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:46.989568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-db5ce318-047e-42ac-9868-aee199d1b009 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:46.991131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-db5ce318-047e-42ac-9868-aee199d1b009 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:46.992337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-db5ce318-047e-42ac-9868-aee199d1b009 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.165919 Aug 01 15:57:46.992921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1551/2775] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:47.395672 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1f7891ac-aba0-42c3-9150-43c930a6f158 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:47.396294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1f7891ac-aba0-42c3-9150-43c930a6f158 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:47.403723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1f7891ac-aba0-42c3-9150-43c930a6f158 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:47.404176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1f7891ac-aba0-42c3-9150-43c930a6f158 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:47.404991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1f7891ac-aba0-42c3-9150-43c930a6f158 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:47.405432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1f7891ac-aba0-42c3-9150-43c930a6f158 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:47.476643 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1f7891ac-aba0-42c3-9150-43c930a6f158 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:47.494269 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1f7891ac-aba0-42c3-9150-43c930a6f158 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.103033 Aug 01 15:57:47.494988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1225/2776] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:47 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:47.544877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a4b86c1b-a40a-43e1-9428-0e3eb4cb46ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:47.545492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a4b86c1b-a40a-43e1-9428-0e3eb4cb46ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:47.552489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4b86c1b-a40a-43e1-9428-0e3eb4cb46ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:47.552933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4b86c1b-a40a-43e1-9428-0e3eb4cb46ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:47.553723 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4b86c1b-a40a-43e1-9428-0e3eb4cb46ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:47.554180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4b86c1b-a40a-43e1-9428-0e3eb4cb46ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:47.691414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a4b86c1b-a40a-43e1-9428-0e3eb4cb46ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:47.700133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a4b86c1b-a40a-43e1-9428-0e3eb4cb46ff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159624 Aug 01 15:57:47.700716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1552/2777] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:47 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:48.016368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6bc91400-bccb-40ae-af7d-265d90e22fa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:48.016915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6bc91400-bccb-40ae-af7d-265d90e22fa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:48.023239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bc91400-bccb-40ae-af7d-265d90e22fa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:48.023698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bc91400-bccb-40ae-af7d-265d90e22fa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:48.024474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bc91400-bccb-40ae-af7d-265d90e22fa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:48.024916 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bc91400-bccb-40ae-af7d-265d90e22fa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:48.163692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6bc91400-bccb-40ae-af7d-265d90e22fa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:48.172238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6bc91400-bccb-40ae-af7d-265d90e22fa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:48.173763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6bc91400-bccb-40ae-af7d-265d90e22fa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:48.174987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6bc91400-bccb-40ae-af7d-265d90e22fa5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.162646 Aug 01 15:57:48.175552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1226/2778] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:48.526843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-90359cd7-0230-4860-8370-c8297fd2d085 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:48.527526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-90359cd7-0230-4860-8370-c8297fd2d085 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:48.534425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-90359cd7-0230-4860-8370-c8297fd2d085 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:48.534879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-90359cd7-0230-4860-8370-c8297fd2d085 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:48.535771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-90359cd7-0230-4860-8370-c8297fd2d085 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:48.536152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-90359cd7-0230-4860-8370-c8297fd2d085 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:48.601876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-90359cd7-0230-4860-8370-c8297fd2d085 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:48.610930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-90359cd7-0230-4860-8370-c8297fd2d085 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087919 Aug 01 15:57:48.611589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1553/2779] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:48 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:48.726013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f77e33fb-b970-41e8-a75d-3b751e1843b0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:48.726554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f77e33fb-b970-41e8-a75d-3b751e1843b0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:48.733806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f77e33fb-b970-41e8-a75d-3b751e1843b0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:48.734292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f77e33fb-b970-41e8-a75d-3b751e1843b0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:48.735067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f77e33fb-b970-41e8-a75d-3b751e1843b0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:48.735501 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f77e33fb-b970-41e8-a75d-3b751e1843b0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:48.875978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f77e33fb-b970-41e8-a75d-3b751e1843b0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:48.884571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f77e33fb-b970-41e8-a75d-3b751e1843b0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.165804 Aug 01 15:57:48.885153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1227/2780] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:48 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:49.199013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4d74cd06-1d30-4a5d-a82d-3585993ca0b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:49.199628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4d74cd06-1d30-4a5d-a82d-3585993ca0b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:49.205859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d74cd06-1d30-4a5d-a82d-3585993ca0b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:49.206340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d74cd06-1d30-4a5d-a82d-3585993ca0b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:49.207105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d74cd06-1d30-4a5d-a82d-3585993ca0b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:49.207538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d74cd06-1d30-4a5d-a82d-3585993ca0b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:49.342595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4d74cd06-1d30-4a5d-a82d-3585993ca0b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:49.351404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4d74cd06-1d30-4a5d-a82d-3585993ca0b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:49.352915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4d74cd06-1d30-4a5d-a82d-3585993ca0b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:49.354114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4d74cd06-1d30-4a5d-a82d-3585993ca0b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.159667 Aug 01 15:57:49.354707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1554/2781] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:49.633077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-50c505de-91db-449f-813e-1e1f2a17a271 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:49.633731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-50c505de-91db-449f-813e-1e1f2a17a271 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:49.640078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-50c505de-91db-449f-813e-1e1f2a17a271 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:49.640531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-50c505de-91db-449f-813e-1e1f2a17a271 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:49.641297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-50c505de-91db-449f-813e-1e1f2a17a271 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:49.641727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-50c505de-91db-449f-813e-1e1f2a17a271 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:49.705806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-50c505de-91db-449f-813e-1e1f2a17a271 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:49.714910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-50c505de-91db-449f-813e-1e1f2a17a271 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085678 Aug 01 15:57:49.715484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1228/2782] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:49 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:49.907612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b41afdfd-b9bc-4b87-a3c0-c0ddb4b978d5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:49.908235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b41afdfd-b9bc-4b87-a3c0-c0ddb4b978d5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:49.914741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b41afdfd-b9bc-4b87-a3c0-c0ddb4b978d5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:49.915165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b41afdfd-b9bc-4b87-a3c0-c0ddb4b978d5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:49.915921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b41afdfd-b9bc-4b87-a3c0-c0ddb4b978d5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:49.916347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b41afdfd-b9bc-4b87-a3c0-c0ddb4b978d5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:50.055539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b41afdfd-b9bc-4b87-a3c0-c0ddb4b978d5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:50.063775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b41afdfd-b9bc-4b87-a3c0-c0ddb4b978d5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.160381 Aug 01 15:57:50.064367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1555/2783] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:49 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:50.377225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ddc721b3-f48f-48f6-b2bd-1c9505645d5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:50.377835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ddc721b3-f48f-48f6-b2bd-1c9505645d5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:50.384567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddc721b3-f48f-48f6-b2bd-1c9505645d5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:50.385017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddc721b3-f48f-48f6-b2bd-1c9505645d5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:50.386429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddc721b3-f48f-48f6-b2bd-1c9505645d5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:50.386889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddc721b3-f48f-48f6-b2bd-1c9505645d5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:50.517714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ddc721b3-f48f-48f6-b2bd-1c9505645d5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:50.526801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ddc721b3-f48f-48f6-b2bd-1c9505645d5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:50.528284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ddc721b3-f48f-48f6-b2bd-1c9505645d5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:50.529435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ddc721b3-f48f-48f6-b2bd-1c9505645d5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.156150 Aug 01 15:57:50.530012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1229/2784] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:50.736523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f0e1175f-b49a-4440-9713-284d3f8c3cea tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:50.737225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f0e1175f-b49a-4440-9713-284d3f8c3cea tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:50.744213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f0e1175f-b49a-4440-9713-284d3f8c3cea tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:50.744671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f0e1175f-b49a-4440-9713-284d3f8c3cea tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:50.745450 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f0e1175f-b49a-4440-9713-284d3f8c3cea tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:50.745929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f0e1175f-b49a-4440-9713-284d3f8c3cea tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:50.809477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f0e1175f-b49a-4440-9713-284d3f8c3cea tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:50.817654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f0e1175f-b49a-4440-9713-284d3f8c3cea tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085124 Aug 01 15:57:50.818279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1556/2785] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:50 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:51.085072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0dc3a505-be6f-4cb3-8e8e-49bdc107f7f7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:51.085693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0dc3a505-be6f-4cb3-8e8e-49bdc107f7f7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:51.092017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0dc3a505-be6f-4cb3-8e8e-49bdc107f7f7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:51.092473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0dc3a505-be6f-4cb3-8e8e-49bdc107f7f7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:51.093242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0dc3a505-be6f-4cb3-8e8e-49bdc107f7f7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:51.093680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0dc3a505-be6f-4cb3-8e8e-49bdc107f7f7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:51.233280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0dc3a505-be6f-4cb3-8e8e-49bdc107f7f7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:51.241333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0dc3a505-be6f-4cb3-8e8e-49bdc107f7f7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.160131 Aug 01 15:57:51.241906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1230/2786] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:51 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:51.552845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-48d4f72f-a99b-4d53-a321-618045a1c6b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:51.553436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-48d4f72f-a99b-4d53-a321-618045a1c6b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:51.560305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48d4f72f-a99b-4d53-a321-618045a1c6b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:51.560759 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48d4f72f-a99b-4d53-a321-618045a1c6b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:51.561519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48d4f72f-a99b-4d53-a321-618045a1c6b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:51.562092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48d4f72f-a99b-4d53-a321-618045a1c6b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:51.695751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48d4f72f-a99b-4d53-a321-618045a1c6b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:51.704362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48d4f72f-a99b-4d53-a321-618045a1c6b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:51.705870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48d4f72f-a99b-4d53-a321-618045a1c6b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:51.707058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-48d4f72f-a99b-4d53-a321-618045a1c6b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.158252 Aug 01 15:57:51.707614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1557/2787] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:51.839921 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bd70744c-8222-4363-b549-0ed751b0233d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:51.840543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bd70744c-8222-4363-b549-0ed751b0233d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:51.847138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd70744c-8222-4363-b549-0ed751b0233d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:51.847582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd70744c-8222-4363-b549-0ed751b0233d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:51.848337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd70744c-8222-4363-b549-0ed751b0233d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:51.848769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bd70744c-8222-4363-b549-0ed751b0233d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:51.918004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bd70744c-8222-4363-b549-0ed751b0233d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:51.926577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bd70744c-8222-4363-b549-0ed751b0233d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.091025 Aug 01 15:57:51.927255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1231/2788] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:51 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:52.264320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8bbc5bbf-25b5-43cd-aab0-ed24b1673c92 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:52.264972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8bbc5bbf-25b5-43cd-aab0-ed24b1673c92 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:52.271658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8bbc5bbf-25b5-43cd-aab0-ed24b1673c92 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:52.272119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8bbc5bbf-25b5-43cd-aab0-ed24b1673c92 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:52.272885 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8bbc5bbf-25b5-43cd-aab0-ed24b1673c92 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:52.273463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8bbc5bbf-25b5-43cd-aab0-ed24b1673c92 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:52.402882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8bbc5bbf-25b5-43cd-aab0-ed24b1673c92 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:52.410857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8bbc5bbf-25b5-43cd-aab0-ed24b1673c92 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151063 Aug 01 15:57:52.411426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1558/2789] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:52 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:52.731271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b4fd4186-c556-46db-a173-15f50db4f6a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:52.731887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b4fd4186-c556-46db-a173-15f50db4f6a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:52.738038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4fd4186-c556-46db-a173-15f50db4f6a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:52.738496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4fd4186-c556-46db-a173-15f50db4f6a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:52.739262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4fd4186-c556-46db-a173-15f50db4f6a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:52.739696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4fd4186-c556-46db-a173-15f50db4f6a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:52.869367 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b4fd4186-c556-46db-a173-15f50db4f6a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:52.878012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b4fd4186-c556-46db-a173-15f50db4f6a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:52.879460 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b4fd4186-c556-46db-a173-15f50db4f6a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:52.880635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b4fd4186-c556-46db-a173-15f50db4f6a9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.153919 Aug 01 15:57:52.881200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1232/2790] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:52.949265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dfa5cc52-0a74-41d5-8bbd-d72a0028756c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:52.949874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dfa5cc52-0a74-41d5-8bbd-d72a0028756c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:52.956009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dfa5cc52-0a74-41d5-8bbd-d72a0028756c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:52.956452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dfa5cc52-0a74-41d5-8bbd-d72a0028756c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:52.957205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dfa5cc52-0a74-41d5-8bbd-d72a0028756c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:52.957639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dfa5cc52-0a74-41d5-8bbd-d72a0028756c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:53.022120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dfa5cc52-0a74-41d5-8bbd-d72a0028756c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:53.030928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dfa5cc52-0a74-41d5-8bbd-d72a0028756c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086101 Aug 01 15:57:53.031513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1559/2791] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:52 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:53.432871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2cd49492-e8a6-4b13-b333-fc3ef8690560 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:53.433518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2cd49492-e8a6-4b13-b333-fc3ef8690560 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:53.439619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2cd49492-e8a6-4b13-b333-fc3ef8690560 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:53.440072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2cd49492-e8a6-4b13-b333-fc3ef8690560 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:53.440835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2cd49492-e8a6-4b13-b333-fc3ef8690560 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:53.441274 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2cd49492-e8a6-4b13-b333-fc3ef8690560 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:53.572971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2cd49492-e8a6-4b13-b333-fc3ef8690560 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:53.581688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2cd49492-e8a6-4b13-b333-fc3ef8690560 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153135 Aug 01 15:57:53.582290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1233/2792] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:53 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:53.903430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4dc0a549-a2c7-4865-9aa1-4f9ecb3b6276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:53.904043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4dc0a549-a2c7-4865-9aa1-4f9ecb3b6276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:53.910691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4dc0a549-a2c7-4865-9aa1-4f9ecb3b6276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:53.911140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4dc0a549-a2c7-4865-9aa1-4f9ecb3b6276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:53.911911 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4dc0a549-a2c7-4865-9aa1-4f9ecb3b6276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:53.912347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4dc0a549-a2c7-4865-9aa1-4f9ecb3b6276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:54.043886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4dc0a549-a2c7-4865-9aa1-4f9ecb3b6276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:54.052495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0d4d24bb-1609-4999-9862-ad1596e48037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:54.053028 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4dc0a549-a2c7-4865-9aa1-4f9ecb3b6276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:54.053170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0d4d24bb-1609-4999-9862-ad1596e48037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:54.054480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4dc0a549-a2c7-4865-9aa1-4f9ecb3b6276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:54.055661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4dc0a549-a2c7-4865-9aa1-4f9ecb3b6276 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.156143 Aug 01 15:57:54.056219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1560/2793] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:54.061090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d4d24bb-1609-4999-9862-ad1596e48037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:54.061514 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d4d24bb-1609-4999-9862-ad1596e48037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:54.062392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d4d24bb-1609-4999-9862-ad1596e48037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:54.063068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0d4d24bb-1609-4999-9862-ad1596e48037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:54.128789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0d4d24bb-1609-4999-9862-ad1596e48037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:54.137385 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0d4d24bb-1609-4999-9862-ad1596e48037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.089394 Aug 01 15:57:54.137972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1234/2794] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:54 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:54.603184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-abe7b0b4-d1d5-47b3-97e8-391581aa3c18 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:54.603811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-abe7b0b4-d1d5-47b3-97e8-391581aa3c18 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:54.610005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abe7b0b4-d1d5-47b3-97e8-391581aa3c18 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:54.610500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abe7b0b4-d1d5-47b3-97e8-391581aa3c18 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:54.611259 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abe7b0b4-d1d5-47b3-97e8-391581aa3c18 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:54.611702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abe7b0b4-d1d5-47b3-97e8-391581aa3c18 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:54.743172 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-abe7b0b4-d1d5-47b3-97e8-391581aa3c18 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:54.751118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-abe7b0b4-d1d5-47b3-97e8-391581aa3c18 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152146 Aug 01 15:57:54.751681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1561/2795] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:54 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:55.079703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f67fcd1f-9913-45f6-aaa0-9608f18e43fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:55.080348 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f67fcd1f-9913-45f6-aaa0-9608f18e43fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:55.087160 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f67fcd1f-9913-45f6-aaa0-9608f18e43fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:55.087608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f67fcd1f-9913-45f6-aaa0-9608f18e43fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:55.088375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f67fcd1f-9913-45f6-aaa0-9608f18e43fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:55.088815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f67fcd1f-9913-45f6-aaa0-9608f18e43fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:55.161537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-041143a7-95e9-46e5-a0a5-71d7d64df779 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:55.162229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-041143a7-95e9-46e5-a0a5-71d7d64df779 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:55.168830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-041143a7-95e9-46e5-a0a5-71d7d64df779 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:55.169331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-041143a7-95e9-46e5-a0a5-71d7d64df779 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:55.170140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-041143a7-95e9-46e5-a0a5-71d7d64df779 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:55.170579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-041143a7-95e9-46e5-a0a5-71d7d64df779 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:55.231005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f67fcd1f-9913-45f6-aaa0-9608f18e43fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:55.239731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f67fcd1f-9913-45f6-aaa0-9608f18e43fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:55.241241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f67fcd1f-9913-45f6-aaa0-9608f18e43fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:55.242440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f67fcd1f-9913-45f6-aaa0-9608f18e43fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.166714 Aug 01 15:57:55.243015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1235/2796] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:55.252208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-041143a7-95e9-46e5-a0a5-71d7d64df779 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:55.260065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-041143a7-95e9-46e5-a0a5-71d7d64df779 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.104400 Aug 01 15:57:55.260781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1562/2797] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:55 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:57:55.772684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-74816362-d963-4a74-815a-0879f79dfb7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:55.773299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-74816362-d963-4a74-815a-0879f79dfb7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:55.779946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-74816362-d963-4a74-815a-0879f79dfb7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:55.780400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-74816362-d963-4a74-815a-0879f79dfb7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:55.781165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-74816362-d963-4a74-815a-0879f79dfb7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:55.781604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-74816362-d963-4a74-815a-0879f79dfb7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:55.913008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-74816362-d963-4a74-815a-0879f79dfb7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:55.921602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-74816362-d963-4a74-815a-0879f79dfb7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152829 Aug 01 15:57:55.922224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1236/2798] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:55 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:56.267693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d6a3a41a-dc35-45c7-962e-a162834ef806 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:56.268307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d6a3a41a-dc35-45c7-962e-a162834ef806 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:56.274997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6a3a41a-dc35-45c7-962e-a162834ef806 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:56.275449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6a3a41a-dc35-45c7-962e-a162834ef806 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:56.276863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6a3a41a-dc35-45c7-962e-a162834ef806 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:56.277629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d6a3a41a-dc35-45c7-962e-a162834ef806 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:56.282767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a32a7216-7db6-4475-88f8-3315d202907d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:56.283418 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a32a7216-7db6-4475-88f8-3315d202907d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:56.289814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a32a7216-7db6-4475-88f8-3315d202907d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:56.290295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a32a7216-7db6-4475-88f8-3315d202907d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:56.291054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a32a7216-7db6-4475-88f8-3315d202907d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:56.291487 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a32a7216-7db6-4475-88f8-3315d202907d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:56.374647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a32a7216-7db6-4475-88f8-3315d202907d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:56.383134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a32a7216-7db6-4475-88f8-3315d202907d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.104315 Aug 01 15:57:56.383703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1237/2799] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:56 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:56.440686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d6a3a41a-dc35-45c7-962e-a162834ef806 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:56.451520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d6a3a41a-dc35-45c7-962e-a162834ef806 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:56.453038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d6a3a41a-dc35-45c7-962e-a162834ef806 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:56.454307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d6a3a41a-dc35-45c7-962e-a162834ef806 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.190542 Aug 01 15:57:56.454877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1563/2800] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:56.943369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-68799df1-7f6f-4ee9-a243-54c4f95e1e4a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:56.944041 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-68799df1-7f6f-4ee9-a243-54c4f95e1e4a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:56.950208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68799df1-7f6f-4ee9-a243-54c4f95e1e4a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:56.950660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68799df1-7f6f-4ee9-a243-54c4f95e1e4a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:56.951617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68799df1-7f6f-4ee9-a243-54c4f95e1e4a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:56.952420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68799df1-7f6f-4ee9-a243-54c4f95e1e4a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:57.085363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-68799df1-7f6f-4ee9-a243-54c4f95e1e4a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:57.094654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-68799df1-7f6f-4ee9-a243-54c4f95e1e4a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155010 Aug 01 15:57:57.095327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1238/2801] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:56 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:57.405986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-09924a8c-9095-4676-833d-260d46254e4d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:57.406631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-09924a8c-9095-4676-833d-260d46254e4d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:57.413136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09924a8c-9095-4676-833d-260d46254e4d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:57.413590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09924a8c-9095-4676-833d-260d46254e4d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:57.414389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09924a8c-9095-4676-833d-260d46254e4d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:57.414827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09924a8c-9095-4676-833d-260d46254e4d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:57.477822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5d7a096b-d694-4683-9bd1-c51bc525c0be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:57.478477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5d7a096b-d694-4683-9bd1-c51bc525c0be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:57.479106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-09924a8c-9095-4676-833d-260d46254e4d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:57.485604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d7a096b-d694-4683-9bd1-c51bc525c0be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:57.486213 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d7a096b-d694-4683-9bd1-c51bc525c0be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:57.487109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d7a096b-d694-4683-9bd1-c51bc525c0be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:57.487531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d7a096b-d694-4683-9bd1-c51bc525c0be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:57.500839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-09924a8c-9095-4676-833d-260d46254e4d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.098690 Aug 01 15:57:57.501437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1564/2802] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:57 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:57.624876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d7a096b-d694-4683-9bd1-c51bc525c0be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:57.633676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d7a096b-d694-4683-9bd1-c51bc525c0be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:57.635241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d7a096b-d694-4683-9bd1-c51bc525c0be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:57.636952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5d7a096b-d694-4683-9bd1-c51bc525c0be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.163295 Aug 01 15:57:57.637519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1239/2803] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:58.116799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-af63bd35-e98e-4103-8398-6911dc568d4d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:58.117396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-af63bd35-e98e-4103-8398-6911dc568d4d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:58.124042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af63bd35-e98e-4103-8398-6911dc568d4d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:58.124487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af63bd35-e98e-4103-8398-6911dc568d4d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:58.125243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af63bd35-e98e-4103-8398-6911dc568d4d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:58.125670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af63bd35-e98e-4103-8398-6911dc568d4d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:58.255870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-af63bd35-e98e-4103-8398-6911dc568d4d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:58.263817 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-af63bd35-e98e-4103-8398-6911dc568d4d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150989 Aug 01 15:57:58.264378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1565/2804] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:58 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:58.522329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e7b5e560-b9dc-4453-afb2-e710ece1331c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:58.522967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e7b5e560-b9dc-4453-afb2-e710ece1331c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:58.529609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e7b5e560-b9dc-4453-afb2-e710ece1331c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:58.529950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e7b5e560-b9dc-4453-afb2-e710ece1331c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:58.530715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e7b5e560-b9dc-4453-afb2-e710ece1331c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:58.531144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e7b5e560-b9dc-4453-afb2-e710ece1331c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:58.594221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e7b5e560-b9dc-4453-afb2-e710ece1331c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:58.602467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e7b5e560-b9dc-4453-afb2-e710ece1331c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083938 Aug 01 15:57:58.603023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1240/2805] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:58 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:58.661521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8f5e7483-b64f-443a-be94-2f02b430abcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:58.662174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8f5e7483-b64f-443a-be94-2f02b430abcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:58.669459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f5e7483-b64f-443a-be94-2f02b430abcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:58.669926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f5e7483-b64f-443a-be94-2f02b430abcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:58.670700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f5e7483-b64f-443a-be94-2f02b430abcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:58.671136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f5e7483-b64f-443a-be94-2f02b430abcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:58.804725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f5e7483-b64f-443a-be94-2f02b430abcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:58.813396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f5e7483-b64f-443a-be94-2f02b430abcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:58.815128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f5e7483-b64f-443a-be94-2f02b430abcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:58.816578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8f5e7483-b64f-443a-be94-2f02b430abcb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.158908 Aug 01 15:57:58.817160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1566/2806] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:57:59.286268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b4ff2b48-486e-4d1d-a4c8-bad9017886da tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:59.286910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b4ff2b48-486e-4d1d-a4c8-bad9017886da tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:59.293643 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4ff2b48-486e-4d1d-a4c8-bad9017886da tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:59.294122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4ff2b48-486e-4d1d-a4c8-bad9017886da tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:59.295421 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4ff2b48-486e-4d1d-a4c8-bad9017886da tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:59.295868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4ff2b48-486e-4d1d-a4c8-bad9017886da tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:59.315207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:59.427396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b4ff2b48-486e-4d1d-a4c8-bad9017886da tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:59.435909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b4ff2b48-486e-4d1d-a4c8-bad9017886da tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154784 Aug 01 15:57:59.436473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1241/2807] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:59 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:59.626585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cd01ba19-61ad-4df2-886f-14714a4f0de3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:59.627284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cd01ba19-61ad-4df2-886f-14714a4f0de3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:59.633322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cd01ba19-61ad-4df2-886f-14714a4f0de3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:59.633765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cd01ba19-61ad-4df2-886f-14714a4f0de3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:59.634554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cd01ba19-61ad-4df2-886f-14714a4f0de3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:59.634982 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cd01ba19-61ad-4df2-886f-14714a4f0de3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:59.639590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:57:59.698793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cd01ba19-61ad-4df2-886f-14714a4f0de3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:59.708242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cd01ba19-61ad-4df2-886f-14714a4f0de3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086026 Aug 01 15:57:59.708811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1567/2808] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:57:59 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:57:59.839166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2d919aca-49e3-4d89-b316-6b1475a27d94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:57:59.839817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2d919aca-49e3-4d89-b316-6b1475a27d94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:57:59.846363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2d919aca-49e3-4d89-b316-6b1475a27d94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:59.846812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2d919aca-49e3-4d89-b316-6b1475a27d94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:59.847574 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2d919aca-49e3-4d89-b316-6b1475a27d94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:57:59.848016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2d919aca-49e3-4d89-b316-6b1475a27d94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:57:59.983749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2d919aca-49e3-4d89-b316-6b1475a27d94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:59.996069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2d919aca-49e3-4d89-b316-6b1475a27d94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:59.998254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2d919aca-49e3-4d89-b316-6b1475a27d94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:57:59.999461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2d919aca-49e3-4d89-b316-6b1475a27d94 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.164165 Aug 01 15:58:00.000028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1242/2809] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:57:59 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:58:00.458203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0a2c514e-d71f-4f4c-8c9c-55effcb8d2a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:00.458809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0a2c514e-d71f-4f4c-8c9c-55effcb8d2a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:00.464855 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a2c514e-d71f-4f4c-8c9c-55effcb8d2a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:00.465301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a2c514e-d71f-4f4c-8c9c-55effcb8d2a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:00.466755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a2c514e-d71f-4f4c-8c9c-55effcb8d2a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:00.467198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a2c514e-d71f-4f4c-8c9c-55effcb8d2a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:00.597192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0a2c514e-d71f-4f4c-8c9c-55effcb8d2a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:00.605695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0a2c514e-d71f-4f4c-8c9c-55effcb8d2a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151384 Aug 01 15:58:00.606295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1568/2810] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:00 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:00.729530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-00fcacde-294c-4209-96c7-415ddeddd3a0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:00.730143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-00fcacde-294c-4209-96c7-415ddeddd3a0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:00.736408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00fcacde-294c-4209-96c7-415ddeddd3a0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:00.736864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00fcacde-294c-4209-96c7-415ddeddd3a0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:00.737673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00fcacde-294c-4209-96c7-415ddeddd3a0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:00.738141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00fcacde-294c-4209-96c7-415ddeddd3a0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:00.802357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-00fcacde-294c-4209-96c7-415ddeddd3a0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:00.811122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-00fcacde-294c-4209-96c7-415ddeddd3a0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085819 Aug 01 15:58:00.811681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1243/2811] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:00 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:01.022638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-77c179e8-f895-4193-bd90-977bc8489fbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:01.023198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-77c179e8-f895-4193-bd90-977bc8489fbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:01.030109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77c179e8-f895-4193-bd90-977bc8489fbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:01.030559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77c179e8-f895-4193-bd90-977bc8489fbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:01.031333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77c179e8-f895-4193-bd90-977bc8489fbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:01.031776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77c179e8-f895-4193-bd90-977bc8489fbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:01.165293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-77c179e8-f895-4193-bd90-977bc8489fbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:01.174626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-77c179e8-f895-4193-bd90-977bc8489fbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:01.177521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-77c179e8-f895-4193-bd90-977bc8489fbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:01.179740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-77c179e8-f895-4193-bd90-977bc8489fbe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.160995 Aug 01 15:58:01.180548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1569/2812] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:01.626984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9b0da22a-131a-4147-9b82-274325f6e670 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:01.627583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9b0da22a-131a-4147-9b82-274325f6e670 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:01.634373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b0da22a-131a-4147-9b82-274325f6e670 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:01.634828 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b0da22a-131a-4147-9b82-274325f6e670 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:01.635591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b0da22a-131a-4147-9b82-274325f6e670 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:01.636032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9b0da22a-131a-4147-9b82-274325f6e670 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:01.767449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9b0da22a-131a-4147-9b82-274325f6e670 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:01.775512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9b0da22a-131a-4147-9b82-274325f6e670 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152337 Aug 01 15:58:01.776086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1244/2813] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:01 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:01.831834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8ec0e80a-aaa1-498f-8e75-10bd11c41012 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:01.832589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8ec0e80a-aaa1-498f-8e75-10bd11c41012 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:01.838881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ec0e80a-aaa1-498f-8e75-10bd11c41012 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:01.839333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ec0e80a-aaa1-498f-8e75-10bd11c41012 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:01.840097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ec0e80a-aaa1-498f-8e75-10bd11c41012 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:01.840536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ec0e80a-aaa1-498f-8e75-10bd11c41012 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:01.906581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8ec0e80a-aaa1-498f-8e75-10bd11c41012 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:01.919051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8ec0e80a-aaa1-498f-8e75-10bd11c41012 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.090978 Aug 01 15:58:01.919667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1570/2814] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:01 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:02.204939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1b7c87b0-08a1-427f-81fd-0ee92b3ed232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:02.205373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1b7c87b0-08a1-427f-81fd-0ee92b3ed232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:02.211526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b7c87b0-08a1-427f-81fd-0ee92b3ed232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:02.211971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b7c87b0-08a1-427f-81fd-0ee92b3ed232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:02.212731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b7c87b0-08a1-427f-81fd-0ee92b3ed232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:02.213196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b7c87b0-08a1-427f-81fd-0ee92b3ed232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:02.350199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1b7c87b0-08a1-427f-81fd-0ee92b3ed232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:02.358778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1b7c87b0-08a1-427f-81fd-0ee92b3ed232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:02.360289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1b7c87b0-08a1-427f-81fd-0ee92b3ed232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:02.361436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1b7c87b0-08a1-427f-81fd-0ee92b3ed232 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.161160 Aug 01 15:58:02.362362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1245/2815] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:02.798270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9910ae4f-0bf7-49cc-ba58-93e31005e7f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:02.798860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9910ae4f-0bf7-49cc-ba58-93e31005e7f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:02.805440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9910ae4f-0bf7-49cc-ba58-93e31005e7f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:02.805908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9910ae4f-0bf7-49cc-ba58-93e31005e7f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:02.806682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9910ae4f-0bf7-49cc-ba58-93e31005e7f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:02.807110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9910ae4f-0bf7-49cc-ba58-93e31005e7f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:02.938070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9910ae4f-0bf7-49cc-ba58-93e31005e7f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:02.941760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a35c3447-f6cb-4688-bb92-5f8d427adfe5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:02.942416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a35c3447-f6cb-4688-bb92-5f8d427adfe5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:02.946214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9910ae4f-0bf7-49cc-ba58-93e31005e7f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152479 Aug 01 15:58:02.947608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1571/2816] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:02 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:02.948752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a35c3447-f6cb-4688-bb92-5f8d427adfe5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:02.949235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a35c3447-f6cb-4688-bb92-5f8d427adfe5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:02.950045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a35c3447-f6cb-4688-bb92-5f8d427adfe5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:02.950490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a35c3447-f6cb-4688-bb92-5f8d427adfe5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:03.015999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a35c3447-f6cb-4688-bb92-5f8d427adfe5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:03.024038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a35c3447-f6cb-4688-bb92-5f8d427adfe5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086025 Aug 01 15:58:03.024672 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1246/2817] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:02 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:03.384944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0748b35b-f608-4683-9c0b-f228295ea8c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:03.385556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0748b35b-f608-4683-9c0b-f228295ea8c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:03.387464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=86 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:03.393346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0748b35b-f608-4683-9c0b-f228295ea8c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:03.393795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0748b35b-f608-4683-9c0b-f228295ea8c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:03.394616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0748b35b-f608-4683-9c0b-f228295ea8c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:03.395058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0748b35b-f608-4683-9c0b-f228295ea8c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:03.524448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0748b35b-f608-4683-9c0b-f228295ea8c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:03.533685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0748b35b-f608-4683-9c0b-f228295ea8c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:03.535337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0748b35b-f608-4683-9c0b-f228295ea8c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:03.536513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0748b35b-f608-4683-9c0b-f228295ea8c2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.155530 Aug 01 15:58:03.537080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1572/2818] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:03.969524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2aa1f41c-e48f-4729-85a5-d5acbd261c51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:03.970175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2aa1f41c-e48f-4729-85a5-d5acbd261c51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:03.977016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2aa1f41c-e48f-4729-85a5-d5acbd261c51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:03.977466 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2aa1f41c-e48f-4729-85a5-d5acbd261c51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:03.978331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2aa1f41c-e48f-4729-85a5-d5acbd261c51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:03.978764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2aa1f41c-e48f-4729-85a5-d5acbd261c51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:04.046619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9200753f-9fe6-48d3-bf1f-9377a64c3aaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:04.047205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9200753f-9fe6-48d3-bf1f-9377a64c3aaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:04.054508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9200753f-9fe6-48d3-bf1f-9377a64c3aaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:04.054963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9200753f-9fe6-48d3-bf1f-9377a64c3aaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:04.055848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9200753f-9fe6-48d3-bf1f-9377a64c3aaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:04.056159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9200753f-9fe6-48d3-bf1f-9377a64c3aaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:04.134424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9200753f-9fe6-48d3-bf1f-9377a64c3aaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:04.142825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9200753f-9fe6-48d3-bf1f-9377a64c3aaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.100423 Aug 01 15:58:04.145978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2aa1f41c-e48f-4729-85a5-d5acbd261c51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:04.150119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1573/2819] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:04 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:04.154182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2aa1f41c-e48f-4729-85a5-d5acbd261c51 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.189536 Aug 01 15:58:04.154733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1247/2820] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:03 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:04.559191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c973d618-8d04-480f-ab91-07ad5db1f896 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:04.559806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c973d618-8d04-480f-ab91-07ad5db1f896 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:04.565877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c973d618-8d04-480f-ab91-07ad5db1f896 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:04.566356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c973d618-8d04-480f-ab91-07ad5db1f896 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:04.567130 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c973d618-8d04-480f-ab91-07ad5db1f896 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:04.567570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c973d618-8d04-480f-ab91-07ad5db1f896 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:04.698552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c973d618-8d04-480f-ab91-07ad5db1f896 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:04.707185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c973d618-8d04-480f-ab91-07ad5db1f896 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:04.708674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c973d618-8d04-480f-ab91-07ad5db1f896 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:04.709823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c973d618-8d04-480f-ab91-07ad5db1f896 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.154581 Aug 01 15:58:04.710416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1574/2821] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:04 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:05.163656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bea15673-5439-40b0-8cbf-26cc65f9c41c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:05.164356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bea15673-5439-40b0-8cbf-26cc65f9c41c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:05.171001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bea15673-5439-40b0-8cbf-26cc65f9c41c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:05.171446 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bea15673-5439-40b0-8cbf-26cc65f9c41c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:05.172199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bea15673-5439-40b0-8cbf-26cc65f9c41c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:05.172632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bea15673-5439-40b0-8cbf-26cc65f9c41c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:05.174344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fce079b1-5649-4f26-b802-2817c961481e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:05.174964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fce079b1-5649-4f26-b802-2817c961481e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:05.181437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fce079b1-5649-4f26-b802-2817c961481e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:05.181905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fce079b1-5649-4f26-b802-2817c961481e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:05.182679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fce079b1-5649-4f26-b802-2817c961481e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:05.183107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fce079b1-5649-4f26-b802-2817c961481e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:05.262043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bea15673-5439-40b0-8cbf-26cc65f9c41c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:05.271193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bea15673-5439-40b0-8cbf-26cc65f9c41c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.111361 Aug 01 15:58:05.271778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1248/2822] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:05 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:05.338060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fce079b1-5649-4f26-b802-2817c961481e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:05.350095 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fce079b1-5649-4f26-b802-2817c961481e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.179272 Aug 01 15:58:05.351092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1575/2823] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:05 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:05.733189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cf70ab4f-96ee-441c-adae-c9a4ee3e0e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:05.736347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cf70ab4f-96ee-441c-adae-c9a4ee3e0e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:05.744558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf70ab4f-96ee-441c-adae-c9a4ee3e0e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:05.745011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf70ab4f-96ee-441c-adae-c9a4ee3e0e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:05.745785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf70ab4f-96ee-441c-adae-c9a4ee3e0e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:05.746251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf70ab4f-96ee-441c-adae-c9a4ee3e0e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:05.879521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cf70ab4f-96ee-441c-adae-c9a4ee3e0e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:05.888027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cf70ab4f-96ee-441c-adae-c9a4ee3e0e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:05.889659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cf70ab4f-96ee-441c-adae-c9a4ee3e0e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:05.890933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cf70ab4f-96ee-441c-adae-c9a4ee3e0e6f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.162010 Aug 01 15:58:05.891521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1249/2824] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:05 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:06.293744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7eede1b7-cf89-45b8-98b0-668328877a2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:06.294329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7eede1b7-cf89-45b8-98b0-668328877a2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:06.301604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7eede1b7-cf89-45b8-98b0-668328877a2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:06.302104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7eede1b7-cf89-45b8-98b0-668328877a2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:06.302876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7eede1b7-cf89-45b8-98b0-668328877a2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:06.303313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7eede1b7-cf89-45b8-98b0-668328877a2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:06.366332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7eede1b7-cf89-45b8-98b0-668328877a2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:06.372027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7c6168b1-0b0a-4141-8e03-dce3fcefc859 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:06.372652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7c6168b1-0b0a-4141-8e03-dce3fcefc859 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:06.374705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7eede1b7-cf89-45b8-98b0-668328877a2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084911 Aug 01 15:58:06.375373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1576/2825] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:06 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:06.379534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c6168b1-0b0a-4141-8e03-dce3fcefc859 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:06.379981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c6168b1-0b0a-4141-8e03-dce3fcefc859 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:06.380747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c6168b1-0b0a-4141-8e03-dce3fcefc859 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:06.381186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c6168b1-0b0a-4141-8e03-dce3fcefc859 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:06.520039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7c6168b1-0b0a-4141-8e03-dce3fcefc859 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:06.528044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7c6168b1-0b0a-4141-8e03-dce3fcefc859 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159803 Aug 01 15:58:06.528724 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1250/2826] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:06 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:06.913972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0daf99bc-ade1-4729-97fe-68c1f7c36348 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:06.914585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0daf99bc-ade1-4729-97fe-68c1f7c36348 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:06.920726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0daf99bc-ade1-4729-97fe-68c1f7c36348 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:06.921173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0daf99bc-ade1-4729-97fe-68c1f7c36348 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:06.921954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0daf99bc-ade1-4729-97fe-68c1f7c36348 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:06.922391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0daf99bc-ade1-4729-97fe-68c1f7c36348 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:07.051699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0daf99bc-ade1-4729-97fe-68c1f7c36348 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:07.060265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0daf99bc-ade1-4729-97fe-68c1f7c36348 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:07.062311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0daf99bc-ade1-4729-97fe-68c1f7c36348 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:07.063476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0daf99bc-ade1-4729-97fe-68c1f7c36348 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.153513 Aug 01 15:58:07.064033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1577/2827] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:07.396398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ebc317a4-5bac-42c7-a645-3e26f4d71424 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:07.397003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ebc317a4-5bac-42c7-a645-3e26f4d71424 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:07.403167 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ebc317a4-5bac-42c7-a645-3e26f4d71424 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:07.403621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ebc317a4-5bac-42c7-a645-3e26f4d71424 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:07.404386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ebc317a4-5bac-42c7-a645-3e26f4d71424 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:07.404825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ebc317a4-5bac-42c7-a645-3e26f4d71424 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:07.469414 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ebc317a4-5bac-42c7-a645-3e26f4d71424 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:07.477719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ebc317a4-5bac-42c7-a645-3e26f4d71424 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085703 Aug 01 15:58:07.478308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1251/2828] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:07 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:07.550899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cc1d611a-cc6d-4f50-976b-f2f09129f66c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:07.551524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cc1d611a-cc6d-4f50-976b-f2f09129f66c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:07.558053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc1d611a-cc6d-4f50-976b-f2f09129f66c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:07.558511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc1d611a-cc6d-4f50-976b-f2f09129f66c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:07.559273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc1d611a-cc6d-4f50-976b-f2f09129f66c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:07.559713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc1d611a-cc6d-4f50-976b-f2f09129f66c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:07.698398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cc1d611a-cc6d-4f50-976b-f2f09129f66c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:07.706451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cc1d611a-cc6d-4f50-976b-f2f09129f66c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159414 Aug 01 15:58:07.707023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1578/2829] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:07 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:08.086847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-dec1f1a0-d0ec-439a-872d-d37386d91a13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:08.087453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-dec1f1a0-d0ec-439a-872d-d37386d91a13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:08.094285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dec1f1a0-d0ec-439a-872d-d37386d91a13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:08.094729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dec1f1a0-d0ec-439a-872d-d37386d91a13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:08.095481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dec1f1a0-d0ec-439a-872d-d37386d91a13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:08.095919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dec1f1a0-d0ec-439a-872d-d37386d91a13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:08.223476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dec1f1a0-d0ec-439a-872d-d37386d91a13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:08.231966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dec1f1a0-d0ec-439a-872d-d37386d91a13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:08.233534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dec1f1a0-d0ec-439a-872d-d37386d91a13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:08.234788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-dec1f1a0-d0ec-439a-872d-d37386d91a13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.151842 Aug 01 15:58:08.235350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1252/2830] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:58:08.499373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0174b539-3fb9-405e-a595-f1404e20d32a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:08.499979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0174b539-3fb9-405e-a595-f1404e20d32a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:08.506207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0174b539-3fb9-405e-a595-f1404e20d32a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:08.506654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0174b539-3fb9-405e-a595-f1404e20d32a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:08.507413 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0174b539-3fb9-405e-a595-f1404e20d32a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:08.507841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0174b539-3fb9-405e-a595-f1404e20d32a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:08.571455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0174b539-3fb9-405e-a595-f1404e20d32a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:08.579538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0174b539-3fb9-405e-a595-f1404e20d32a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084017 Aug 01 15:58:08.580110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1579/2831] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:08 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:08.729016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-02e3ec16-15d3-43f2-a6cd-aa08857e1091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:08.729611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-02e3ec16-15d3-43f2-a6cd-aa08857e1091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:08.736456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-02e3ec16-15d3-43f2-a6cd-aa08857e1091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:08.736946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-02e3ec16-15d3-43f2-a6cd-aa08857e1091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:08.737714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-02e3ec16-15d3-43f2-a6cd-aa08857e1091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:08.738185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-02e3ec16-15d3-43f2-a6cd-aa08857e1091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:08.870187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-02e3ec16-15d3-43f2-a6cd-aa08857e1091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:08.878326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-02e3ec16-15d3-43f2-a6cd-aa08857e1091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153513 Aug 01 15:58:08.878889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1253/2832] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:08 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:09.258197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e766b716-f04f-4d4b-91d5-3e632f5df7d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:09.258808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e766b716-f04f-4d4b-91d5-3e632f5df7d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:09.265608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e766b716-f04f-4d4b-91d5-3e632f5df7d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:09.266086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e766b716-f04f-4d4b-91d5-3e632f5df7d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:09.266844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e766b716-f04f-4d4b-91d5-3e632f5df7d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:09.267271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e766b716-f04f-4d4b-91d5-3e632f5df7d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:09.395417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e766b716-f04f-4d4b-91d5-3e632f5df7d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:09.403769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e766b716-f04f-4d4b-91d5-3e632f5df7d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:09.405249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e766b716-f04f-4d4b-91d5-3e632f5df7d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:09.406430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e766b716-f04f-4d4b-91d5-3e632f5df7d8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.152209 Aug 01 15:58:09.406989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1580/2833] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:09.600657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-25766780-7968-4689-a90f-ce6606850b7b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:09.601445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-25766780-7968-4689-a90f-ce6606850b7b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:09.608081 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25766780-7968-4689-a90f-ce6606850b7b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:09.608541 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25766780-7968-4689-a90f-ce6606850b7b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:09.609372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25766780-7968-4689-a90f-ce6606850b7b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:09.610111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25766780-7968-4689-a90f-ce6606850b7b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:09.674750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-25766780-7968-4689-a90f-ce6606850b7b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:09.682725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-25766780-7968-4689-a90f-ce6606850b7b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085979 Aug 01 15:58:09.683289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1254/2834] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:09 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:09.901436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-99f1ea28-0574-4e2a-b5b4-1b160aa2facc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:09.902087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-99f1ea28-0574-4e2a-b5b4-1b160aa2facc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:09.909224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99f1ea28-0574-4e2a-b5b4-1b160aa2facc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:09.909785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99f1ea28-0574-4e2a-b5b4-1b160aa2facc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:09.910598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99f1ea28-0574-4e2a-b5b4-1b160aa2facc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:09.911159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-99f1ea28-0574-4e2a-b5b4-1b160aa2facc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:10.044760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-99f1ea28-0574-4e2a-b5b4-1b160aa2facc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:10.056273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-99f1ea28-0574-4e2a-b5b4-1b160aa2facc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.158529 Aug 01 15:58:10.057318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1581/2835] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:09 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:10.429978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b9463ac6-4a2b-4b97-bdf9-2e8b7062d645 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:10.430580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b9463ac6-4a2b-4b97-bdf9-2e8b7062d645 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:10.437130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b9463ac6-4a2b-4b97-bdf9-2e8b7062d645 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:10.437566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b9463ac6-4a2b-4b97-bdf9-2e8b7062d645 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:10.438362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b9463ac6-4a2b-4b97-bdf9-2e8b7062d645 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:10.439001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b9463ac6-4a2b-4b97-bdf9-2e8b7062d645 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:10.567133 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b9463ac6-4a2b-4b97-bdf9-2e8b7062d645 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:10.575596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b9463ac6-4a2b-4b97-bdf9-2e8b7062d645 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:10.577740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b9463ac6-4a2b-4b97-bdf9-2e8b7062d645 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:10.578927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b9463ac6-4a2b-4b97-bdf9-2e8b7062d645 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.152923 Aug 01 15:58:10.579505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1255/2836] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:10 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:10.705348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-da06f045-ba5b-4107-a592-8d546ff943e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:10.705907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-da06f045-ba5b-4107-a592-8d546ff943e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:10.712062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da06f045-ba5b-4107-a592-8d546ff943e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:10.712516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da06f045-ba5b-4107-a592-8d546ff943e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:10.713282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da06f045-ba5b-4107-a592-8d546ff943e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:10.713724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-da06f045-ba5b-4107-a592-8d546ff943e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:10.778073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-da06f045-ba5b-4107-a592-8d546ff943e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:10.786064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-da06f045-ba5b-4107-a592-8d546ff943e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085572 Aug 01 15:58:10.786629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1582/2837] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:10 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:11.078489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-23e7c4bf-dbe4-47b6-b5e1-99f5a92e41ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:11.079108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-23e7c4bf-dbe4-47b6-b5e1-99f5a92e41ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:11.085804 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23e7c4bf-dbe4-47b6-b5e1-99f5a92e41ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:11.086245 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23e7c4bf-dbe4-47b6-b5e1-99f5a92e41ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:11.087046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23e7c4bf-dbe4-47b6-b5e1-99f5a92e41ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:11.087536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23e7c4bf-dbe4-47b6-b5e1-99f5a92e41ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:11.225542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-23e7c4bf-dbe4-47b6-b5e1-99f5a92e41ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:11.234504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-23e7c4bf-dbe4-47b6-b5e1-99f5a92e41ce tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.160338 Aug 01 15:58:11.235067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1256/2838] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:11 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:11.601617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6cbb9fc9-ed4c-4658-9152-4267ab03a95a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:11.602349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6cbb9fc9-ed4c-4658-9152-4267ab03a95a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:11.609694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6cbb9fc9-ed4c-4658-9152-4267ab03a95a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:11.610166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6cbb9fc9-ed4c-4658-9152-4267ab03a95a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:11.611112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6cbb9fc9-ed4c-4658-9152-4267ab03a95a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:11.611543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6cbb9fc9-ed4c-4658-9152-4267ab03a95a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:11.739980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6cbb9fc9-ed4c-4658-9152-4267ab03a95a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:11.743435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:11.749361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6cbb9fc9-ed4c-4658-9152-4267ab03a95a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:11.750876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6cbb9fc9-ed4c-4658-9152-4267ab03a95a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:11.752054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6cbb9fc9-ed4c-4658-9152-4267ab03a95a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.154612 Aug 01 15:58:11.752615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1583/2839] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:11 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:11.806793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cf67f056-fb7e-4bb1-a5d9-ba86eba661b3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:11.807525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cf67f056-fb7e-4bb1-a5d9-ba86eba661b3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:11.815745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf67f056-fb7e-4bb1-a5d9-ba86eba661b3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:11.816195 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf67f056-fb7e-4bb1-a5d9-ba86eba661b3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:11.817061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf67f056-fb7e-4bb1-a5d9-ba86eba661b3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:11.817730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cf67f056-fb7e-4bb1-a5d9-ba86eba661b3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:11.883122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cf67f056-fb7e-4bb1-a5d9-ba86eba661b3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:11.891964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cf67f056-fb7e-4bb1-a5d9-ba86eba661b3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088906 Aug 01 15:58:11.892539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1257/2840] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:11 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:12.256047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7c146037-7cc4-4c07-885f-01ed9c327477 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:12.256581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7c146037-7cc4-4c07-885f-01ed9c327477 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:12.262731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c146037-7cc4-4c07-885f-01ed9c327477 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:12.263184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c146037-7cc4-4c07-885f-01ed9c327477 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:12.264590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c146037-7cc4-4c07-885f-01ed9c327477 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:12.265056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c146037-7cc4-4c07-885f-01ed9c327477 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:12.392798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7c146037-7cc4-4c07-885f-01ed9c327477 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:12.401742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7c146037-7cc4-4c07-885f-01ed9c327477 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.149596 Aug 01 15:58:12.402627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1584/2841] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:12 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:12.775587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6685e008-4d52-4495-9cd7-1470fa265b24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:12.776224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6685e008-4d52-4495-9cd7-1470fa265b24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:12.783458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6685e008-4d52-4495-9cd7-1470fa265b24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:12.784088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6685e008-4d52-4495-9cd7-1470fa265b24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:12.784857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6685e008-4d52-4495-9cd7-1470fa265b24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:12.789168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6685e008-4d52-4495-9cd7-1470fa265b24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:12.790296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:12.913824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5a48aaa5-0159-43ac-866c-c8b9a398f524 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:12.914446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5a48aaa5-0159-43ac-866c-c8b9a398f524 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:12.918589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6685e008-4d52-4495-9cd7-1470fa265b24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:12.921528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a48aaa5-0159-43ac-866c-c8b9a398f524 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:12.921999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a48aaa5-0159-43ac-866c-c8b9a398f524 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:12.922785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a48aaa5-0159-43ac-866c-c8b9a398f524 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:12.923203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a48aaa5-0159-43ac-866c-c8b9a398f524 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:12.928140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6685e008-4d52-4495-9cd7-1470fa265b24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:12.929813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6685e008-4d52-4495-9cd7-1470fa265b24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:12.931187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6685e008-4d52-4495-9cd7-1470fa265b24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.159695 Aug 01 15:58:12.931782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1258/2842] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:12.991802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5a48aaa5-0159-43ac-866c-c8b9a398f524 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:12.999790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5a48aaa5-0159-43ac-866c-c8b9a398f524 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.089942 Aug 01 15:58:13.000358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1585/2843] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:12 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:13.424194 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fdc45b79-d5d3-4574-8ead-d9603ecc5000 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:13.424799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fdc45b79-d5d3-4574-8ead-d9603ecc5000 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:13.426722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=80 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:13.432053 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdc45b79-d5d3-4574-8ead-d9603ecc5000 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:13.432504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdc45b79-d5d3-4574-8ead-d9603ecc5000 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:13.433262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdc45b79-d5d3-4574-8ead-d9603ecc5000 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:13.433690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdc45b79-d5d3-4574-8ead-d9603ecc5000 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:13.566624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fdc45b79-d5d3-4574-8ead-d9603ecc5000 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:13.574532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fdc45b79-d5d3-4574-8ead-d9603ecc5000 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155149 Aug 01 15:58:13.575087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1259/2844] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:13 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:13.958153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9a22c629-c4da-4b69-82a9-75ef0baeb495 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:13.959010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9a22c629-c4da-4b69-82a9-75ef0baeb495 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:13.966397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a22c629-c4da-4b69-82a9-75ef0baeb495 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:13.966874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a22c629-c4da-4b69-82a9-75ef0baeb495 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:13.968305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a22c629-c4da-4b69-82a9-75ef0baeb495 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:13.968738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a22c629-c4da-4b69-82a9-75ef0baeb495 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:14.020880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-85bfba1e-4e5d-433a-a765-43c4e3e9c8a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:14.021496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-85bfba1e-4e5d-433a-a765-43c4e3e9c8a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:14.028131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-85bfba1e-4e5d-433a-a765-43c4e3e9c8a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:14.028585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-85bfba1e-4e5d-433a-a765-43c4e3e9c8a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:14.029368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-85bfba1e-4e5d-433a-a765-43c4e3e9c8a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:14.030582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-85bfba1e-4e5d-433a-a765-43c4e3e9c8a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:14.105013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-85bfba1e-4e5d-433a-a765-43c4e3e9c8a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:14.113133 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-85bfba1e-4e5d-433a-a765-43c4e3e9c8a2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.095935 Aug 01 15:58:14.113738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1260/2845] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:14 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:14.126347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9a22c629-c4da-4b69-82a9-75ef0baeb495 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:14.134869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9a22c629-c4da-4b69-82a9-75ef0baeb495 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:14.136373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9a22c629-c4da-4b69-82a9-75ef0baeb495 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:14.137539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9a22c629-c4da-4b69-82a9-75ef0baeb495 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.185182 Aug 01 15:58:14.138129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1586/2846] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:14.596328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-418a627c-924e-4fc1-b49f-a4b3f2679cd2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:14.596930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-418a627c-924e-4fc1-b49f-a4b3f2679cd2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:14.603172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-418a627c-924e-4fc1-b49f-a4b3f2679cd2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:14.603610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-418a627c-924e-4fc1-b49f-a4b3f2679cd2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:14.604355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-418a627c-924e-4fc1-b49f-a4b3f2679cd2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:14.604781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-418a627c-924e-4fc1-b49f-a4b3f2679cd2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:14.732401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-418a627c-924e-4fc1-b49f-a4b3f2679cd2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:14.741046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-418a627c-924e-4fc1-b49f-a4b3f2679cd2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.148546 Aug 01 15:58:14.741620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1261/2847] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:14 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:15.134626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b5b9650b-0eb4-4c7b-9115-84d98bac86dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:15.135237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b5b9650b-0eb4-4c7b-9115-84d98bac86dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:15.141921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5b9650b-0eb4-4c7b-9115-84d98bac86dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:15.142394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5b9650b-0eb4-4c7b-9115-84d98bac86dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:15.143163 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5b9650b-0eb4-4c7b-9115-84d98bac86dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:15.143604 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5b9650b-0eb4-4c7b-9115-84d98bac86dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:15.161291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-de4cc587-c73d-477e-85e8-01138f90315a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:15.161913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-de4cc587-c73d-477e-85e8-01138f90315a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:15.168377 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-de4cc587-c73d-477e-85e8-01138f90315a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:15.168824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-de4cc587-c73d-477e-85e8-01138f90315a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:15.169635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-de4cc587-c73d-477e-85e8-01138f90315a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:15.170725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-de4cc587-c73d-477e-85e8-01138f90315a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:15.206538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b5b9650b-0eb4-4c7b-9115-84d98bac86dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:15.214812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b5b9650b-0eb4-4c7b-9115-84d98bac86dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084087 Aug 01 15:58:15.215394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1587/2848] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:15 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:15.305872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-de4cc587-c73d-477e-85e8-01138f90315a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:15.314562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-de4cc587-c73d-477e-85e8-01138f90315a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:15.316205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-de4cc587-c73d-477e-85e8-01138f90315a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:15.317368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-de4cc587-c73d-477e-85e8-01138f90315a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.160011 Aug 01 15:58:15.317939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1262/2849] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:58:15.762985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-78e12f42-555d-4b35-8755-ca18efd690d1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:15.763598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-78e12f42-555d-4b35-8755-ca18efd690d1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:15.770349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78e12f42-555d-4b35-8755-ca18efd690d1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:15.770804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78e12f42-555d-4b35-8755-ca18efd690d1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:15.771571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78e12f42-555d-4b35-8755-ca18efd690d1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:15.772040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78e12f42-555d-4b35-8755-ca18efd690d1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:15.791503 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-097000e3-743d-43b1-a973-bbb7a9a65c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:15.791988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-097000e3-743d-43b1-a973-bbb7a9a65c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:15.798306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-097000e3-743d-43b1-a973-bbb7a9a65c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:15.798750 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-097000e3-743d-43b1-a973-bbb7a9a65c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:15.799506 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-097000e3-743d-43b1-a973-bbb7a9a65c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:15.799939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-097000e3-743d-43b1-a973-bbb7a9a65c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:15.824543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-097000e3-743d-43b1-a973-bbb7a9a65c70 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479/ips" status: 200 len: 151 microversion: 2.1 time: 0.036805 Aug 01 15:58:15.825124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1263/2850] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 1 15:58:15 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:58:15.919933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-78e12f42-555d-4b35-8755-ca18efd690d1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:15.928614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-78e12f42-555d-4b35-8755-ca18efd690d1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.169455 Aug 01 15:58:15.929827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1588/2851] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:15 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:16.237825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-425bb124-eded-48a4-bd55-b48a1dc2f827 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:16.238461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-425bb124-eded-48a4-bd55-b48a1dc2f827 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:16.244717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-425bb124-eded-48a4-bd55-b48a1dc2f827 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:16.245164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-425bb124-eded-48a4-bd55-b48a1dc2f827 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:16.245932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-425bb124-eded-48a4-bd55-b48a1dc2f827 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:16.246369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-425bb124-eded-48a4-bd55-b48a1dc2f827 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:16.308661 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-425bb124-eded-48a4-bd55-b48a1dc2f827 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:16.317563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-425bb124-eded-48a4-bd55-b48a1dc2f827 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083897 Aug 01 15:58:16.318162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1264/2852] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:16 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:16.339472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e6d09698-c93b-499b-8269-03dfcd5bef24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:16.340091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e6d09698-c93b-499b-8269-03dfcd5bef24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:16.346717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6d09698-c93b-499b-8269-03dfcd5bef24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:16.347169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6d09698-c93b-499b-8269-03dfcd5bef24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:16.347937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6d09698-c93b-499b-8269-03dfcd5bef24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:16.348388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6d09698-c93b-499b-8269-03dfcd5bef24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:16.482123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e6d09698-c93b-499b-8269-03dfcd5bef24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:16.491510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e6d09698-c93b-499b-8269-03dfcd5bef24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:16.493016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e6d09698-c93b-499b-8269-03dfcd5bef24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:16.494221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e6d09698-c93b-499b-8269-03dfcd5bef24 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.158622 Aug 01 15:58:16.494781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1589/2853] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:16 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:16.954423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c17cd1e0-f955-4b6e-840f-93f0a9e413ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:16.955032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c17cd1e0-f955-4b6e-840f-93f0a9e413ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:16.961152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c17cd1e0-f955-4b6e-840f-93f0a9e413ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:16.961621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c17cd1e0-f955-4b6e-840f-93f0a9e413ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:16.962416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c17cd1e0-f955-4b6e-840f-93f0a9e413ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:16.962846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c17cd1e0-f955-4b6e-840f-93f0a9e413ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:17.094422 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c17cd1e0-f955-4b6e-840f-93f0a9e413ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:17.102837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c17cd1e0-f955-4b6e-840f-93f0a9e413ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152911 Aug 01 15:58:17.103419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1265/2854] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:16 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:17.338435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-28854505-abda-4acd-93ed-ed976028cde5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:17.338963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-28854505-abda-4acd-93ed-ed976028cde5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:17.345529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28854505-abda-4acd-93ed-ed976028cde5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:17.346138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28854505-abda-4acd-93ed-ed976028cde5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:17.346745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28854505-abda-4acd-93ed-ed976028cde5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:17.347181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28854505-abda-4acd-93ed-ed976028cde5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:17.408006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-28854505-abda-4acd-93ed-ed976028cde5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:17.415986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-28854505-abda-4acd-93ed-ed976028cde5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.081420 Aug 01 15:58:17.416547 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1590/2855] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:17 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:17.519479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a76de474-de01-4e21-a003-65c0a3193b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:17.520107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a76de474-de01-4e21-a003-65c0a3193b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:17.526674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a76de474-de01-4e21-a003-65c0a3193b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:17.527118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a76de474-de01-4e21-a003-65c0a3193b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:17.527873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a76de474-de01-4e21-a003-65c0a3193b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:17.528299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a76de474-de01-4e21-a003-65c0a3193b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:17.662717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a76de474-de01-4e21-a003-65c0a3193b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:17.671555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a76de474-de01-4e21-a003-65c0a3193b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:17.673036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a76de474-de01-4e21-a003-65c0a3193b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:17.674237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a76de474-de01-4e21-a003-65c0a3193b67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.160832 Aug 01 15:58:17.674795 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1266/2856] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:17 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:18.123695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-791e6149-b941-4871-b014-6000e9ead1e9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:18.124306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-791e6149-b941-4871-b014-6000e9ead1e9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:18.130489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-791e6149-b941-4871-b014-6000e9ead1e9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:18.130932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-791e6149-b941-4871-b014-6000e9ead1e9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:18.131689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-791e6149-b941-4871-b014-6000e9ead1e9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:18.132182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-791e6149-b941-4871-b014-6000e9ead1e9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:18.259364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-791e6149-b941-4871-b014-6000e9ead1e9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:18.267544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-791e6149-b941-4871-b014-6000e9ead1e9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.147665 Aug 01 15:58:18.268117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1591/2857] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:18 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:18.437435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-92cd0e9e-b66e-4d58-8aff-ba64ad5a3687 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:18.438076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-92cd0e9e-b66e-4d58-8aff-ba64ad5a3687 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:18.444251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-92cd0e9e-b66e-4d58-8aff-ba64ad5a3687 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:18.444702 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-92cd0e9e-b66e-4d58-8aff-ba64ad5a3687 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:18.445461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-92cd0e9e-b66e-4d58-8aff-ba64ad5a3687 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:18.445918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-92cd0e9e-b66e-4d58-8aff-ba64ad5a3687 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:18.510622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-92cd0e9e-b66e-4d58-8aff-ba64ad5a3687 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:18.519110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-92cd0e9e-b66e-4d58-8aff-ba64ad5a3687 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085599 Aug 01 15:58:18.519674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1267/2858] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:18 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:18.697473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3cc32ccf-b11a-4e80-8707-959d48ad8964 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:18.698034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3cc32ccf-b11a-4e80-8707-959d48ad8964 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:18.705274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cc32ccf-b11a-4e80-8707-959d48ad8964 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:18.705725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cc32ccf-b11a-4e80-8707-959d48ad8964 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:18.706538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cc32ccf-b11a-4e80-8707-959d48ad8964 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:18.706976 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cc32ccf-b11a-4e80-8707-959d48ad8964 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:18.838055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3cc32ccf-b11a-4e80-8707-959d48ad8964 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:18.846580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3cc32ccf-b11a-4e80-8707-959d48ad8964 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:18.848126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3cc32ccf-b11a-4e80-8707-959d48ad8964 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:18.849353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3cc32ccf-b11a-4e80-8707-959d48ad8964 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.155890 Aug 01 15:58:18.849934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1592/2859] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:19.289558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-adb416a6-46c3-45b1-80dc-3c9ce4703d0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:19.290215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-adb416a6-46c3-45b1-80dc-3c9ce4703d0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:19.296822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-adb416a6-46c3-45b1-80dc-3c9ce4703d0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:19.297274 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-adb416a6-46c3-45b1-80dc-3c9ce4703d0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:19.298083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-adb416a6-46c3-45b1-80dc-3c9ce4703d0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:19.298846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-adb416a6-46c3-45b1-80dc-3c9ce4703d0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:19.427024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-adb416a6-46c3-45b1-80dc-3c9ce4703d0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:19.434955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-adb416a6-46c3-45b1-80dc-3c9ce4703d0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.149289 Aug 01 15:58:19.435995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1268/2860] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:19 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:19.540823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-15fc72a5-1be4-49d6-ab79-d8b67ead4cb2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:19.541434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-15fc72a5-1be4-49d6-ab79-d8b67ead4cb2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:19.548040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15fc72a5-1be4-49d6-ab79-d8b67ead4cb2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:19.548488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15fc72a5-1be4-49d6-ab79-d8b67ead4cb2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:19.549247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15fc72a5-1be4-49d6-ab79-d8b67ead4cb2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:19.549686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-15fc72a5-1be4-49d6-ab79-d8b67ead4cb2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:19.615239 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-15fc72a5-1be4-49d6-ab79-d8b67ead4cb2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:19.623898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-15fc72a5-1be4-49d6-ab79-d8b67ead4cb2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086466 Aug 01 15:58:19.624464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1593/2861] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:19 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:19.876823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8957202d-c629-4ded-b727-43c86ac75e13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:19.878050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8957202d-c629-4ded-b727-43c86ac75e13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:19.884863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8957202d-c629-4ded-b727-43c86ac75e13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:19.885314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8957202d-c629-4ded-b727-43c86ac75e13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:19.886118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8957202d-c629-4ded-b727-43c86ac75e13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:19.886555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8957202d-c629-4ded-b727-43c86ac75e13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:20.020801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8957202d-c629-4ded-b727-43c86ac75e13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:20.029983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8957202d-c629-4ded-b727-43c86ac75e13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:20.032122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8957202d-c629-4ded-b727-43c86ac75e13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:20.033294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8957202d-c629-4ded-b727-43c86ac75e13 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.164472 Aug 01 15:58:20.033858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1269/2862] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:58:20.458585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-115e4909-e2f5-4328-b900-ecc5616ac7bb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:20.459211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-115e4909-e2f5-4328-b900-ecc5616ac7bb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:20.465376 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-115e4909-e2f5-4328-b900-ecc5616ac7bb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:20.465836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-115e4909-e2f5-4328-b900-ecc5616ac7bb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:20.466640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-115e4909-e2f5-4328-b900-ecc5616ac7bb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:20.467753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-115e4909-e2f5-4328-b900-ecc5616ac7bb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:20.600440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-115e4909-e2f5-4328-b900-ecc5616ac7bb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:20.608837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-115e4909-e2f5-4328-b900-ecc5616ac7bb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155205 Aug 01 15:58:20.609453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1594/2863] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:20 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:20.646317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2f31db1f-e4c5-4c63-a8c2-93afd24e5419 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:20.646932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2f31db1f-e4c5-4c63-a8c2-93afd24e5419 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:20.653677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f31db1f-e4c5-4c63-a8c2-93afd24e5419 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:20.654168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f31db1f-e4c5-4c63-a8c2-93afd24e5419 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:20.654972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f31db1f-e4c5-4c63-a8c2-93afd24e5419 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:20.655410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f31db1f-e4c5-4c63-a8c2-93afd24e5419 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:20.719682 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2f31db1f-e4c5-4c63-a8c2-93afd24e5419 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:20.728199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2f31db1f-e4c5-4c63-a8c2-93afd24e5419 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085736 Aug 01 15:58:20.728766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1270/2864] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:20 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:21.057173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a79aab12-9e87-4960-9bed-cf17743bb12b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:21.057819 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a79aab12-9e87-4960-9bed-cf17743bb12b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:21.064630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a79aab12-9e87-4960-9bed-cf17743bb12b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:21.065079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a79aab12-9e87-4960-9bed-cf17743bb12b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:21.065854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a79aab12-9e87-4960-9bed-cf17743bb12b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:21.066324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a79aab12-9e87-4960-9bed-cf17743bb12b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:21.197768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a79aab12-9e87-4960-9bed-cf17743bb12b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:21.206427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a79aab12-9e87-4960-9bed-cf17743bb12b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:21.207969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a79aab12-9e87-4960-9bed-cf17743bb12b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:21.209139 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a79aab12-9e87-4960-9bed-cf17743bb12b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.155954 Aug 01 15:58:21.209700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1595/2865] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:21.630646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-89663b5c-13ed-466c-8d22-46c1a9a57e81 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:21.631268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-89663b5c-13ed-466c-8d22-46c1a9a57e81 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:21.637431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89663b5c-13ed-466c-8d22-46c1a9a57e81 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:21.637875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89663b5c-13ed-466c-8d22-46c1a9a57e81 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:21.638673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89663b5c-13ed-466c-8d22-46c1a9a57e81 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:21.639125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-89663b5c-13ed-466c-8d22-46c1a9a57e81 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:21.748738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dd86dc46-0526-4ded-b1b7-233a1746a480 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:21.749463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dd86dc46-0526-4ded-b1b7-233a1746a480 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:21.756451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd86dc46-0526-4ded-b1b7-233a1746a480 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:21.756992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd86dc46-0526-4ded-b1b7-233a1746a480 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:21.757771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd86dc46-0526-4ded-b1b7-233a1746a480 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:21.758271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dd86dc46-0526-4ded-b1b7-233a1746a480 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:21.779200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-89663b5c-13ed-466c-8d22-46c1a9a57e81 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:21.788169 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-89663b5c-13ed-466c-8d22-46c1a9a57e81 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.161299 Aug 01 15:58:21.788775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1271/2866] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:21 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:21.823736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dd86dc46-0526-4ded-b1b7-233a1746a480 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:21.832583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dd86dc46-0526-4ded-b1b7-233a1746a480 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087747 Aug 01 15:58:21.833152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1596/2867] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:21 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:22.231632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-48ff86a6-c503-468e-9c87-91c3ed818da6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:22.232241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-48ff86a6-c503-468e-9c87-91c3ed818da6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:22.238408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-48ff86a6-c503-468e-9c87-91c3ed818da6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:22.238858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-48ff86a6-c503-468e-9c87-91c3ed818da6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:22.239625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-48ff86a6-c503-468e-9c87-91c3ed818da6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:22.240065 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-48ff86a6-c503-468e-9c87-91c3ed818da6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:22.368418 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-48ff86a6-c503-468e-9c87-91c3ed818da6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:22.377197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-48ff86a6-c503-468e-9c87-91c3ed818da6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:22.378726 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-48ff86a6-c503-468e-9c87-91c3ed818da6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:22.379879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-48ff86a6-c503-468e-9c87-91c3ed818da6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.152205 Aug 01 15:58:22.380424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1272/2868] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:22 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:22.809467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5a1d7382-9a0b-4ddb-a4b6-5b1170183b8f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:22.810105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5a1d7382-9a0b-4ddb-a4b6-5b1170183b8f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:22.817294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a1d7382-9a0b-4ddb-a4b6-5b1170183b8f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:22.817734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a1d7382-9a0b-4ddb-a4b6-5b1170183b8f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:22.818515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a1d7382-9a0b-4ddb-a4b6-5b1170183b8f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:22.818945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a1d7382-9a0b-4ddb-a4b6-5b1170183b8f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:22.854312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-96456703-da76-446f-8ea6-114989671c50 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:22.854888 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-96456703-da76-446f-8ea6-114989671c50 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:22.862109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96456703-da76-446f-8ea6-114989671c50 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:22.862567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96456703-da76-446f-8ea6-114989671c50 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:22.863355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96456703-da76-446f-8ea6-114989671c50 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:22.863794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96456703-da76-446f-8ea6-114989671c50 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:22.940352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-96456703-da76-446f-8ea6-114989671c50 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:22.948427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-96456703-da76-446f-8ea6-114989671c50 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.098225 Aug 01 15:58:22.948998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1273/2869] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:22 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:22.973643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5a1d7382-9a0b-4ddb-a4b6-5b1170183b8f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:22.981857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5a1d7382-9a0b-4ddb-a4b6-5b1170183b8f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.176206 Aug 01 15:58:22.983052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1597/2870] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:22 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:23.403408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e9e53716-f10b-4f18-85c8-93a04cbd5791 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:23.404019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e9e53716-f10b-4f18-85c8-93a04cbd5791 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:23.411039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9e53716-f10b-4f18-85c8-93a04cbd5791 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:23.411497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9e53716-f10b-4f18-85c8-93a04cbd5791 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:23.412254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9e53716-f10b-4f18-85c8-93a04cbd5791 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:23.412697 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9e53716-f10b-4f18-85c8-93a04cbd5791 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:23.690941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e9e53716-f10b-4f18-85c8-93a04cbd5791 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:23.699225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e9e53716-f10b-4f18-85c8-93a04cbd5791 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:23.700723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e9e53716-f10b-4f18-85c8-93a04cbd5791 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:23.702540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e9e53716-f10b-4f18-85c8-93a04cbd5791 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.303083 Aug 01 15:58:23.703094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1274/2871] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:23 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:23.968776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b3f4e7ba-f170-4b17-9ec3-5d4f290d29df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:23.969494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b3f4e7ba-f170-4b17-9ec3-5d4f290d29df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:23.975998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b3f4e7ba-f170-4b17-9ec3-5d4f290d29df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:23.976706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b3f4e7ba-f170-4b17-9ec3-5d4f290d29df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:23.977476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b3f4e7ba-f170-4b17-9ec3-5d4f290d29df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:23.977939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b3f4e7ba-f170-4b17-9ec3-5d4f290d29df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:24.005529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6c5d90af-7e30-491f-8f11-a0daba0dac2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:24.006723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6c5d90af-7e30-491f-8f11-a0daba0dac2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:24.013414 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6c5d90af-7e30-491f-8f11-a0daba0dac2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:24.013864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6c5d90af-7e30-491f-8f11-a0daba0dac2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:24.014667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6c5d90af-7e30-491f-8f11-a0daba0dac2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:24.015109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6c5d90af-7e30-491f-8f11-a0daba0dac2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:24.019225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:24.040398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b3f4e7ba-f170-4b17-9ec3-5d4f290d29df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:24.049039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b3f4e7ba-f170-4b17-9ec3-5d4f290d29df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084210 Aug 01 15:58:24.049748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1598/2872] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:23 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:24.155812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6c5d90af-7e30-491f-8f11-a0daba0dac2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:24.163802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6c5d90af-7e30-491f-8f11-a0daba0dac2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.163331 Aug 01 15:58:24.164368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1275/2873] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:23 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:24.725898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-02c9ee7c-9b52-4cf0-bfc2-4ac7c079ea71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:24.726784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-02c9ee7c-9b52-4cf0-bfc2-4ac7c079ea71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:24.733720 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02c9ee7c-9b52-4cf0-bfc2-4ac7c079ea71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:24.734150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02c9ee7c-9b52-4cf0-bfc2-4ac7c079ea71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:24.734917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02c9ee7c-9b52-4cf0-bfc2-4ac7c079ea71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:24.735355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-02c9ee7c-9b52-4cf0-bfc2-4ac7c079ea71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:24.865480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-02c9ee7c-9b52-4cf0-bfc2-4ac7c079ea71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:24.874096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-02c9ee7c-9b52-4cf0-bfc2-4ac7c079ea71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:24.875599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-02c9ee7c-9b52-4cf0-bfc2-4ac7c079ea71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:24.876772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-02c9ee7c-9b52-4cf0-bfc2-4ac7c079ea71 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.154811 Aug 01 15:58:24.877332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1599/2874] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:25.070540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8949e500-3bc1-48da-9c71-6b4ae5999c81 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:25.071196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8949e500-3bc1-48da-9c71-6b4ae5999c81 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:25.078416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8949e500-3bc1-48da-9c71-6b4ae5999c81 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:25.078860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8949e500-3bc1-48da-9c71-6b4ae5999c81 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:25.079633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8949e500-3bc1-48da-9c71-6b4ae5999c81 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:25.080062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8949e500-3bc1-48da-9c71-6b4ae5999c81 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:25.142326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8949e500-3bc1-48da-9c71-6b4ae5999c81 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:25.150498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8949e500-3bc1-48da-9c71-6b4ae5999c81 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083775 Aug 01 15:58:25.151043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1276/2875] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:25 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:25.184489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e69d1c22-f41d-4265-9968-3e5256ea5af2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:25.185099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e69d1c22-f41d-4265-9968-3e5256ea5af2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:25.192249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e69d1c22-f41d-4265-9968-3e5256ea5af2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:25.192700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e69d1c22-f41d-4265-9968-3e5256ea5af2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:25.193465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e69d1c22-f41d-4265-9968-3e5256ea5af2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:25.193920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e69d1c22-f41d-4265-9968-3e5256ea5af2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:25.212474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:25.328431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e69d1c22-f41d-4265-9968-3e5256ea5af2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:25.336588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e69d1c22-f41d-4265-9968-3e5256ea5af2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155901 Aug 01 15:58:25.337154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1600/2876] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:25 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:25.901082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-65f3139d-cb3f-4e71-9bcc-363ec50bccac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:25.901690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-65f3139d-cb3f-4e71-9bcc-363ec50bccac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:25.908226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f3139d-cb3f-4e71-9bcc-363ec50bccac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:25.908668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f3139d-cb3f-4e71-9bcc-363ec50bccac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:25.909433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f3139d-cb3f-4e71-9bcc-363ec50bccac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:25.909866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65f3139d-cb3f-4e71-9bcc-363ec50bccac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:26.039632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-65f3139d-cb3f-4e71-9bcc-363ec50bccac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:26.048011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-65f3139d-cb3f-4e71-9bcc-363ec50bccac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:26.049516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-65f3139d-cb3f-4e71-9bcc-363ec50bccac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:26.050717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-65f3139d-cb3f-4e71-9bcc-363ec50bccac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.153570 Aug 01 15:58:26.051829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1277/2877] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:25 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:26.172157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-221587c0-7658-4c67-a035-731100e8cdf9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:26.172778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-221587c0-7658-4c67-a035-731100e8cdf9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:26.179562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-221587c0-7658-4c67-a035-731100e8cdf9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:26.180013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-221587c0-7658-4c67-a035-731100e8cdf9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:26.180782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-221587c0-7658-4c67-a035-731100e8cdf9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:26.181222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-221587c0-7658-4c67-a035-731100e8cdf9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:26.243545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-221587c0-7658-4c67-a035-731100e8cdf9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:26.252327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-221587c0-7658-4c67-a035-731100e8cdf9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084160 Aug 01 15:58:26.252893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1601/2878] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:26 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:26.358641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e8f5f3ac-789c-42e3-8352-be2bc665286c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:26.359251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e8f5f3ac-789c-42e3-8352-be2bc665286c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:26.366055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8f5f3ac-789c-42e3-8352-be2bc665286c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:26.366513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8f5f3ac-789c-42e3-8352-be2bc665286c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:26.367317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8f5f3ac-789c-42e3-8352-be2bc665286c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:26.367919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8f5f3ac-789c-42e3-8352-be2bc665286c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:26.748705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e8f5f3ac-789c-42e3-8352-be2bc665286c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:26.757042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e8f5f3ac-789c-42e3-8352-be2bc665286c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.402744 Aug 01 15:58:26.757605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1278/2879] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:26 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:27.074875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-38709671-0d14-4d4f-931c-9743269dea9b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:27.075495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-38709671-0d14-4d4f-931c-9743269dea9b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:27.082222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38709671-0d14-4d4f-931c-9743269dea9b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:27.082676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38709671-0d14-4d4f-931c-9743269dea9b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:27.083444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38709671-0d14-4d4f-931c-9743269dea9b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:27.083882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-38709671-0d14-4d4f-931c-9743269dea9b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:27.214411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-38709671-0d14-4d4f-931c-9743269dea9b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:27.223506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-38709671-0d14-4d4f-931c-9743269dea9b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:27.225010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-38709671-0d14-4d4f-931c-9743269dea9b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:27.226447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-38709671-0d14-4d4f-931c-9743269dea9b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.155284 Aug 01 15:58:27.227010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1602/2880] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:27.273783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b8e8f745-474d-4468-978a-05d345a4860e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:27.274490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b8e8f745-474d-4468-978a-05d345a4860e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:27.281233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b8e8f745-474d-4468-978a-05d345a4860e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:27.281683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b8e8f745-474d-4468-978a-05d345a4860e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:27.282486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b8e8f745-474d-4468-978a-05d345a4860e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:27.282930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b8e8f745-474d-4468-978a-05d345a4860e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:27.345604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b8e8f745-474d-4468-978a-05d345a4860e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:27.353794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b8e8f745-474d-4468-978a-05d345a4860e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083837 Aug 01 15:58:27.354384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1279/2881] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:27 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:27.779249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c37cf608-6b47-4107-ae17-0356f03eb305 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:27.780013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c37cf608-6b47-4107-ae17-0356f03eb305 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:27.786543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c37cf608-6b47-4107-ae17-0356f03eb305 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:27.787026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c37cf608-6b47-4107-ae17-0356f03eb305 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:27.787798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c37cf608-6b47-4107-ae17-0356f03eb305 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:27.788250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c37cf608-6b47-4107-ae17-0356f03eb305 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:27.917365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c37cf608-6b47-4107-ae17-0356f03eb305 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:27.930835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c37cf608-6b47-4107-ae17-0356f03eb305 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155350 Aug 01 15:58:27.931432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1603/2882] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:27 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:28.250024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d6d16382-11e0-46b6-b8b0-e256b52a53ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:28.250628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d6d16382-11e0-46b6-b8b0-e256b52a53ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:28.257183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6d16382-11e0-46b6-b8b0-e256b52a53ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:28.257633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6d16382-11e0-46b6-b8b0-e256b52a53ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:28.258419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6d16382-11e0-46b6-b8b0-e256b52a53ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:28.258853 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6d16382-11e0-46b6-b8b0-e256b52a53ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:28.375469 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b0eca637-9a41-4206-8183-faaa7841e036 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:28.376088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b0eca637-9a41-4206-8183-faaa7841e036 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:28.382747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0eca637-9a41-4206-8183-faaa7841e036 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:28.383203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0eca637-9a41-4206-8183-faaa7841e036 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:28.383979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0eca637-9a41-4206-8183-faaa7841e036 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:28.384417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0eca637-9a41-4206-8183-faaa7841e036 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:28.391158 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d6d16382-11e0-46b6-b8b0-e256b52a53ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:28.399632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d6d16382-11e0-46b6-b8b0-e256b52a53ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:28.401132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d6d16382-11e0-46b6-b8b0-e256b52a53ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:28.402312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d6d16382-11e0-46b6-b8b0-e256b52a53ff tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.156665 Aug 01 15:58:28.402855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1280/2883] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:58:28.450018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b0eca637-9a41-4206-8183-faaa7841e036 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:28.458889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b0eca637-9a41-4206-8183-faaa7841e036 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087831 Aug 01 15:58:28.459462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1604/2884] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:28 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:28.952669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-781d1773-4a69-4d2b-b879-1c833213d64d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:28.953290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-781d1773-4a69-4d2b-b879-1c833213d64d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:28.959454 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-781d1773-4a69-4d2b-b879-1c833213d64d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:28.959906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-781d1773-4a69-4d2b-b879-1c833213d64d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:28.960668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-781d1773-4a69-4d2b-b879-1c833213d64d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:28.961108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-781d1773-4a69-4d2b-b879-1c833213d64d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:29.089544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-781d1773-4a69-4d2b-b879-1c833213d64d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:29.098076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-781d1773-4a69-4d2b-b879-1c833213d64d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.149151 Aug 01 15:58:29.098661 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1281/2885] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:28 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:29.425524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-068c4743-c822-4232-ba51-5c146afa7aca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:29.426166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-068c4743-c822-4232-ba51-5c146afa7aca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:29.432824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-068c4743-c822-4232-ba51-5c146afa7aca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:29.433272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-068c4743-c822-4232-ba51-5c146afa7aca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:29.434079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-068c4743-c822-4232-ba51-5c146afa7aca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:29.434519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-068c4743-c822-4232-ba51-5c146afa7aca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:29.480154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-29e8eb67-bb80-40aa-836b-fbf49689e081 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:29.480757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-29e8eb67-bb80-40aa-836b-fbf49689e081 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:29.487545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-29e8eb67-bb80-40aa-836b-fbf49689e081 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:29.488002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-29e8eb67-bb80-40aa-836b-fbf49689e081 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:29.488778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-29e8eb67-bb80-40aa-836b-fbf49689e081 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:29.489222 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-29e8eb67-bb80-40aa-836b-fbf49689e081 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:29.570671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-29e8eb67-bb80-40aa-836b-fbf49689e081 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:29.579563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-29e8eb67-bb80-40aa-836b-fbf49689e081 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.103390 Aug 01 15:58:29.580537 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1282/2886] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:29 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:29.593307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-068c4743-c822-4232-ba51-5c146afa7aca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:29.601854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-068c4743-c822-4232-ba51-5c146afa7aca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:29.603374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-068c4743-c822-4232-ba51-5c146afa7aca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:29.604836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-068c4743-c822-4232-ba51-5c146afa7aca tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.183162 Aug 01 15:58:29.605662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1605/2887] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:30.119680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-42b63d52-eb41-4942-89a4-15b8a3edc1aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:30.120302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-42b63d52-eb41-4942-89a4-15b8a3edc1aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:30.126724 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42b63d52-eb41-4942-89a4-15b8a3edc1aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:30.126875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42b63d52-eb41-4942-89a4-15b8a3edc1aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:30.127650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42b63d52-eb41-4942-89a4-15b8a3edc1aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:30.128092 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42b63d52-eb41-4942-89a4-15b8a3edc1aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:30.257498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-42b63d52-eb41-4942-89a4-15b8a3edc1aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:30.266035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-42b63d52-eb41-4942-89a4-15b8a3edc1aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150226 Aug 01 15:58:30.266610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1283/2888] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:30 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:30.602967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f7ba78da-1f36-40c8-997b-d0c16c49db31 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:30.603576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f7ba78da-1f36-40c8-997b-d0c16c49db31 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:30.610757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7ba78da-1f36-40c8-997b-d0c16c49db31 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:30.611208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7ba78da-1f36-40c8-997b-d0c16c49db31 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:30.611967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7ba78da-1f36-40c8-997b-d0c16c49db31 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:30.612402 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7ba78da-1f36-40c8-997b-d0c16c49db31 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:30.627364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f306a718-58c1-4998-9f5b-7feaea28547c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:30.627972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f306a718-58c1-4998-9f5b-7feaea28547c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:30.634464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f306a718-58c1-4998-9f5b-7feaea28547c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:30.634909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f306a718-58c1-4998-9f5b-7feaea28547c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:30.635663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f306a718-58c1-4998-9f5b-7feaea28547c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:30.636099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f306a718-58c1-4998-9f5b-7feaea28547c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:30.675621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f7ba78da-1f36-40c8-997b-d0c16c49db31 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:30.683802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f7ba78da-1f36-40c8-997b-d0c16c49db31 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084927 Aug 01 15:58:30.684381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1606/2889] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:30 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:30.771630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f306a718-58c1-4998-9f5b-7feaea28547c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:30.780755 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f306a718-58c1-4998-9f5b-7feaea28547c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:30.782299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f306a718-58c1-4998-9f5b-7feaea28547c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:30.783471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f306a718-58c1-4998-9f5b-7feaea28547c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.159950 Aug 01 15:58:30.784058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1284/2890] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:58:31.289346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-124742b1-267a-40f1-b17e-dbfb5f595b43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:31.290033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-124742b1-267a-40f1-b17e-dbfb5f595b43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:31.296667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-124742b1-267a-40f1-b17e-dbfb5f595b43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:31.297110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-124742b1-267a-40f1-b17e-dbfb5f595b43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:31.297930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-124742b1-267a-40f1-b17e-dbfb5f595b43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:31.298348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-124742b1-267a-40f1-b17e-dbfb5f595b43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:31.436434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-124742b1-267a-40f1-b17e-dbfb5f595b43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:31.444377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-124742b1-267a-40f1-b17e-dbfb5f595b43 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.158900 Aug 01 15:58:31.444951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1607/2891] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:31 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:31.706593 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7d708282-9eed-4176-840d-b2a6db45d7e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:31.707314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7d708282-9eed-4176-840d-b2a6db45d7e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:31.716610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d708282-9eed-4176-840d-b2a6db45d7e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:31.717057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d708282-9eed-4176-840d-b2a6db45d7e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:31.717823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d708282-9eed-4176-840d-b2a6db45d7e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:31.718288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7d708282-9eed-4176-840d-b2a6db45d7e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:31.780544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7d708282-9eed-4176-840d-b2a6db45d7e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:31.788523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7d708282-9eed-4176-840d-b2a6db45d7e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087685 Aug 01 15:58:31.789079 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1285/2892] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:31 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:31.806268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f1c9dcdd-b34d-4f0b-9f37-ffdba1938132 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:31.806854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f1c9dcdd-b34d-4f0b-9f37-ffdba1938132 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:31.814364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1c9dcdd-b34d-4f0b-9f37-ffdba1938132 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:31.814806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1c9dcdd-b34d-4f0b-9f37-ffdba1938132 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:31.815561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1c9dcdd-b34d-4f0b-9f37-ffdba1938132 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:31.815995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f1c9dcdd-b34d-4f0b-9f37-ffdba1938132 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:31.951395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f1c9dcdd-b34d-4f0b-9f37-ffdba1938132 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:31.960078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f1c9dcdd-b34d-4f0b-9f37-ffdba1938132 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:31.961508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f1c9dcdd-b34d-4f0b-9f37-ffdba1938132 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:31.962707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f1c9dcdd-b34d-4f0b-9f37-ffdba1938132 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.160313 Aug 01 15:58:31.963298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1608/2893] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:32.465879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-efb4760e-aa08-440c-b439-76f6ba72eb9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:32.466519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-efb4760e-aa08-440c-b439-76f6ba72eb9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:32.473233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-efb4760e-aa08-440c-b439-76f6ba72eb9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:32.473685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-efb4760e-aa08-440c-b439-76f6ba72eb9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:32.474484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-efb4760e-aa08-440c-b439-76f6ba72eb9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:32.474997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-efb4760e-aa08-440c-b439-76f6ba72eb9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:32.602498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-efb4760e-aa08-440c-b439-76f6ba72eb9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:32.610473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-efb4760e-aa08-440c-b439-76f6ba72eb9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.148467 Aug 01 15:58:32.611025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1286/2894] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:32 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:32.808989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c671b3e6-a34d-4f84-b9a5-040a646a0037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:32.809575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c671b3e6-a34d-4f84-b9a5-040a646a0037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:32.816652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c671b3e6-a34d-4f84-b9a5-040a646a0037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:32.817129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c671b3e6-a34d-4f84-b9a5-040a646a0037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:32.817905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c671b3e6-a34d-4f84-b9a5-040a646a0037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:32.818341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c671b3e6-a34d-4f84-b9a5-040a646a0037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:32.881296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c671b3e6-a34d-4f84-b9a5-040a646a0037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:32.889355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c671b3e6-a34d-4f84-b9a5-040a646a0037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084279 Aug 01 15:58:32.890591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1609/2895] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:32 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:32.987088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0c0e1df8-cff5-4cb5-ab44-ae9c3242eec2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:32.987712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0c0e1df8-cff5-4cb5-ab44-ae9c3242eec2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:32.994336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c0e1df8-cff5-4cb5-ab44-ae9c3242eec2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:32.994790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c0e1df8-cff5-4cb5-ab44-ae9c3242eec2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:32.995560 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c0e1df8-cff5-4cb5-ab44-ae9c3242eec2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:32.996000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c0e1df8-cff5-4cb5-ab44-ae9c3242eec2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:33.134891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c0e1df8-cff5-4cb5-ab44-ae9c3242eec2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:33.143448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c0e1df8-cff5-4cb5-ab44-ae9c3242eec2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:33.144935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c0e1df8-cff5-4cb5-ab44-ae9c3242eec2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:33.146125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0c0e1df8-cff5-4cb5-ab44-ae9c3242eec2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.163521 Aug 01 15:58:33.146691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1287/2896] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:33.632717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-69d79900-ac7f-42de-9c98-6995787c9df1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:33.633343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-69d79900-ac7f-42de-9c98-6995787c9df1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:33.635273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=76 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:33.641799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-69d79900-ac7f-42de-9c98-6995787c9df1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:33.642337 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-69d79900-ac7f-42de-9c98-6995787c9df1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:33.643110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-69d79900-ac7f-42de-9c98-6995787c9df1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:33.643551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-69d79900-ac7f-42de-9c98-6995787c9df1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:33.771315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-69d79900-ac7f-42de-9c98-6995787c9df1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:33.779355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-69d79900-ac7f-42de-9c98-6995787c9df1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150607 Aug 01 15:58:33.779918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1610/2897] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:33 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:33.911763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f13414aa-dde9-4a4f-9ba8-5d38b9c12daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:33.912297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f13414aa-dde9-4a4f-9ba8-5d38b9c12daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:33.918395 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f13414aa-dde9-4a4f-9ba8-5d38b9c12daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:33.918852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f13414aa-dde9-4a4f-9ba8-5d38b9c12daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:33.919619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f13414aa-dde9-4a4f-9ba8-5d38b9c12daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:33.920063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f13414aa-dde9-4a4f-9ba8-5d38b9c12daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:33.986319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f13414aa-dde9-4a4f-9ba8-5d38b9c12daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:33.994898 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f13414aa-dde9-4a4f-9ba8-5d38b9c12daf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087187 Aug 01 15:58:33.995447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1288/2898] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:33 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:34.169043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-632b8e33-83aa-495b-adbd-1d70d2147e9d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:34.169593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-632b8e33-83aa-495b-adbd-1d70d2147e9d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:34.176514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-632b8e33-83aa-495b-adbd-1d70d2147e9d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:34.176967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-632b8e33-83aa-495b-adbd-1d70d2147e9d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:34.177877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-632b8e33-83aa-495b-adbd-1d70d2147e9d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:34.178371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-632b8e33-83aa-495b-adbd-1d70d2147e9d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:34.312121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-632b8e33-83aa-495b-adbd-1d70d2147e9d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:34.320454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-632b8e33-83aa-495b-adbd-1d70d2147e9d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:34.321977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-632b8e33-83aa-495b-adbd-1d70d2147e9d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:34.323335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-632b8e33-83aa-495b-adbd-1d70d2147e9d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.158076 Aug 01 15:58:34.323676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1611/2899] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:34.801379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-37220f32-5092-4309-92d0-c5ef3e79f511 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:34.801932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-37220f32-5092-4309-92d0-c5ef3e79f511 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:34.808037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37220f32-5092-4309-92d0-c5ef3e79f511 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:34.808495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37220f32-5092-4309-92d0-c5ef3e79f511 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:34.809255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37220f32-5092-4309-92d0-c5ef3e79f511 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:34.809698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-37220f32-5092-4309-92d0-c5ef3e79f511 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:34.939566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-37220f32-5092-4309-92d0-c5ef3e79f511 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:34.947543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-37220f32-5092-4309-92d0-c5ef3e79f511 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150152 Aug 01 15:58:34.948119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1289/2900] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:34 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:35.015989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b745f97a-2800-407a-b34f-03d8ff002123 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:35.016599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b745f97a-2800-407a-b34f-03d8ff002123 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:35.024561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b745f97a-2800-407a-b34f-03d8ff002123 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:35.025394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b745f97a-2800-407a-b34f-03d8ff002123 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:35.026202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b745f97a-2800-407a-b34f-03d8ff002123 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:35.026638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b745f97a-2800-407a-b34f-03d8ff002123 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:35.097287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b745f97a-2800-407a-b34f-03d8ff002123 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:35.105943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b745f97a-2800-407a-b34f-03d8ff002123 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.093803 Aug 01 15:58:35.106514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1612/2901] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:35 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:35.347984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-309fb3ce-64bf-46a6-8370-38bbf0fafebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:35.348534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-309fb3ce-64bf-46a6-8370-38bbf0fafebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:35.355402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-309fb3ce-64bf-46a6-8370-38bbf0fafebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:35.355859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-309fb3ce-64bf-46a6-8370-38bbf0fafebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:35.356623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-309fb3ce-64bf-46a6-8370-38bbf0fafebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:35.357062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-309fb3ce-64bf-46a6-8370-38bbf0fafebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:35.489251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-309fb3ce-64bf-46a6-8370-38bbf0fafebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:35.497627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-309fb3ce-64bf-46a6-8370-38bbf0fafebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:35.499162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-309fb3ce-64bf-46a6-8370-38bbf0fafebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:35.500326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-309fb3ce-64bf-46a6-8370-38bbf0fafebc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.157799 Aug 01 15:58:35.500883 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1290/2902] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:35.968662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-17459c92-3045-4f84-85ac-941e885f666c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:35.969315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-17459c92-3045-4f84-85ac-941e885f666c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:35.975932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-17459c92-3045-4f84-85ac-941e885f666c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:35.976634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-17459c92-3045-4f84-85ac-941e885f666c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:35.977401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-17459c92-3045-4f84-85ac-941e885f666c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:35.977841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-17459c92-3045-4f84-85ac-941e885f666c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:36.108322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-17459c92-3045-4f84-85ac-941e885f666c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:36.116731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-17459c92-3045-4f84-85ac-941e885f666c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151945 Aug 01 15:58:36.117290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1613/2903] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:35 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:36.128579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ccaa700b-ffce-4b3e-b699-f92cc23aa399 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:36.129196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ccaa700b-ffce-4b3e-b699-f92cc23aa399 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:36.135448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccaa700b-ffce-4b3e-b699-f92cc23aa399 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:36.135870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccaa700b-ffce-4b3e-b699-f92cc23aa399 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:36.136547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccaa700b-ffce-4b3e-b699-f92cc23aa399 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:36.136984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ccaa700b-ffce-4b3e-b699-f92cc23aa399 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:36.203650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ccaa700b-ffce-4b3e-b699-f92cc23aa399 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:36.207063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:36.212234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ccaa700b-ffce-4b3e-b699-f92cc23aa399 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088296 Aug 01 15:58:36.212793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1291/2904] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:36 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:36.523701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-212408e8-fcfd-4847-abd4-4e5e9eba534f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:36.524219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-212408e8-fcfd-4847-abd4-4e5e9eba534f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:36.530866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-212408e8-fcfd-4847-abd4-4e5e9eba534f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:36.531320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-212408e8-fcfd-4847-abd4-4e5e9eba534f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:36.532084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-212408e8-fcfd-4847-abd4-4e5e9eba534f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:36.532523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-212408e8-fcfd-4847-abd4-4e5e9eba534f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:36.662439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-212408e8-fcfd-4847-abd4-4e5e9eba534f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:36.670735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-212408e8-fcfd-4847-abd4-4e5e9eba534f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:36.672877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-212408e8-fcfd-4847-abd4-4e5e9eba534f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:36.674120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-212408e8-fcfd-4847-abd4-4e5e9eba534f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.154496 Aug 01 15:58:36.674678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1614/2905] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:37.138192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6d16dcc3-ac96-4488-ab60-3916bdf1a91b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:37.138843 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6d16dcc3-ac96-4488-ab60-3916bdf1a91b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:37.146187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d16dcc3-ac96-4488-ab60-3916bdf1a91b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:37.146646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d16dcc3-ac96-4488-ab60-3916bdf1a91b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:37.147449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d16dcc3-ac96-4488-ab60-3916bdf1a91b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:37.147892 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6d16dcc3-ac96-4488-ab60-3916bdf1a91b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:37.233140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ac1b824c-cc45-46ba-afa8-5c2f585df583 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:37.233739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ac1b824c-cc45-46ba-afa8-5c2f585df583 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:37.240601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac1b824c-cc45-46ba-afa8-5c2f585df583 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:37.241041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac1b824c-cc45-46ba-afa8-5c2f585df583 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:37.241800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac1b824c-cc45-46ba-afa8-5c2f585df583 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:37.242259 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ac1b824c-cc45-46ba-afa8-5c2f585df583 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:37.279051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6d16dcc3-ac96-4488-ab60-3916bdf1a91b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:37.287489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6d16dcc3-ac96-4488-ab60-3916bdf1a91b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153309 Aug 01 15:58:37.288064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1292/2906] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:37 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:37.310989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ac1b824c-cc45-46ba-afa8-5c2f585df583 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:37.319649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ac1b824c-cc45-46ba-afa8-5c2f585df583 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.090304 Aug 01 15:58:37.320211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1615/2907] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:37 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:37.697206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f302eb18-dd62-41ff-9931-f0a9d4806dc1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:37.697845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f302eb18-dd62-41ff-9931-f0a9d4806dc1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:37.704280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f302eb18-dd62-41ff-9931-f0a9d4806dc1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:37.704736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f302eb18-dd62-41ff-9931-f0a9d4806dc1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:37.705507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f302eb18-dd62-41ff-9931-f0a9d4806dc1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:37.705984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f302eb18-dd62-41ff-9931-f0a9d4806dc1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:37.843189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f302eb18-dd62-41ff-9931-f0a9d4806dc1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:37.851808 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f302eb18-dd62-41ff-9931-f0a9d4806dc1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:37.853309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f302eb18-dd62-41ff-9931-f0a9d4806dc1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:37.854518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f302eb18-dd62-41ff-9931-f0a9d4806dc1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.161206 Aug 01 15:58:37.855056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1293/2908] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:38.309777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-168d7ba2-0a70-4f5e-a680-a6b33da5b1cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:38.310346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-168d7ba2-0a70-4f5e-a680-a6b33da5b1cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:38.317411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-168d7ba2-0a70-4f5e-a680-a6b33da5b1cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:38.317852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-168d7ba2-0a70-4f5e-a680-a6b33da5b1cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:38.318643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-168d7ba2-0a70-4f5e-a680-a6b33da5b1cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:38.319075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-168d7ba2-0a70-4f5e-a680-a6b33da5b1cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:38.341087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7fe72814-31b5-412f-b437-395bcb622964 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:38.341697 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7fe72814-31b5-412f-b437-395bcb622964 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:38.348977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7fe72814-31b5-412f-b437-395bcb622964 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:38.349427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7fe72814-31b5-412f-b437-395bcb622964 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:38.350229 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7fe72814-31b5-412f-b437-395bcb622964 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:38.350669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7fe72814-31b5-412f-b437-395bcb622964 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:38.420337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7fe72814-31b5-412f-b437-395bcb622964 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:38.428462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7fe72814-31b5-412f-b437-395bcb622964 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.091193 Aug 01 15:58:38.429020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1294/2909] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:38 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:38.475734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-168d7ba2-0a70-4f5e-a680-a6b33da5b1cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:38.483927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-168d7ba2-0a70-4f5e-a680-a6b33da5b1cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.178154 Aug 01 15:58:38.484524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1616/2910] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:38 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:38.877083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d10e2c98-327f-4c3f-aa7f-f6e512e0a0fc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:38.877693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d10e2c98-327f-4c3f-aa7f-f6e512e0a0fc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:38.884130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d10e2c98-327f-4c3f-aa7f-f6e512e0a0fc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:38.884588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d10e2c98-327f-4c3f-aa7f-f6e512e0a0fc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:38.885347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d10e2c98-327f-4c3f-aa7f-f6e512e0a0fc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:38.885787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d10e2c98-327f-4c3f-aa7f-f6e512e0a0fc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:39.022179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d10e2c98-327f-4c3f-aa7f-f6e512e0a0fc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:39.031134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d10e2c98-327f-4c3f-aa7f-f6e512e0a0fc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:39.032617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d10e2c98-327f-4c3f-aa7f-f6e512e0a0fc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:39.033773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d10e2c98-327f-4c3f-aa7f-f6e512e0a0fc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.160627 Aug 01 15:58:39.034358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1295/2911] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:39.449402 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-54eb6c50-fd44-43cd-b875-fa5386eca3e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:39.450028 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-54eb6c50-fd44-43cd-b875-fa5386eca3e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:39.457965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54eb6c50-fd44-43cd-b875-fa5386eca3e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:39.458422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54eb6c50-fd44-43cd-b875-fa5386eca3e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:39.459195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54eb6c50-fd44-43cd-b875-fa5386eca3e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:39.459633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-54eb6c50-fd44-43cd-b875-fa5386eca3e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:39.463680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:39.505469 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-acb8dbca-00b7-4751-a29c-dd061a6c4585 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:39.506120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-acb8dbca-00b7-4751-a29c-dd061a6c4585 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:39.513009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acb8dbca-00b7-4751-a29c-dd061a6c4585 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:39.513464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acb8dbca-00b7-4751-a29c-dd061a6c4585 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:39.514269 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acb8dbca-00b7-4751-a29c-dd061a6c4585 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:39.515299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acb8dbca-00b7-4751-a29c-dd061a6c4585 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:39.522969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-54eb6c50-fd44-43cd-b875-fa5386eca3e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:39.531192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-54eb6c50-fd44-43cd-b875-fa5386eca3e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085711 Aug 01 15:58:39.531771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1617/2912] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:39 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:39.650290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-acb8dbca-00b7-4751-a29c-dd061a6c4585 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:39.658314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-acb8dbca-00b7-4751-a29c-dd061a6c4585 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156677 Aug 01 15:58:39.658869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1296/2913] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:39 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:40.056887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-808882b7-03e8-4659-b419-ef765c3d344f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:40.057498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-808882b7-03e8-4659-b419-ef765c3d344f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:40.064816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-808882b7-03e8-4659-b419-ef765c3d344f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:40.065262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-808882b7-03e8-4659-b419-ef765c3d344f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:40.066085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-808882b7-03e8-4659-b419-ef765c3d344f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:40.068741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-808882b7-03e8-4659-b419-ef765c3d344f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:40.194263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-808882b7-03e8-4659-b419-ef765c3d344f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:40.202678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-808882b7-03e8-4659-b419-ef765c3d344f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:40.204183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-808882b7-03e8-4659-b419-ef765c3d344f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:40.205347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-808882b7-03e8-4659-b419-ef765c3d344f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.152536 Aug 01 15:58:40.205955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1618/2914] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:40.552216 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-78f26860-e925-4f0b-9002-98f105d1a137 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:40.552829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-78f26860-e925-4f0b-9002-98f105d1a137 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:40.559531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-78f26860-e925-4f0b-9002-98f105d1a137 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:40.559979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-78f26860-e925-4f0b-9002-98f105d1a137 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:40.560740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-78f26860-e925-4f0b-9002-98f105d1a137 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:40.561187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-78f26860-e925-4f0b-9002-98f105d1a137 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:40.623064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-78f26860-e925-4f0b-9002-98f105d1a137 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:40.631104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-78f26860-e925-4f0b-9002-98f105d1a137 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082719 Aug 01 15:58:40.631696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1297/2915] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:40 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:40.679569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-860c4d57-9ceb-4e0c-9f83-8ec80f9da949 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:40.680177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-860c4d57-9ceb-4e0c-9f83-8ec80f9da949 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:40.686793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-860c4d57-9ceb-4e0c-9f83-8ec80f9da949 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:40.687243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-860c4d57-9ceb-4e0c-9f83-8ec80f9da949 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:40.688001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-860c4d57-9ceb-4e0c-9f83-8ec80f9da949 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:40.688613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-860c4d57-9ceb-4e0c-9f83-8ec80f9da949 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:40.822421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-860c4d57-9ceb-4e0c-9f83-8ec80f9da949 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:40.830908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-860c4d57-9ceb-4e0c-9f83-8ec80f9da949 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155254 Aug 01 15:58:40.831467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1619/2916] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:40 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:41.229082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-dd127659-c459-4809-a0b4-c1bdf50bafba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:41.229725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-dd127659-c459-4809-a0b4-c1bdf50bafba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:41.236344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dd127659-c459-4809-a0b4-c1bdf50bafba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:41.236797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dd127659-c459-4809-a0b4-c1bdf50bafba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:41.237561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dd127659-c459-4809-a0b4-c1bdf50bafba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:41.238035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-dd127659-c459-4809-a0b4-c1bdf50bafba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:41.366501 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dd127659-c459-4809-a0b4-c1bdf50bafba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:41.375554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dd127659-c459-4809-a0b4-c1bdf50bafba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:41.377058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-dd127659-c459-4809-a0b4-c1bdf50bafba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:41.378267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-dd127659-c459-4809-a0b4-c1bdf50bafba tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.153493 Aug 01 15:58:41.378820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1298/2917] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:41.652856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fd415ad8-1708-4cd8-89e1-243ec6444044 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:41.653464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fd415ad8-1708-4cd8-89e1-243ec6444044 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:41.660228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd415ad8-1708-4cd8-89e1-243ec6444044 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:41.660671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd415ad8-1708-4cd8-89e1-243ec6444044 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:41.661453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd415ad8-1708-4cd8-89e1-243ec6444044 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:41.661908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd415ad8-1708-4cd8-89e1-243ec6444044 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:41.727620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fd415ad8-1708-4cd8-89e1-243ec6444044 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:41.736537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fd415ad8-1708-4cd8-89e1-243ec6444044 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087496 Aug 01 15:58:41.737146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1620/2918] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:41 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:41.854595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3eced03b-cabf-4175-8574-1f381f22a947 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:41.855554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3eced03b-cabf-4175-8574-1f381f22a947 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:41.863989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3eced03b-cabf-4175-8574-1f381f22a947 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:41.864431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3eced03b-cabf-4175-8574-1f381f22a947 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:41.865191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3eced03b-cabf-4175-8574-1f381f22a947 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:41.865631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3eced03b-cabf-4175-8574-1f381f22a947 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:41.996224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3eced03b-cabf-4175-8574-1f381f22a947 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:42.005257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3eced03b-cabf-4175-8574-1f381f22a947 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155347 Aug 01 15:58:42.005840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1299/2919] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:41 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:42.401230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7eae08ff-3441-42fe-b58d-46c5584f8b28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:42.401852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7eae08ff-3441-42fe-b58d-46c5584f8b28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:42.408017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7eae08ff-3441-42fe-b58d-46c5584f8b28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:42.408464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7eae08ff-3441-42fe-b58d-46c5584f8b28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:42.409226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7eae08ff-3441-42fe-b58d-46c5584f8b28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:42.409666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7eae08ff-3441-42fe-b58d-46c5584f8b28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:42.539077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7eae08ff-3441-42fe-b58d-46c5584f8b28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:42.547516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7eae08ff-3441-42fe-b58d-46c5584f8b28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:42.549084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7eae08ff-3441-42fe-b58d-46c5584f8b28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:42.550255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7eae08ff-3441-42fe-b58d-46c5584f8b28 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.153115 Aug 01 15:58:42.550906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1621/2920] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:42 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:42.756624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-23130715-a141-4548-9af9-997cf042f5de tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:42.757274 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-23130715-a141-4548-9af9-997cf042f5de tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:42.763554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23130715-a141-4548-9af9-997cf042f5de tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:42.764005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23130715-a141-4548-9af9-997cf042f5de tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:42.764778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23130715-a141-4548-9af9-997cf042f5de tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:42.765217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-23130715-a141-4548-9af9-997cf042f5de tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:42.832544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-23130715-a141-4548-9af9-997cf042f5de tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:42.843358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-23130715-a141-4548-9af9-997cf042f5de tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.090540 Aug 01 15:58:42.843943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1300/2921] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:42 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:43.027721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-04723c36-86f9-4c32-9606-c411fcd377be tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:43.028273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-04723c36-86f9-4c32-9606-c411fcd377be tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:43.035544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-04723c36-86f9-4c32-9606-c411fcd377be tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:43.036026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-04723c36-86f9-4c32-9606-c411fcd377be tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:43.036795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-04723c36-86f9-4c32-9606-c411fcd377be tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:43.037237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-04723c36-86f9-4c32-9606-c411fcd377be tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:43.169490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-04723c36-86f9-4c32-9606-c411fcd377be tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:43.178161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-04723c36-86f9-4c32-9606-c411fcd377be tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154454 Aug 01 15:58:43.178726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1622/2922] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:43 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:43.573948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-361ec9db-99da-47df-8e6b-76ba87c57574 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:43.574576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-361ec9db-99da-47df-8e6b-76ba87c57574 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:43.576912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=84 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:43.583010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-361ec9db-99da-47df-8e6b-76ba87c57574 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:43.583465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-361ec9db-99da-47df-8e6b-76ba87c57574 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:43.584244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-361ec9db-99da-47df-8e6b-76ba87c57574 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:43.584687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-361ec9db-99da-47df-8e6b-76ba87c57574 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:43.712370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-361ec9db-99da-47df-8e6b-76ba87c57574 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:43.721745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-361ec9db-99da-47df-8e6b-76ba87c57574 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:43.723308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-361ec9db-99da-47df-8e6b-76ba87c57574 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:43.724479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-361ec9db-99da-47df-8e6b-76ba87c57574 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.154528 Aug 01 15:58:43.725040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1301/2923] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:43.864721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-58d5cbac-2f07-4363-93c2-f9dcd65d85a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:43.865343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-58d5cbac-2f07-4363-93c2-f9dcd65d85a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:43.873338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58d5cbac-2f07-4363-93c2-f9dcd65d85a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:43.873791 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58d5cbac-2f07-4363-93c2-f9dcd65d85a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:43.875097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58d5cbac-2f07-4363-93c2-f9dcd65d85a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:43.875536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58d5cbac-2f07-4363-93c2-f9dcd65d85a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:43.940111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-58d5cbac-2f07-4363-93c2-f9dcd65d85a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:43.948138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-58d5cbac-2f07-4363-93c2-f9dcd65d85a5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087290 Aug 01 15:58:43.948706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1623/2924] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:43 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:44.199602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5972a47e-65da-4af8-9369-6cfd50b5e342 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:44.200173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5972a47e-65da-4af8-9369-6cfd50b5e342 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:44.207153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5972a47e-65da-4af8-9369-6cfd50b5e342 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:44.207609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5972a47e-65da-4af8-9369-6cfd50b5e342 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:44.208371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5972a47e-65da-4af8-9369-6cfd50b5e342 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:44.208813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5972a47e-65da-4af8-9369-6cfd50b5e342 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:44.340715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5972a47e-65da-4af8-9369-6cfd50b5e342 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:44.348675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5972a47e-65da-4af8-9369-6cfd50b5e342 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153012 Aug 01 15:58:44.349236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1302/2925] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:44 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:44.747217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-157c3a3d-d0fa-46f0-80f1-8faaeb9439a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:44.747755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-157c3a3d-d0fa-46f0-80f1-8faaeb9439a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:44.755118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-157c3a3d-d0fa-46f0-80f1-8faaeb9439a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:44.755563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-157c3a3d-d0fa-46f0-80f1-8faaeb9439a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:44.756318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-157c3a3d-d0fa-46f0-80f1-8faaeb9439a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:44.756746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-157c3a3d-d0fa-46f0-80f1-8faaeb9439a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:44.886979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-157c3a3d-d0fa-46f0-80f1-8faaeb9439a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:44.895525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-157c3a3d-d0fa-46f0-80f1-8faaeb9439a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:44.897066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-157c3a3d-d0fa-46f0-80f1-8faaeb9439a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:44.898295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-157c3a3d-d0fa-46f0-80f1-8faaeb9439a0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.155006 Aug 01 15:58:44.898868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1624/2926] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:44.970641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f985b2d6-2c60-44b9-b1ad-924b1640a925 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:44.971258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f985b2d6-2c60-44b9-b1ad-924b1640a925 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:44.978111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f985b2d6-2c60-44b9-b1ad-924b1640a925 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:44.978561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f985b2d6-2c60-44b9-b1ad-924b1640a925 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:44.979318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f985b2d6-2c60-44b9-b1ad-924b1640a925 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:44.979755 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f985b2d6-2c60-44b9-b1ad-924b1640a925 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:45.044998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f985b2d6-2c60-44b9-b1ad-924b1640a925 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:45.053392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f985b2d6-2c60-44b9-b1ad-924b1640a925 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087410 Aug 01 15:58:45.054136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1303/2927] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:44 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:45.371487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3c929f6a-1d67-4a8c-b64f-2a5de43c5d3a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:45.372088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3c929f6a-1d67-4a8c-b64f-2a5de43c5d3a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:45.379355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3c929f6a-1d67-4a8c-b64f-2a5de43c5d3a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:45.379796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3c929f6a-1d67-4a8c-b64f-2a5de43c5d3a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:45.380553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3c929f6a-1d67-4a8c-b64f-2a5de43c5d3a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:45.380985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3c929f6a-1d67-4a8c-b64f-2a5de43c5d3a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:45.519069 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3c929f6a-1d67-4a8c-b64f-2a5de43c5d3a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:45.527876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3c929f6a-1d67-4a8c-b64f-2a5de43c5d3a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.160253 Aug 01 15:58:45.528684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1625/2928] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:45 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:45.922545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-163d6df4-f072-490e-b934-89e42bd25dcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:45.923286 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-163d6df4-f072-490e-b934-89e42bd25dcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:45.929758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-163d6df4-f072-490e-b934-89e42bd25dcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:45.930250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-163d6df4-f072-490e-b934-89e42bd25dcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:45.931016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-163d6df4-f072-490e-b934-89e42bd25dcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:45.931453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-163d6df4-f072-490e-b934-89e42bd25dcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:46.065783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-163d6df4-f072-490e-b934-89e42bd25dcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:46.074781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-83a05640-4515-4491-a8e7-0f30fc606866 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:46.075317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-163d6df4-f072-490e-b934-89e42bd25dcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:46.075442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-83a05640-4515-4491-a8e7-0f30fc606866 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:46.076499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-163d6df4-f072-490e-b934-89e42bd25dcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:46.077675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-163d6df4-f072-490e-b934-89e42bd25dcd tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.159628 Aug 01 15:58:46.078263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1304/2929] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:46.082047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83a05640-4515-4491-a8e7-0f30fc606866 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:46.082490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83a05640-4515-4491-a8e7-0f30fc606866 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:46.083252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83a05640-4515-4491-a8e7-0f30fc606866 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:46.083678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83a05640-4515-4491-a8e7-0f30fc606866 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:46.148737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-83a05640-4515-4491-a8e7-0f30fc606866 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:46.157472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-83a05640-4515-4491-a8e7-0f30fc606866 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086456 Aug 01 15:58:46.158255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1626/2930] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:46 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:46.551111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bf9b436f-8f90-442b-b01d-09855e7c6fe4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:46.551730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bf9b436f-8f90-442b-b01d-09855e7c6fe4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:46.558022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf9b436f-8f90-442b-b01d-09855e7c6fe4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:46.558477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf9b436f-8f90-442b-b01d-09855e7c6fe4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:46.559241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf9b436f-8f90-442b-b01d-09855e7c6fe4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:46.559686 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf9b436f-8f90-442b-b01d-09855e7c6fe4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:46.689059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bf9b436f-8f90-442b-b01d-09855e7c6fe4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:46.697351 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bf9b436f-8f90-442b-b01d-09855e7c6fe4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150284 Aug 01 15:58:46.698283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1305/2931] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:46 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:47.101105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4223761b-886e-46ac-a23b-e077b92219b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:47.102206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4223761b-886e-46ac-a23b-e077b92219b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:47.109332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4223761b-886e-46ac-a23b-e077b92219b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:47.109789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4223761b-886e-46ac-a23b-e077b92219b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:47.110698 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4223761b-886e-46ac-a23b-e077b92219b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:47.111146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4223761b-886e-46ac-a23b-e077b92219b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:47.178798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-41fba0d1-e9d4-4754-b6d9-417a75d25678 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:47.179441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-41fba0d1-e9d4-4754-b6d9-417a75d25678 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:47.186888 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41fba0d1-e9d4-4754-b6d9-417a75d25678 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:47.187342 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41fba0d1-e9d4-4754-b6d9-417a75d25678 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:47.188126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41fba0d1-e9d4-4754-b6d9-417a75d25678 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:47.188571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41fba0d1-e9d4-4754-b6d9-417a75d25678 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:47.265271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-41fba0d1-e9d4-4754-b6d9-417a75d25678 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:47.272499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4223761b-886e-46ac-a23b-e077b92219b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:47.273757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-41fba0d1-e9d4-4754-b6d9-417a75d25678 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.099042 Aug 01 15:58:47.274363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1306/2932] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:47 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:58:47.281320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4223761b-886e-46ac-a23b-e077b92219b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:47.282893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4223761b-886e-46ac-a23b-e077b92219b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:47.284007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4223761b-886e-46ac-a23b-e077b92219b8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.186853 Aug 01 15:58:47.284561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1627/2933] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:47.719497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ed12d41b-da90-4aee-8033-abe00322592d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:47.720109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ed12d41b-da90-4aee-8033-abe00322592d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:47.726196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed12d41b-da90-4aee-8033-abe00322592d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:47.726906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed12d41b-da90-4aee-8033-abe00322592d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:47.727659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed12d41b-da90-4aee-8033-abe00322592d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:47.728096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed12d41b-da90-4aee-8033-abe00322592d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:47.857410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ed12d41b-da90-4aee-8033-abe00322592d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:47.865510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ed12d41b-da90-4aee-8033-abe00322592d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.149927 Aug 01 15:58:47.866101 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1307/2934] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:47 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:48.294869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7378ff5b-ea18-42ca-834a-ddf44f7fbc33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:48.295492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7378ff5b-ea18-42ca-834a-ddf44f7fbc33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:48.302027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7378ff5b-ea18-42ca-834a-ddf44f7fbc33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:48.302472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7378ff5b-ea18-42ca-834a-ddf44f7fbc33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:48.303228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7378ff5b-ea18-42ca-834a-ddf44f7fbc33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:48.303660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7378ff5b-ea18-42ca-834a-ddf44f7fbc33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:48.309066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bf178d0b-b326-4270-84e3-ff960bc7d2c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:48.309649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bf178d0b-b326-4270-84e3-ff960bc7d2c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:48.315958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf178d0b-b326-4270-84e3-ff960bc7d2c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:48.316410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf178d0b-b326-4270-84e3-ff960bc7d2c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:48.317180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf178d0b-b326-4270-84e3-ff960bc7d2c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:48.317617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bf178d0b-b326-4270-84e3-ff960bc7d2c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:48.337097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:48.372783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7378ff5b-ea18-42ca-834a-ddf44f7fbc33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:48.381444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7378ff5b-ea18-42ca-834a-ddf44f7fbc33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.090414 Aug 01 15:58:48.382050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1628/2935] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:48 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:48.471169 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bf178d0b-b326-4270-84e3-ff960bc7d2c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:48.479771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bf178d0b-b326-4270-84e3-ff960bc7d2c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:48.481252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bf178d0b-b326-4270-84e3-ff960bc7d2c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:48.482457 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bf178d0b-b326-4270-84e3-ff960bc7d2c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.179284 Aug 01 15:58:48.483217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1308/2936] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:58:48.886916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-09f514fc-6666-4f84-9ace-6b774293a81d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:48.887565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-09f514fc-6666-4f84-9ace-6b774293a81d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:48.894135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09f514fc-6666-4f84-9ace-6b774293a81d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:48.894583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09f514fc-6666-4f84-9ace-6b774293a81d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:48.895339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09f514fc-6666-4f84-9ace-6b774293a81d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:48.895772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09f514fc-6666-4f84-9ace-6b774293a81d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:49.023387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-09f514fc-6666-4f84-9ace-6b774293a81d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:49.032269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-09f514fc-6666-4f84-9ace-6b774293a81d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.149155 Aug 01 15:58:49.032872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1629/2937] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:48 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:49.403172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-283e8f5a-690c-46f7-9012-4e252546b8dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:49.403780 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-283e8f5a-690c-46f7-9012-4e252546b8dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:49.410899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-283e8f5a-690c-46f7-9012-4e252546b8dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:49.411356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-283e8f5a-690c-46f7-9012-4e252546b8dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:49.412129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-283e8f5a-690c-46f7-9012-4e252546b8dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:49.412569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-283e8f5a-690c-46f7-9012-4e252546b8dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:49.474072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-283e8f5a-690c-46f7-9012-4e252546b8dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:49.482358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-283e8f5a-690c-46f7-9012-4e252546b8dd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083004 Aug 01 15:58:49.482923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1309/2938] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:49 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:49.507251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-77182e51-805a-4113-adb4-92d6f153df7c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:49.507865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-77182e51-805a-4113-adb4-92d6f153df7c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:49.514220 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77182e51-805a-4113-adb4-92d6f153df7c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:49.514677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77182e51-805a-4113-adb4-92d6f153df7c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:49.515442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77182e51-805a-4113-adb4-92d6f153df7c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:49.515884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-77182e51-805a-4113-adb4-92d6f153df7c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:49.647503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-77182e51-805a-4113-adb4-92d6f153df7c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:49.656118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-77182e51-805a-4113-adb4-92d6f153df7c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:49.657564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-77182e51-805a-4113-adb4-92d6f153df7c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:49.658764 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-77182e51-805a-4113-adb4-92d6f153df7c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.155570 Aug 01 15:58:49.659328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1630/2939] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:50.054315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-918edc5e-6f3b-4645-bfcd-ec8b532131c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:50.054507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-918edc5e-6f3b-4645-bfcd-ec8b532131c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:50.060611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-918edc5e-6f3b-4645-bfcd-ec8b532131c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:50.061068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-918edc5e-6f3b-4645-bfcd-ec8b532131c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:50.061970 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-918edc5e-6f3b-4645-bfcd-ec8b532131c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:50.062528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-918edc5e-6f3b-4645-bfcd-ec8b532131c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:50.194981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-918edc5e-6f3b-4645-bfcd-ec8b532131c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:50.203885 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-918edc5e-6f3b-4645-bfcd-ec8b532131c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153805 Aug 01 15:58:50.204465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1310/2940] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:50 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:50.505250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-73881f43-0e94-4db2-854d-637fdba0bed6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:50.505866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-73881f43-0e94-4db2-854d-637fdba0bed6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:50.512642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73881f43-0e94-4db2-854d-637fdba0bed6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:50.513227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73881f43-0e94-4db2-854d-637fdba0bed6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:50.513849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73881f43-0e94-4db2-854d-637fdba0bed6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:50.514317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73881f43-0e94-4db2-854d-637fdba0bed6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:50.580150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-73881f43-0e94-4db2-854d-637fdba0bed6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:50.589729 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-73881f43-0e94-4db2-854d-637fdba0bed6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088302 Aug 01 15:58:50.591112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1631/2941] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:50 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:50.682166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2d44589a-dba6-49be-a464-eb9029b743e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:50.682777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2d44589a-dba6-49be-a464-eb9029b743e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:50.689339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2d44589a-dba6-49be-a464-eb9029b743e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:50.689788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2d44589a-dba6-49be-a464-eb9029b743e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:50.690608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2d44589a-dba6-49be-a464-eb9029b743e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:50.691046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2d44589a-dba6-49be-a464-eb9029b743e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:50.823806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2d44589a-dba6-49be-a464-eb9029b743e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:50.832816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2d44589a-dba6-49be-a464-eb9029b743e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:50.834341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2d44589a-dba6-49be-a464-eb9029b743e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:50.835493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2d44589a-dba6-49be-a464-eb9029b743e0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.157282 Aug 01 15:58:50.836041 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1311/2942] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:51.226098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-60398510-c9c1-4e84-a413-ff9fbd60083a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:51.227225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-60398510-c9c1-4e84-a413-ff9fbd60083a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:51.233735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60398510-c9c1-4e84-a413-ff9fbd60083a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:51.234202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60398510-c9c1-4e84-a413-ff9fbd60083a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:51.234954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60398510-c9c1-4e84-a413-ff9fbd60083a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:51.235384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-60398510-c9c1-4e84-a413-ff9fbd60083a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:51.363748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-60398510-c9c1-4e84-a413-ff9fbd60083a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:51.371638 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-60398510-c9c1-4e84-a413-ff9fbd60083a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.149472 Aug 01 15:58:51.372214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1632/2943] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:51 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:51.612316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-597efc00-67a5-4e95-8eb8-b5a15ad8abaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:51.612845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-597efc00-67a5-4e95-8eb8-b5a15ad8abaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:51.619155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-597efc00-67a5-4e95-8eb8-b5a15ad8abaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:51.619609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-597efc00-67a5-4e95-8eb8-b5a15ad8abaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:51.620373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-597efc00-67a5-4e95-8eb8-b5a15ad8abaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:51.620814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-597efc00-67a5-4e95-8eb8-b5a15ad8abaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:51.683650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-597efc00-67a5-4e95-8eb8-b5a15ad8abaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:51.693069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-597efc00-67a5-4e95-8eb8-b5a15ad8abaf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085297 Aug 01 15:58:51.693642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1312/2944] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:51 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:51.857826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6d75e700-56cd-42bb-b906-1be98d17da7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:51.858542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6d75e700-56cd-42bb-b906-1be98d17da7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:51.865313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6d75e700-56cd-42bb-b906-1be98d17da7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:51.865763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6d75e700-56cd-42bb-b906-1be98d17da7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:51.866553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6d75e700-56cd-42bb-b906-1be98d17da7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:51.866989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6d75e700-56cd-42bb-b906-1be98d17da7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:52.005033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6d75e700-56cd-42bb-b906-1be98d17da7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:52.008484 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:58:52.014798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6d75e700-56cd-42bb-b906-1be98d17da7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:52.016310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6d75e700-56cd-42bb-b906-1be98d17da7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:52.017478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6d75e700-56cd-42bb-b906-1be98d17da7f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.163580 Aug 01 15:58:52.018072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1633/2945] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:52.393191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-014c33ea-006d-4d07-a0d1-a7adc0b54c74 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:52.393805 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-014c33ea-006d-4d07-a0d1-a7adc0b54c74 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:52.400088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-014c33ea-006d-4d07-a0d1-a7adc0b54c74 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:52.400539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-014c33ea-006d-4d07-a0d1-a7adc0b54c74 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:52.401301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-014c33ea-006d-4d07-a0d1-a7adc0b54c74 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:52.401736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-014c33ea-006d-4d07-a0d1-a7adc0b54c74 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:52.534496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-014c33ea-006d-4d07-a0d1-a7adc0b54c74 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:52.542534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-014c33ea-006d-4d07-a0d1-a7adc0b54c74 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153837 Aug 01 15:58:52.543093 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1313/2946] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:52 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:52.715198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f7537093-9419-42d2-8140-cbc80a1dbc9e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:52.715735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f7537093-9419-42d2-8140-cbc80a1dbc9e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:52.721856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7537093-9419-42d2-8140-cbc80a1dbc9e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:52.722339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7537093-9419-42d2-8140-cbc80a1dbc9e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:52.723215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7537093-9419-42d2-8140-cbc80a1dbc9e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:52.723661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7537093-9419-42d2-8140-cbc80a1dbc9e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:52.788474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f7537093-9419-42d2-8140-cbc80a1dbc9e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:52.796938 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f7537093-9419-42d2-8140-cbc80a1dbc9e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085892 Aug 01 15:58:52.797497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1634/2947] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:52 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:53.040876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-de4c21b1-2018-4fbf-959e-defc2d10606e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:53.041426 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-de4c21b1-2018-4fbf-959e-defc2d10606e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:53.048561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-de4c21b1-2018-4fbf-959e-defc2d10606e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:53.049009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-de4c21b1-2018-4fbf-959e-defc2d10606e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:53.049779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-de4c21b1-2018-4fbf-959e-defc2d10606e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:53.050245 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-de4c21b1-2018-4fbf-959e-defc2d10606e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:53.179945 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-de4c21b1-2018-4fbf-959e-defc2d10606e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:53.188319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-de4c21b1-2018-4fbf-959e-defc2d10606e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:53.189804 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-de4c21b1-2018-4fbf-959e-defc2d10606e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:53.190986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-de4c21b1-2018-4fbf-959e-defc2d10606e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.154101 Aug 01 15:58:53.191543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1314/2948] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:58:53.564355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-724669fd-3093-4234-876a-abd3dea2cd4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:53.565036 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-724669fd-3093-4234-876a-abd3dea2cd4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:53.571465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-724669fd-3093-4234-876a-abd3dea2cd4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:53.571913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-724669fd-3093-4234-876a-abd3dea2cd4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:53.572670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-724669fd-3093-4234-876a-abd3dea2cd4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:53.573105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-724669fd-3093-4234-876a-abd3dea2cd4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:53.703753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-724669fd-3093-4234-876a-abd3dea2cd4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:53.711726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-724669fd-3093-4234-876a-abd3dea2cd4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151270 Aug 01 15:58:53.712295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1635/2949] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:53 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:53.818372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a9defcd3-8ab4-43b7-beef-1dbdf7c3443f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:53.818909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a9defcd3-8ab4-43b7-beef-1dbdf7c3443f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:53.825236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9defcd3-8ab4-43b7-beef-1dbdf7c3443f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:53.825694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9defcd3-8ab4-43b7-beef-1dbdf7c3443f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:53.826498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9defcd3-8ab4-43b7-beef-1dbdf7c3443f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:53.827657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a9defcd3-8ab4-43b7-beef-1dbdf7c3443f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:53.893144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a9defcd3-8ab4-43b7-beef-1dbdf7c3443f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:53.901296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a9defcd3-8ab4-43b7-beef-1dbdf7c3443f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086846 Aug 01 15:58:53.901879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1315/2950] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:53 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:54.215013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-efba74b0-d0d2-46f4-bec7-0344464d0360 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:54.215616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-efba74b0-d0d2-46f4-bec7-0344464d0360 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:54.221623 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efba74b0-d0d2-46f4-bec7-0344464d0360 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:54.222190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efba74b0-d0d2-46f4-bec7-0344464d0360 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:54.222882 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efba74b0-d0d2-46f4-bec7-0344464d0360 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:54.223313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efba74b0-d0d2-46f4-bec7-0344464d0360 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:54.353313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-efba74b0-d0d2-46f4-bec7-0344464d0360 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:54.362796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-efba74b0-d0d2-46f4-bec7-0344464d0360 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:54.364032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-efba74b0-d0d2-46f4-bec7-0344464d0360 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:54.365256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-efba74b0-d0d2-46f4-bec7-0344464d0360 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.154152 Aug 01 15:58:54.365827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1636/2951] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:54.734003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f55e8d8e-1d41-4974-95a9-87996bf291a9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:54.734614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f55e8d8e-1d41-4974-95a9-87996bf291a9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:54.741143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f55e8d8e-1d41-4974-95a9-87996bf291a9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:54.741595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f55e8d8e-1d41-4974-95a9-87996bf291a9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:54.742379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f55e8d8e-1d41-4974-95a9-87996bf291a9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:54.742813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f55e8d8e-1d41-4974-95a9-87996bf291a9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:54.873526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f55e8d8e-1d41-4974-95a9-87996bf291a9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:54.881864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f55e8d8e-1d41-4974-95a9-87996bf291a9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151880 Aug 01 15:58:54.882454 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1316/2952] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:54 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:54.922008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1e79d926-ec20-46aa-a4a0-68d819cc4479 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:54.922793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1e79d926-ec20-46aa-a4a0-68d819cc4479 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:54.929112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e79d926-ec20-46aa-a4a0-68d819cc4479 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:54.929579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e79d926-ec20-46aa-a4a0-68d819cc4479 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:54.930625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e79d926-ec20-46aa-a4a0-68d819cc4479 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:54.931076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e79d926-ec20-46aa-a4a0-68d819cc4479 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:54.997017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1e79d926-ec20-46aa-a4a0-68d819cc4479 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:55.005140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1e79d926-ec20-46aa-a4a0-68d819cc4479 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087207 Aug 01 15:58:55.005697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1637/2953] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:54 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:55.388143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-39cb49da-bf60-420e-b265-f3361ff35f69 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:55.388760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-39cb49da-bf60-420e-b265-f3361ff35f69 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:55.394969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39cb49da-bf60-420e-b265-f3361ff35f69 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:55.395425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39cb49da-bf60-420e-b265-f3361ff35f69 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:55.396190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39cb49da-bf60-420e-b265-f3361ff35f69 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:55.396635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-39cb49da-bf60-420e-b265-f3361ff35f69 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:55.525116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-39cb49da-bf60-420e-b265-f3361ff35f69 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:55.534487 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-39cb49da-bf60-420e-b265-f3361ff35f69 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:55.535999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-39cb49da-bf60-420e-b265-f3361ff35f69 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:55.537171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-39cb49da-bf60-420e-b265-f3361ff35f69 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.153004 Aug 01 15:58:55.537729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1317/2954] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:55.904433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ef4cd431-5da3-43c0-84ef-7d6f3f72a2b4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:55.905072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ef4cd431-5da3-43c0-84ef-7d6f3f72a2b4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:55.911905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef4cd431-5da3-43c0-84ef-7d6f3f72a2b4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:55.912357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef4cd431-5da3-43c0-84ef-7d6f3f72a2b4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:55.913162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef4cd431-5da3-43c0-84ef-7d6f3f72a2b4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:55.913597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef4cd431-5da3-43c0-84ef-7d6f3f72a2b4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:56.026493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5aa3cdbf-2a85-4344-8d7d-75754c9579e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:56.027256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5aa3cdbf-2a85-4344-8d7d-75754c9579e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:56.033659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5aa3cdbf-2a85-4344-8d7d-75754c9579e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:56.034136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5aa3cdbf-2a85-4344-8d7d-75754c9579e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:56.034902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5aa3cdbf-2a85-4344-8d7d-75754c9579e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:56.035335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5aa3cdbf-2a85-4344-8d7d-75754c9579e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:56.046986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ef4cd431-5da3-43c0-84ef-7d6f3f72a2b4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:56.055506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ef4cd431-5da3-43c0-84ef-7d6f3f72a2b4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154859 Aug 01 15:58:56.056098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1638/2955] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:55 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:56.101047 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5aa3cdbf-2a85-4344-8d7d-75754c9579e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:56.109307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5aa3cdbf-2a85-4344-8d7d-75754c9579e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086716 Aug 01 15:58:56.109875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1318/2956] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:56 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:56.560039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-58e25ecd-585a-4ca9-9160-e53a7b2f0983 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:56.560687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-58e25ecd-585a-4ca9-9160-e53a7b2f0983 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:56.567576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58e25ecd-585a-4ca9-9160-e53a7b2f0983 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:56.568027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58e25ecd-585a-4ca9-9160-e53a7b2f0983 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:56.568797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58e25ecd-585a-4ca9-9160-e53a7b2f0983 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:56.569236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58e25ecd-585a-4ca9-9160-e53a7b2f0983 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:56.699059 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-58e25ecd-585a-4ca9-9160-e53a7b2f0983 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:56.707433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-58e25ecd-585a-4ca9-9160-e53a7b2f0983 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:56.708974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-58e25ecd-585a-4ca9-9160-e53a7b2f0983 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:56.710159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-58e25ecd-585a-4ca9-9160-e53a7b2f0983 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.154133 Aug 01 15:58:56.710726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1639/2957] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:57.077956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7de4e4fa-4510-4793-94ee-7e741d20b576 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:57.078580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7de4e4fa-4510-4793-94ee-7e741d20b576 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:57.085495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7de4e4fa-4510-4793-94ee-7e741d20b576 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:57.085973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7de4e4fa-4510-4793-94ee-7e741d20b576 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:57.086749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7de4e4fa-4510-4793-94ee-7e741d20b576 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:57.087191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7de4e4fa-4510-4793-94ee-7e741d20b576 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:57.133369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7c33529f-9c2f-49f6-9f82-3bc477d0f03c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:57.133999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7c33529f-9c2f-49f6-9f82-3bc477d0f03c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:57.142553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c33529f-9c2f-49f6-9f82-3bc477d0f03c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:57.143089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c33529f-9c2f-49f6-9f82-3bc477d0f03c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:57.143939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c33529f-9c2f-49f6-9f82-3bc477d0f03c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:57.144445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c33529f-9c2f-49f6-9f82-3bc477d0f03c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:57.222565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7c33529f-9c2f-49f6-9f82-3bc477d0f03c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:57.231124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7c33529f-9c2f-49f6-9f82-3bc477d0f03c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.101587 Aug 01 15:58:57.231974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1640/2958] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:57 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:57.252617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7de4e4fa-4510-4793-94ee-7e741d20b576 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:57.260851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7de4e4fa-4510-4793-94ee-7e741d20b576 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.187679 Aug 01 15:58:57.261445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1319/2959] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:57 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:57.734229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2ccef4e2-b277-4523-b51d-d63a84b5effb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:57.734846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2ccef4e2-b277-4523-b51d-d63a84b5effb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:57.740918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ccef4e2-b277-4523-b51d-d63a84b5effb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:57.741374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ccef4e2-b277-4523-b51d-d63a84b5effb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:57.742168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ccef4e2-b277-4523-b51d-d63a84b5effb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:57.742610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ccef4e2-b277-4523-b51d-d63a84b5effb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:57.876118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2ccef4e2-b277-4523-b51d-d63a84b5effb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:57.885012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2ccef4e2-b277-4523-b51d-d63a84b5effb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:57.886550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2ccef4e2-b277-4523-b51d-d63a84b5effb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:57.887722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2ccef4e2-b277-4523-b51d-d63a84b5effb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.157889 Aug 01 15:58:57.888292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1641/2960] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:58:58.252730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c83448b5-f305-4257-8206-c38a9d4b1864 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:58.253344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c83448b5-f305-4257-8206-c38a9d4b1864 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:58.260040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c83448b5-f305-4257-8206-c38a9d4b1864 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:58.260492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c83448b5-f305-4257-8206-c38a9d4b1864 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:58.261267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c83448b5-f305-4257-8206-c38a9d4b1864 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:58.261707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c83448b5-f305-4257-8206-c38a9d4b1864 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:58.284585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ddcc3821-31dc-4045-a265-e13a76b57c10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:58.285234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ddcc3821-31dc-4045-a265-e13a76b57c10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:58.296178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ddcc3821-31dc-4045-a265-e13a76b57c10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:58.296901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ddcc3821-31dc-4045-a265-e13a76b57c10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:58.298299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ddcc3821-31dc-4045-a265-e13a76b57c10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:58.299443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ddcc3821-31dc-4045-a265-e13a76b57c10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:58.405351 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c83448b5-f305-4257-8206-c38a9d4b1864 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:58.413393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c83448b5-f305-4257-8206-c38a9d4b1864 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.164621 Aug 01 15:58:58.413984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1320/2961] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:58 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:58.464280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ddcc3821-31dc-4045-a265-e13a76b57c10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:58.472842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ddcc3821-31dc-4045-a265-e13a76b57c10 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.193523 Aug 01 15:58:58.473405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1642/2962] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:58 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:58.911470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-87e85cd6-3d32-4d9b-8e80-94356f537f5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:58.912088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-87e85cd6-3d32-4d9b-8e80-94356f537f5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:58.918358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87e85cd6-3d32-4d9b-8e80-94356f537f5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:58.918809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87e85cd6-3d32-4d9b-8e80-94356f537f5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:58.919582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87e85cd6-3d32-4d9b-8e80-94356f537f5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:58.920021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87e85cd6-3d32-4d9b-8e80-94356f537f5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:59.055860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-87e85cd6-3d32-4d9b-8e80-94356f537f5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:59.065472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-87e85cd6-3d32-4d9b-8e80-94356f537f5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:59.066993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-87e85cd6-3d32-4d9b-8e80-94356f537f5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:59.068168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-87e85cd6-3d32-4d9b-8e80-94356f537f5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.160798 Aug 01 15:58:59.068769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1321/2963] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:58:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:58:59.435415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2cbdfa5e-c3ca-4b00-975c-f9f1927f6314 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:59.436014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2cbdfa5e-c3ca-4b00-975c-f9f1927f6314 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:59.443411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2cbdfa5e-c3ca-4b00-975c-f9f1927f6314 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:59.443862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2cbdfa5e-c3ca-4b00-975c-f9f1927f6314 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:59.444625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2cbdfa5e-c3ca-4b00-975c-f9f1927f6314 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:59.445061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2cbdfa5e-c3ca-4b00-975c-f9f1927f6314 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:59.495140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f63a5029-e082-45d5-b90a-7f5674123efd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:58:59.495815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f63a5029-e082-45d5-b90a-7f5674123efd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:58:59.502662 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f63a5029-e082-45d5-b90a-7f5674123efd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:59.503114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f63a5029-e082-45d5-b90a-7f5674123efd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:59.503883 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f63a5029-e082-45d5-b90a-7f5674123efd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:58:59.504320 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f63a5029-e082-45d5-b90a-7f5674123efd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:58:59.586265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2cbdfa5e-c3ca-4b00-975c-f9f1927f6314 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:59.594879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2cbdfa5e-c3ca-4b00-975c-f9f1927f6314 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.163267 Aug 01 15:58:59.595458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1643/2964] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:59 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:58:59.664521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f63a5029-e082-45d5-b90a-7f5674123efd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:58:59.674208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f63a5029-e082-45d5-b90a-7f5674123efd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.182787 Aug 01 15:58:59.674790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1322/2965] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:58:59 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:00.091605 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f8a688ac-872d-4c52-97bf-6506fa110ab3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:00.092248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f8a688ac-872d-4c52-97bf-6506fa110ab3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:00.098457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f8a688ac-872d-4c52-97bf-6506fa110ab3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:00.098922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f8a688ac-872d-4c52-97bf-6506fa110ab3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:00.099673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f8a688ac-872d-4c52-97bf-6506fa110ab3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:00.100115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f8a688ac-872d-4c52-97bf-6506fa110ab3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:00.229749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f8a688ac-872d-4c52-97bf-6506fa110ab3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:00.240392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f8a688ac-872d-4c52-97bf-6506fa110ab3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:00.242462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f8a688ac-872d-4c52-97bf-6506fa110ab3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:00.244057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f8a688ac-872d-4c52-97bf-6506fa110ab3 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.156344 Aug 01 15:59:00.244626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1644/2966] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:59:00.618422 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b1243056-bc39-4871-8716-550a4900a013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:00.619046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b1243056-bc39-4871-8716-550a4900a013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:00.626302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1243056-bc39-4871-8716-550a4900a013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:00.626778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1243056-bc39-4871-8716-550a4900a013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:00.628113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1243056-bc39-4871-8716-550a4900a013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:00.628761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b1243056-bc39-4871-8716-550a4900a013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:00.692391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b1243056-bc39-4871-8716-550a4900a013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:00.695458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0a69029b-7855-4423-a76d-28b87b3c5433 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:00.696081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0a69029b-7855-4423-a76d-28b87b3c5433 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:00.701431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b1243056-bc39-4871-8716-550a4900a013 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087234 Aug 01 15:59:00.703933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1323/2967] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:00 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:00.704101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a69029b-7855-4423-a76d-28b87b3c5433 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:00.704101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a69029b-7855-4423-a76d-28b87b3c5433 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:00.704506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a69029b-7855-4423-a76d-28b87b3c5433 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:00.704944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a69029b-7855-4423-a76d-28b87b3c5433 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:00.845527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0a69029b-7855-4423-a76d-28b87b3c5433 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:00.853949 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0a69029b-7855-4423-a76d-28b87b3c5433 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.162406 Aug 01 15:59:00.854516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1645/2968] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:00 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:01.267601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4a09e558-2c3c-4e24-b5bc-5834be94b9ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:01.268199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4a09e558-2c3c-4e24-b5bc-5834be94b9ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:01.274661 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a09e558-2c3c-4e24-b5bc-5834be94b9ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:01.275141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a09e558-2c3c-4e24-b5bc-5834be94b9ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:01.275903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a09e558-2c3c-4e24-b5bc-5834be94b9ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:01.276343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a09e558-2c3c-4e24-b5bc-5834be94b9ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:01.413396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4a09e558-2c3c-4e24-b5bc-5834be94b9ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:01.422779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4a09e558-2c3c-4e24-b5bc-5834be94b9ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:01.424311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4a09e558-2c3c-4e24-b5bc-5834be94b9ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:01.425506 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4a09e558-2c3c-4e24-b5bc-5834be94b9ad tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1802 microversion: 2.20 time: 0.161994 Aug 01 15:59:01.426086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1324/2969] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:59:01.448138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-00fb38df-2b7e-4e6a-8a41-07500dc80e97 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '.version_select at 0x7feb1618c430>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:01.467926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-00fb38df-2b7e-4e6a-8a41-07500dc80e97 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926280563" status: 204 len: 0 microversion: 2.20 time: 0.023585 Aug 01 15:59:01.469092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1646/2970] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 1 15:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926280563 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 15:59:01.723933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3d858ae8-e155-4040-addc-36f4bd02b0ec tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:01.724558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3d858ae8-e155-4040-addc-36f4bd02b0ec tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:01.731645 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d858ae8-e155-4040-addc-36f4bd02b0ec tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:01.732106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d858ae8-e155-4040-addc-36f4bd02b0ec tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:01.732882 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d858ae8-e155-4040-addc-36f4bd02b0ec tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:01.733329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d858ae8-e155-4040-addc-36f4bd02b0ec tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:01.737421 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:01.829506 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3d858ae8-e155-4040-addc-36f4bd02b0ec tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:01.838033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3d858ae8-e155-4040-addc-36f4bd02b0ec tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.118001 Aug 01 15:59:01.838613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1325/2971] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:01 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:01.876986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-87672e4c-40fc-4f9c-b347-a9ec317210c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:01.877921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-87672e4c-40fc-4f9c-b347-a9ec317210c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:01.883714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87672e4c-40fc-4f9c-b347-a9ec317210c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:01.884448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87672e4c-40fc-4f9c-b347-a9ec317210c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:01.885309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87672e4c-40fc-4f9c-b347-a9ec317210c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:01.885788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-87672e4c-40fc-4f9c-b347-a9ec317210c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:02.126388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-87672e4c-40fc-4f9c-b347-a9ec317210c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:02.135010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-87672e4c-40fc-4f9c-b347-a9ec317210c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.263284 Aug 01 15:59:02.135683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1647/2972] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:01 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:02.764453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-fa04e79d-65d6-4f76-a334-49419e1186dd req-3738ecfa-c462-4e34-b939-36b2a98ccd9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df", "tag": "ce819b69-03c1-4584-9ef2-0228b13d3351"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:59:02.776219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-fa04e79d-65d6-4f76-a334-49419e1186dd req-3738ecfa-c462-4e34-b939-36b2a98ccd9c service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:02.777073 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-fa04e79d-65d6-4f76-a334-49419e1186dd req-3738ecfa-c462-4e34-b939-36b2a98ccd9c service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:02.789798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-fa04e79d-65d6-4f76-a334-49419e1186dd req-3738ecfa-c462-4e34-b939-36b2a98ccd9c service nova] Creating event network-changed:ce819b69-03c1-4584-9ef2-0228b13d3351 for instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df on hv-cinder-84753 Aug 01 15:59:02.795192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-fa04e79d-65d6-4f76-a334-49419e1186dd req-3738ecfa-c462-4e34-b939-36b2a98ccd9c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034283 Aug 01 15:59:02.797419 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1326/2973] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:59:02.860500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-06081423-1e83-41d8-b7f3-c9dc5e823e18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:02.863545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-06081423-1e83-41d8-b7f3-c9dc5e823e18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:02.872939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06081423-1e83-41d8-b7f3-c9dc5e823e18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:02.873633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06081423-1e83-41d8-b7f3-c9dc5e823e18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:02.874905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06081423-1e83-41d8-b7f3-c9dc5e823e18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:02.875591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06081423-1e83-41d8-b7f3-c9dc5e823e18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:02.958704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8303f42d-55ed-47e5-982d-5964f56d6577 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Action: 'create', calling method: .version_select at 0x7feb16198790>, body: {"keypair": {"name": "tempest-keypair-754315665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVN7MoaLMSF3QNQfIS/FNsx3TpgQvXD/8HoEum8MqilUyU91xqU5r2KzszxS/z2Ri8cDNuDSG4dUCYaNjZXOlkjlGZclZ5yhEHi6vPSYoC9K9Gd6rvOg6xAPoEG2YXMiA=="}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:59:02.973875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-06081423-1e83-41d8-b7f3-c9dc5e823e18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:02.975130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-8303f42d-55ed-47e5-982d-5964f56d6577 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Getting quotas for project e829698141514a009e2e769854fe66f0. Resources: {'key_pairs'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:59:02.980582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-8303f42d-55ed-47e5-982d-5964f56d6577 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Getting quotas for user 7d1b6c388c7642a892c905d16f3b8d50 and project e829698141514a009e2e769854fe66f0. Resources: {'key_pairs'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:59:02.984832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-06081423-1e83-41d8-b7f3-c9dc5e823e18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.129916 Aug 01 15:59:02.995254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1648/2974] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:02 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:03.007443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8303f42d-55ed-47e5-982d-5964f56d6577 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.053147 Aug 01 15:59:03.008523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1327/2975] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 1 15:59:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 15:59:03.157546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bc34c9c3-e7ae-4d75-866b-473e6d87e11d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:03.158194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bc34c9c3-e7ae-4d75-866b-473e6d87e11d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:03.167775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc34c9c3-e7ae-4d75-866b-473e6d87e11d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:03.168544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc34c9c3-e7ae-4d75-866b-473e6d87e11d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:03.169396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc34c9c3-e7ae-4d75-866b-473e6d87e11d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:03.169862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc34c9c3-e7ae-4d75-866b-473e6d87e11d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:03.333194 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bc34c9c3-e7ae-4d75-866b-473e6d87e11d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:03.346032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bc34c9c3-e7ae-4d75-866b-473e6d87e11d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.192937 Aug 01 15:59:03.346737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1649/2976] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:03 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:04.007238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-49642396-d604-4dbe-84fa-646cad86660a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:04.008006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-49642396-d604-4dbe-84fa-646cad86660a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:04.015914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49642396-d604-4dbe-84fa-646cad86660a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:04.016525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49642396-d604-4dbe-84fa-646cad86660a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:04.017385 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49642396-d604-4dbe-84fa-646cad86660a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:04.018516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49642396-d604-4dbe-84fa-646cad86660a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:04.091366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-49642396-d604-4dbe-84fa-646cad86660a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:04.100115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-49642396-d604-4dbe-84fa-646cad86660a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.096671 Aug 01 15:59:04.100714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1328/2977] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:04 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:04.368803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-150a771e-365b-43ce-94bc-805cfc8caf4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:04.369451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-150a771e-365b-43ce-94bc-805cfc8caf4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:04.371856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:04.379077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-150a771e-365b-43ce-94bc-805cfc8caf4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:04.379700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-150a771e-365b-43ce-94bc-805cfc8caf4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:04.380488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-150a771e-365b-43ce-94bc-805cfc8caf4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:04.380931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-150a771e-365b-43ce-94bc-805cfc8caf4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:04.525194 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-553324888", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51905392-82b2-4ec8-99b5-dedbdeb4aa80"}], "security_groups": [{"name": "tempest-securitygroup--1191828773"}], "key_name": "tempest-keypair-754315665", "user_data": "}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:59:04.533436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-150a771e-365b-43ce-94bc-805cfc8caf4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:04.541602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-150a771e-365b-43ce-94bc-805cfc8caf4e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.176762 Aug 01 15:59:04.542305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1650/2978] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:04 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:04.633929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.network.neutron [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] validate_networks() for [('51905392-82b2-4ec8-99b5-dedbdeb4aa80', None, None, None, None, None)] {{(pid=124527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:59:05.066900 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Flavor limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:59:05.067477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Image limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:59:05.067973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Flavor pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:59:05.068530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Image pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:59:05.069046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:59:05.078191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:05.078644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:05.079448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:05.079891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:05.097325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Getting quotas for project e829698141514a009e2e769854fe66f0. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:59:05.101316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Getting quotas for user 7d1b6c388c7642a892c905d16f3b8d50 and project e829698141514a009e2e769854fe66f0. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:59:05.113689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Going to run 1 instances... {{(pid=124527) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:59:05.116006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:59:05.123530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9222bdda-e58f-47d4-8bfa-a689abcc77b8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:05.124170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9222bdda-e58f-47d4-8bfa-a689abcc77b8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:05.130335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9222bdda-e58f-47d4-8bfa-a689abcc77b8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:05.130780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9222bdda-e58f-47d4-8bfa-a689abcc77b8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:05.131535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9222bdda-e58f-47d4-8bfa-a689abcc77b8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:05.131964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9222bdda-e58f-47d4-8bfa-a689abcc77b8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:05.150410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:05.161708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [328dc140-bea4-4b62-ba29-c225a0e78a34] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 15:59:05.194884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9222bdda-e58f-47d4-8bfa-a689abcc77b8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:05.203595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9222bdda-e58f-47d4-8bfa-a689abcc77b8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083339 Aug 01 15:59:05.204145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1651/2979] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:05 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:05.564272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-310ca806-c4d8-4093-9799-7a061c6564c0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:05.564984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-310ca806-c4d8-4093-9799-7a061c6564c0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:05.572072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-310ca806-c4d8-4093-9799-7a061c6564c0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:05.572518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-310ca806-c4d8-4093-9799-7a061c6564c0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:05.573296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-310ca806-c4d8-4093-9799-7a061c6564c0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:05.573728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-310ca806-c4d8-4093-9799-7a061c6564c0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:05.711166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-310ca806-c4d8-4093-9799-7a061c6564c0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:05.719320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-310ca806-c4d8-4093-9799-7a061c6564c0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159748 Aug 01 15:59:05.719895 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1652/2980] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:05 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:06.175765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [328dc140-bea4-4b62-ba29-c225a0e78a34] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 34270. Aug 01 15:59:06.186256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ca90e5b8-dd81-4acd-a4b3-9c956de17d32 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.665231 Aug 01 15:59:06.186967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1329/2981] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 1 15:59:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 15:59:06.198432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-075cdbbc-2a1c-43c2-9583-bcc2853f12fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:06.199051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-075cdbbc-2a1c-43c2-9583-bcc2853f12fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:06.223956 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e086b690-a7bc-4600-9c08-9f8b7e016de8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:06.224777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e086b690-a7bc-4600-9c08-9f8b7e016de8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:06.231567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e086b690-a7bc-4600-9c08-9f8b7e016de8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:06.232109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e086b690-a7bc-4600-9c08-9f8b7e016de8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:06.232950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e086b690-a7bc-4600-9c08-9f8b7e016de8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:06.233460 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e086b690-a7bc-4600-9c08-9f8b7e016de8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:06.252428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-075cdbbc-2a1c-43c2-9583-bcc2853f12fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:06.260132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-075cdbbc-2a1c-43c2-9583-bcc2853f12fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:06.261748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-075cdbbc-2a1c-43c2-9583-bcc2853f12fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:06.263013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-075cdbbc-2a1c-43c2-9583-bcc2853f12fb tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1280 microversion: 2.20 time: 0.068482 Aug 01 15:59:06.263662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1653/2982] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:06 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:59:06.297848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e086b690-a7bc-4600-9c08-9f8b7e016de8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:06.306079 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e086b690-a7bc-4600-9c08-9f8b7e016de8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086319 Aug 01 15:59:06.306582 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1330/2983] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:06 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:06.741021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7ccdd592-206e-4a47-bc94-edc58a9481a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:06.741640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7ccdd592-206e-4a47-bc94-edc58a9481a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:06.748797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ccdd592-206e-4a47-bc94-edc58a9481a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:06.749244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ccdd592-206e-4a47-bc94-edc58a9481a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:06.750120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ccdd592-206e-4a47-bc94-edc58a9481a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:06.750557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ccdd592-206e-4a47-bc94-edc58a9481a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:06.888156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7ccdd592-206e-4a47-bc94-edc58a9481a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:06.896148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7ccdd592-206e-4a47-bc94-edc58a9481a2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159119 Aug 01 15:59:06.896762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1654/2984] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:06 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:07.286761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6840a157-3197-4b04-9c8d-16cc70485cd5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:07.287364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6840a157-3197-4b04-9c8d-16cc70485cd5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:07.328716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6b0cc79f-8b1e-4f19-9098-50102e429512 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:07.329219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6b0cc79f-8b1e-4f19-9098-50102e429512 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:07.335417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b0cc79f-8b1e-4f19-9098-50102e429512 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:07.335872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b0cc79f-8b1e-4f19-9098-50102e429512 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:07.336645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b0cc79f-8b1e-4f19-9098-50102e429512 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:07.337093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b0cc79f-8b1e-4f19-9098-50102e429512 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:07.340186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6840a157-3197-4b04-9c8d-16cc70485cd5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:07.347518 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6840a157-3197-4b04-9c8d-16cc70485cd5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:07.349117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6840a157-3197-4b04-9c8d-16cc70485cd5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:07.350337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6840a157-3197-4b04-9c8d-16cc70485cd5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1280 microversion: 2.20 time: 0.067437 Aug 01 15:59:07.350966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1331/2985] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:07 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:59:07.401117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6b0cc79f-8b1e-4f19-9098-50102e429512 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:07.409230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6b0cc79f-8b1e-4f19-9098-50102e429512 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085133 Aug 01 15:59:07.409790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1655/2986] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:07 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:07.917774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4d343712-7b27-4574-b192-fa6f276f4bb8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:07.918470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4d343712-7b27-4574-b192-fa6f276f4bb8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:07.926036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d343712-7b27-4574-b192-fa6f276f4bb8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:07.926549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d343712-7b27-4574-b192-fa6f276f4bb8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:07.927322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d343712-7b27-4574-b192-fa6f276f4bb8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:07.927763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d343712-7b27-4574-b192-fa6f276f4bb8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:08.061821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4d343712-7b27-4574-b192-fa6f276f4bb8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:08.069922 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4d343712-7b27-4574-b192-fa6f276f4bb8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156023 Aug 01 15:59:08.070488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1332/2987] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:07 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:08.372601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c57c9a06-ada5-40cc-bc03-249567b25109 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:08.373207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c57c9a06-ada5-40cc-bc03-249567b25109 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:08.430045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-84365e15-f1e1-4e27-8128-30be3a092a28 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:08.430674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-84365e15-f1e1-4e27-8128-30be3a092a28 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:08.433157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c57c9a06-ada5-40cc-bc03-249567b25109 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:08.437187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84365e15-f1e1-4e27-8128-30be3a092a28 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:08.437731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84365e15-f1e1-4e27-8128-30be3a092a28 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:08.438764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84365e15-f1e1-4e27-8128-30be3a092a28 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:08.439210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-84365e15-f1e1-4e27-8128-30be3a092a28 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:08.440576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c57c9a06-ada5-40cc-bc03-249567b25109 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:08.442126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c57c9a06-ada5-40cc-bc03-249567b25109 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:08.443240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c57c9a06-ada5-40cc-bc03-249567b25109 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1280 microversion: 2.20 time: 0.074552 Aug 01 15:59:08.444011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1656/2988] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:08 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:59:08.508356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-84365e15-f1e1-4e27-8128-30be3a092a28 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:08.517083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-84365e15-f1e1-4e27-8128-30be3a092a28 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.090883 Aug 01 15:59:08.517657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1333/2989] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:08 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:09.091568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-57e5a925-5ad3-4bc5-bb85-0380a3a5986b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:09.092170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-57e5a925-5ad3-4bc5-bb85-0380a3a5986b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:09.098553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-57e5a925-5ad3-4bc5-bb85-0380a3a5986b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:09.099009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-57e5a925-5ad3-4bc5-bb85-0380a3a5986b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:09.099775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-57e5a925-5ad3-4bc5-bb85-0380a3a5986b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:09.100249 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-57e5a925-5ad3-4bc5-bb85-0380a3a5986b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:09.232088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-57e5a925-5ad3-4bc5-bb85-0380a3a5986b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:09.240214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-57e5a925-5ad3-4bc5-bb85-0380a3a5986b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152536 Aug 01 15:59:09.240780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1657/2990] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:09 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:09.466694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9bda34f1-d982-4af7-ab4e-50c2db3de67a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:09.467317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9bda34f1-d982-4af7-ab4e-50c2db3de67a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:09.474305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bda34f1-d982-4af7-ab4e-50c2db3de67a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:09.474757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bda34f1-d982-4af7-ab4e-50c2db3de67a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:09.475520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bda34f1-d982-4af7-ab4e-50c2db3de67a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:09.475959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bda34f1-d982-4af7-ab4e-50c2db3de67a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:09.538904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-039c8eb6-57cc-4b3c-8d3d-8a90decd2518 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:09.540005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-039c8eb6-57cc-4b3c-8d3d-8a90decd2518 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:09.541830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9bda34f1-d982-4af7-ab4e-50c2db3de67a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:09.546351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-039c8eb6-57cc-4b3c-8d3d-8a90decd2518 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:09.546809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-039c8eb6-57cc-4b3c-8d3d-8a90decd2518 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:09.547590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-039c8eb6-57cc-4b3c-8d3d-8a90decd2518 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:09.548033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-039c8eb6-57cc-4b3c-8d3d-8a90decd2518 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:09.550152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9bda34f1-d982-4af7-ab4e-50c2db3de67a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:09.551665 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9bda34f1-d982-4af7-ab4e-50c2db3de67a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:09.552773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9bda34f1-d982-4af7-ab4e-50c2db3de67a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1284 microversion: 2.20 time: 0.090128 Aug 01 15:59:09.553334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1334/2991] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:09 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:59:09.612072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-039c8eb6-57cc-4b3c-8d3d-8a90decd2518 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:09.620231 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-039c8eb6-57cc-4b3c-8d3d-8a90decd2518 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085149 Aug 01 15:59:09.620808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1658/2992] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:09 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:10.261755 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-705a2e7f-4c7a-4004-86b7-79e0b740ab3f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:10.262799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-705a2e7f-4c7a-4004-86b7-79e0b740ab3f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:10.270938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-705a2e7f-4c7a-4004-86b7-79e0b740ab3f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:10.271526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-705a2e7f-4c7a-4004-86b7-79e0b740ab3f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:10.272445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-705a2e7f-4c7a-4004-86b7-79e0b740ab3f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:10.272998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-705a2e7f-4c7a-4004-86b7-79e0b740ab3f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:10.422333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-705a2e7f-4c7a-4004-86b7-79e0b740ab3f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:10.431004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-705a2e7f-4c7a-4004-86b7-79e0b740ab3f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.174012 Aug 01 15:59:10.431605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1335/2993] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:10 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:10.576045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-16a3181e-23cc-482b-8cbb-21cde8359d02 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:10.576705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-16a3181e-23cc-482b-8cbb-21cde8359d02 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:10.583946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16a3181e-23cc-482b-8cbb-21cde8359d02 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:10.584406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16a3181e-23cc-482b-8cbb-21cde8359d02 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:10.585158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16a3181e-23cc-482b-8cbb-21cde8359d02 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:10.585598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-16a3181e-23cc-482b-8cbb-21cde8359d02 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:10.644054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1c230b16-f78b-4e77-a462-dab3da860834 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:10.644054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1c230b16-f78b-4e77-a462-dab3da860834 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:10.652927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-16a3181e-23cc-482b-8cbb-21cde8359d02 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:10.658204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c230b16-f78b-4e77-a462-dab3da860834 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:10.658659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c230b16-f78b-4e77-a462-dab3da860834 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:10.659440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c230b16-f78b-4e77-a462-dab3da860834 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:10.659878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1c230b16-f78b-4e77-a462-dab3da860834 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:10.669062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-16a3181e-23cc-482b-8cbb-21cde8359d02 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:10.670615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-16a3181e-23cc-482b-8cbb-21cde8359d02 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:10.671797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-16a3181e-23cc-482b-8cbb-21cde8359d02 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1338 microversion: 2.20 time: 0.099918 Aug 01 15:59:10.672576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1659/2994] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:10 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1338 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:59:10.730628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1c230b16-f78b-4e77-a462-dab3da860834 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:10.738783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1c230b16-f78b-4e77-a462-dab3da860834 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.100627 Aug 01 15:59:10.739352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1336/2995] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:10 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:11.454329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7e5afdb8-82de-4691-aa01-e4d714f3ab04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:11.455245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7e5afdb8-82de-4691-aa01-e4d714f3ab04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:11.461427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e5afdb8-82de-4691-aa01-e4d714f3ab04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:11.461901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e5afdb8-82de-4691-aa01-e4d714f3ab04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:11.462757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e5afdb8-82de-4691-aa01-e4d714f3ab04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:11.463195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e5afdb8-82de-4691-aa01-e4d714f3ab04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:11.595989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7e5afdb8-82de-4691-aa01-e4d714f3ab04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:11.605906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7e5afdb8-82de-4691-aa01-e4d714f3ab04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156158 Aug 01 15:59:11.606613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1660/2996] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:11 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:11.701850 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-41e7de62-1f84-4c1a-af82-3fb22528125c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:11.702410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-41e7de62-1f84-4c1a-af82-3fb22528125c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:11.705694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:11.713654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41e7de62-1f84-4c1a-af82-3fb22528125c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:11.713654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41e7de62-1f84-4c1a-af82-3fb22528125c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:11.714386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41e7de62-1f84-4c1a-af82-3fb22528125c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:11.715282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41e7de62-1f84-4c1a-af82-3fb22528125c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:11.759908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d5bbcb57-0382-4b54-a7e0-ea30c9ace371 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:11.761445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d5bbcb57-0382-4b54-a7e0-ea30c9ace371 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:11.768544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5bbcb57-0382-4b54-a7e0-ea30c9ace371 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:11.769294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5bbcb57-0382-4b54-a7e0-ea30c9ace371 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:11.770119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5bbcb57-0382-4b54-a7e0-ea30c9ace371 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:11.770600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d5bbcb57-0382-4b54-a7e0-ea30c9ace371 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:11.844080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d5bbcb57-0382-4b54-a7e0-ea30c9ace371 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:11.856762 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d5bbcb57-0382-4b54-a7e0-ea30c9ace371 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.100573 Aug 01 15:59:11.857780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1661/2997] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:11 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:11.863092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-76fc1831-cc5c-4a90-8b42-2bbca5ffdda3 req-b1be3f06-1d1c-422c-8ff9-1c85dc474167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1ace13-28cc-4664-b4d7-7d9672ea2580", "tag": "9d09335e-4f0c-46f3-91bb-850f5252b8d7"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:59:11.873986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-76fc1831-cc5c-4a90-8b42-2bbca5ffdda3 req-b1be3f06-1d1c-422c-8ff9-1c85dc474167 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:11.875299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-76fc1831-cc5c-4a90-8b42-2bbca5ffdda3 req-b1be3f06-1d1c-422c-8ff9-1c85dc474167 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:11.889144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-76fc1831-cc5c-4a90-8b42-2bbca5ffdda3 req-b1be3f06-1d1c-422c-8ff9-1c85dc474167 service nova] Creating event network-changed:9d09335e-4f0c-46f3-91bb-850f5252b8d7 for instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 on hv-cinder-84753 Aug 01 15:59:11.895918 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-76fc1831-cc5c-4a90-8b42-2bbca5ffdda3 req-b1be3f06-1d1c-422c-8ff9-1c85dc474167 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036906 Aug 01 15:59:11.896525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1662/2998] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:59:11.896830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-41e7de62-1f84-4c1a-af82-3fb22528125c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:11.905566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-41e7de62-1f84-4c1a-af82-3fb22528125c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:11.907173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-41e7de62-1f84-4c1a-af82-3fb22528125c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:11.909458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-41e7de62-1f84-4c1a-af82-3fb22528125c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1406 microversion: 2.20 time: 0.214695 Aug 01 15:59:11.910260 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1337/2999] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:11 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:59:12.630750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5524d563-bd09-4df9-975a-2e24c133f92e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:12.631461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5524d563-bd09-4df9-975a-2e24c133f92e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:12.637770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5524d563-bd09-4df9-975a-2e24c133f92e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:12.638268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5524d563-bd09-4df9-975a-2e24c133f92e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:12.639047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5524d563-bd09-4df9-975a-2e24c133f92e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:12.639491 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5524d563-bd09-4df9-975a-2e24c133f92e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:12.773505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5524d563-bd09-4df9-975a-2e24c133f92e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:12.782280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5524d563-bd09-4df9-975a-2e24c133f92e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156688 Aug 01 15:59:12.782837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1663/3000] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:12 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:12.880691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6f111628-8e60-42cc-9d84-09007a589648 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:12.881331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6f111628-8e60-42cc-9d84-09007a589648 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:12.887951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f111628-8e60-42cc-9d84-09007a589648 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:12.888391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f111628-8e60-42cc-9d84-09007a589648 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:12.889138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f111628-8e60-42cc-9d84-09007a589648 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:12.889566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6f111628-8e60-42cc-9d84-09007a589648 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:12.933154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ec049397-57ec-4fcb-b417-abd8942afe6b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:12.933772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ec049397-57ec-4fcb-b417-abd8942afe6b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:12.941112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ec049397-57ec-4fcb-b417-abd8942afe6b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:12.941729 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ec049397-57ec-4fcb-b417-abd8942afe6b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:12.942565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ec049397-57ec-4fcb-b417-abd8942afe6b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:12.943003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ec049397-57ec-4fcb-b417-abd8942afe6b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:12.952515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6f111628-8e60-42cc-9d84-09007a589648 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:12.964010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6f111628-8e60-42cc-9d84-09007a589648 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087030 Aug 01 15:59:12.964690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1338/3001] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:12 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:13.082839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ec049397-57ec-4fcb-b417-abd8942afe6b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:13.091405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ec049397-57ec-4fcb-b417-abd8942afe6b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:13.092889 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ec049397-57ec-4fcb-b417-abd8942afe6b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:13.094616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ec049397-57ec-4fcb-b417-abd8942afe6b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1406 microversion: 2.20 time: 0.165894 Aug 01 15:59:13.095185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1664/3002] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:12 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:59:13.807427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-06c63cce-737f-4724-bf40-5c1cd6d2d390 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:13.808148 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-06c63cce-737f-4724-bf40-5c1cd6d2d390 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:13.815166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06c63cce-737f-4724-bf40-5c1cd6d2d390 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:13.815618 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06c63cce-737f-4724-bf40-5c1cd6d2d390 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:13.816385 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06c63cce-737f-4724-bf40-5c1cd6d2d390 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:13.816819 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06c63cce-737f-4724-bf40-5c1cd6d2d390 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:13.953979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-06c63cce-737f-4724-bf40-5c1cd6d2d390 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:13.962203 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-06c63cce-737f-4724-bf40-5c1cd6d2d390 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.158584 Aug 01 15:59:13.962805 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1339/3003] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:13 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:13.986477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f22d0529-f782-4923-a411-817d529759f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:13.987114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f22d0529-f782-4923-a411-817d529759f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:13.993655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f22d0529-f782-4923-a411-817d529759f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:13.994087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f22d0529-f782-4923-a411-817d529759f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:13.994842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f22d0529-f782-4923-a411-817d529759f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:13.995274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f22d0529-f782-4923-a411-817d529759f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:14.058190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f22d0529-f782-4923-a411-817d529759f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:14.066878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f22d0529-f782-4923-a411-817d529759f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084829 Aug 01 15:59:14.067455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1665/3004] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:13 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:14.116591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d6990dd4-eadf-469c-9449-27287bc0c25f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:14.117200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d6990dd4-eadf-469c-9449-27287bc0c25f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:14.123349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6990dd4-eadf-469c-9449-27287bc0c25f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:14.123800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6990dd4-eadf-469c-9449-27287bc0c25f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:14.125103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6990dd4-eadf-469c-9449-27287bc0c25f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:14.125539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6990dd4-eadf-469c-9449-27287bc0c25f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:14.257729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d6990dd4-eadf-469c-9449-27287bc0c25f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:14.266016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d6990dd4-eadf-469c-9449-27287bc0c25f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:14.267534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d6990dd4-eadf-469c-9449-27287bc0c25f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:14.268642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d6990dd4-eadf-469c-9449-27287bc0c25f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1406 microversion: 2.20 time: 0.155980 Aug 01 15:59:14.269235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1340/3005] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:14 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:59:14.984618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a2795cdf-5dc3-4de6-9e1d-2edcca41cd56 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:14.985325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a2795cdf-5dc3-4de6-9e1d-2edcca41cd56 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:14.991967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2795cdf-5dc3-4de6-9e1d-2edcca41cd56 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:14.992598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2795cdf-5dc3-4de6-9e1d-2edcca41cd56 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:14.993156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2795cdf-5dc3-4de6-9e1d-2edcca41cd56 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:14.993586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2795cdf-5dc3-4de6-9e1d-2edcca41cd56 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:15.088127 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5511cd3a-c5b8-4ff7-a91f-23d92b820abd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:15.088749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5511cd3a-c5b8-4ff7-a91f-23d92b820abd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:15.091176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=2 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:15.096659 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5511cd3a-c5b8-4ff7-a91f-23d92b820abd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:15.097112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5511cd3a-c5b8-4ff7-a91f-23d92b820abd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:15.097881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5511cd3a-c5b8-4ff7-a91f-23d92b820abd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:15.098344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5511cd3a-c5b8-4ff7-a91f-23d92b820abd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:15.128742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a2795cdf-5dc3-4de6-9e1d-2edcca41cd56 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:15.136958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a2795cdf-5dc3-4de6-9e1d-2edcca41cd56 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156713 Aug 01 15:59:15.137534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1666/3006] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:14 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:15.163966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5511cd3a-c5b8-4ff7-a91f-23d92b820abd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:15.172511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5511cd3a-c5b8-4ff7-a91f-23d92b820abd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088228 Aug 01 15:59:15.173146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1341/3007] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:15 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:15.290656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bcad6673-c424-4b69-b6c8-04fc18ca5c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:15.291264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bcad6673-c424-4b69-b6c8-04fc18ca5c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:15.297806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bcad6673-c424-4b69-b6c8-04fc18ca5c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:15.298292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bcad6673-c424-4b69-b6c8-04fc18ca5c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:15.299049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bcad6673-c424-4b69-b6c8-04fc18ca5c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:15.299486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bcad6673-c424-4b69-b6c8-04fc18ca5c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:15.427884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bcad6673-c424-4b69-b6c8-04fc18ca5c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:15.435696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bcad6673-c424-4b69-b6c8-04fc18ca5c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:15.437714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bcad6673-c424-4b69-b6c8-04fc18ca5c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:15.438843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bcad6673-c424-4b69-b6c8-04fc18ca5c31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1406 microversion: 2.20 time: 0.152124 Aug 01 15:59:15.439404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1667/3008] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:15 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:59:16.158646 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2dac9eea-a154-48b8-983e-b5e42aea7b88 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:16.159260 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2dac9eea-a154-48b8-983e-b5e42aea7b88 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:16.165679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dac9eea-a154-48b8-983e-b5e42aea7b88 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:16.166168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dac9eea-a154-48b8-983e-b5e42aea7b88 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:16.167186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dac9eea-a154-48b8-983e-b5e42aea7b88 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:16.167628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2dac9eea-a154-48b8-983e-b5e42aea7b88 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:16.193380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-187b6da9-0367-4d86-ab63-2d7a8e6b7525 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:16.193948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-187b6da9-0367-4d86-ab63-2d7a8e6b7525 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:16.200483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-187b6da9-0367-4d86-ab63-2d7a8e6b7525 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:16.200940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-187b6da9-0367-4d86-ab63-2d7a8e6b7525 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:16.201712 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-187b6da9-0367-4d86-ab63-2d7a8e6b7525 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:16.202182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-187b6da9-0367-4d86-ab63-2d7a8e6b7525 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:16.283196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-187b6da9-0367-4d86-ab63-2d7a8e6b7525 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:16.292907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-187b6da9-0367-4d86-ab63-2d7a8e6b7525 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.103420 Aug 01 15:59:16.306098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1668/3009] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:16 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:16.328657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2dac9eea-a154-48b8-983e-b5e42aea7b88 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:16.336780 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2dac9eea-a154-48b8-983e-b5e42aea7b88 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.182195 Aug 01 15:59:16.337472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1342/3010] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:16 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:16.462085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-52b13ef9-209e-4815-b8a7-2f9a64cd1e5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:16.462617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-52b13ef9-209e-4815-b8a7-2f9a64cd1e5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:16.469457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52b13ef9-209e-4815-b8a7-2f9a64cd1e5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:16.469924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52b13ef9-209e-4815-b8a7-2f9a64cd1e5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:16.470705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52b13ef9-209e-4815-b8a7-2f9a64cd1e5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:16.471140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52b13ef9-209e-4815-b8a7-2f9a64cd1e5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:16.601382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-52b13ef9-209e-4815-b8a7-2f9a64cd1e5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:16.610256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-52b13ef9-209e-4815-b8a7-2f9a64cd1e5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:16.611778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-52b13ef9-209e-4815-b8a7-2f9a64cd1e5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:16.612896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-52b13ef9-209e-4815-b8a7-2f9a64cd1e5f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1406 microversion: 2.20 time: 0.154872 Aug 01 15:59:16.614039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1669/3011] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:16 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:59:17.315554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d86b9a65-23db-4b91-8009-b6b8ab8baaae tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:17.316166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d86b9a65-23db-4b91-8009-b6b8ab8baaae tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:17.322619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d86b9a65-23db-4b91-8009-b6b8ab8baaae tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:17.323072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d86b9a65-23db-4b91-8009-b6b8ab8baaae tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:17.323835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d86b9a65-23db-4b91-8009-b6b8ab8baaae tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:17.324270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d86b9a65-23db-4b91-8009-b6b8ab8baaae tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:17.345838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=12 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:17.359173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2a4a7fd4-714a-4b93-b3ff-d0b0edc68cbd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:17.359832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2a4a7fd4-714a-4b93-b3ff-d0b0edc68cbd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:17.366570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a4a7fd4-714a-4b93-b3ff-d0b0edc68cbd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:17.367021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a4a7fd4-714a-4b93-b3ff-d0b0edc68cbd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:17.367798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a4a7fd4-714a-4b93-b3ff-d0b0edc68cbd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:17.368411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a4a7fd4-714a-4b93-b3ff-d0b0edc68cbd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:17.388300 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d86b9a65-23db-4b91-8009-b6b8ab8baaae tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:17.396479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d86b9a65-23db-4b91-8009-b6b8ab8baaae tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085485 Aug 01 15:59:17.397050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1343/3012] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:17 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:17.504066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2a4a7fd4-714a-4b93-b3ff-d0b0edc68cbd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:17.507693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:17.512999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2a4a7fd4-714a-4b93-b3ff-d0b0edc68cbd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.158488 Aug 01 15:59:17.513569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1670/3013] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:17 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:17.636665 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5191e202-808b-48e1-b3b7-231fc0436337 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:17.637280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5191e202-808b-48e1-b3b7-231fc0436337 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:17.643387 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5191e202-808b-48e1-b3b7-231fc0436337 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:17.643840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5191e202-808b-48e1-b3b7-231fc0436337 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:17.644599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5191e202-808b-48e1-b3b7-231fc0436337 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:17.645045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5191e202-808b-48e1-b3b7-231fc0436337 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:17.777787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5191e202-808b-48e1-b3b7-231fc0436337 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:17.786813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5191e202-808b-48e1-b3b7-231fc0436337 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:17.788314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5191e202-808b-48e1-b3b7-231fc0436337 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:17.789435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5191e202-808b-48e1-b3b7-231fc0436337 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1406 microversion: 2.20 time: 0.156785 Aug 01 15:59:17.790027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1344/3014] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:17 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:59:17.886826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-8380e290-75ba-4bc0-b771-596d40115d39 req-3081ee3f-9272-4610-8626-a67c0f6953d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1ace13-28cc-4664-b4d7-7d9672ea2580", "name": "network-vif-plugged", "status": "completed", "tag": "9d09335e-4f0c-46f3-91bb-850f5252b8d7"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:59:17.898066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-8380e290-75ba-4bc0-b771-596d40115d39 req-3081ee3f-9272-4610-8626-a67c0f6953d3 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:17.898588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-8380e290-75ba-4bc0-b771-596d40115d39 req-3081ee3f-9272-4610-8626-a67c0f6953d3 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:17.910707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-8380e290-75ba-4bc0-b771-596d40115d39 req-3081ee3f-9272-4610-8626-a67c0f6953d3 service nova] Creating event network-vif-plugged:9d09335e-4f0c-46f3-91bb-850f5252b8d7 for instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 on hv-cinder-84753 Aug 01 15:59:17.915784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-8380e290-75ba-4bc0-b771-596d40115d39 req-3081ee3f-9272-4610-8626-a67c0f6953d3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 Aug 01 15:59:17.916375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1671/3015] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:59:18.417781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9c1d8e40-a206-41ef-a01e-6a4076ed6a17 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:18.418380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9c1d8e40-a206-41ef-a01e-6a4076ed6a17 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:18.427586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c1d8e40-a206-41ef-a01e-6a4076ed6a17 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:18.428043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c1d8e40-a206-41ef-a01e-6a4076ed6a17 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:18.428808 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c1d8e40-a206-41ef-a01e-6a4076ed6a17 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:18.429250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9c1d8e40-a206-41ef-a01e-6a4076ed6a17 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:18.433269 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:18.492669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9c1d8e40-a206-41ef-a01e-6a4076ed6a17 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:18.500776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9c1d8e40-a206-41ef-a01e-6a4076ed6a17 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086919 Aug 01 15:59:18.501335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1345/3016] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:18 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:18.531438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=4 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:18.536062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5b390ea1-71d8-47bc-8c3f-a194954f9fff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:18.536787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5b390ea1-71d8-47bc-8c3f-a194954f9fff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:18.543240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b390ea1-71d8-47bc-8c3f-a194954f9fff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:18.543684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b390ea1-71d8-47bc-8c3f-a194954f9fff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:18.544432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b390ea1-71d8-47bc-8c3f-a194954f9fff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:18.544859 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5b390ea1-71d8-47bc-8c3f-a194954f9fff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:18.682012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5b390ea1-71d8-47bc-8c3f-a194954f9fff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:18.690214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5b390ea1-71d8-47bc-8c3f-a194954f9fff tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.160660 Aug 01 15:59:18.690783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1672/3017] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:18 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:18.813172 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4f3a1318-93ad-445b-8cd2-213f4e15ab3d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:18.813879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4f3a1318-93ad-445b-8cd2-213f4e15ab3d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:18.820017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f3a1318-93ad-445b-8cd2-213f4e15ab3d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:18.820464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f3a1318-93ad-445b-8cd2-213f4e15ab3d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:18.821287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f3a1318-93ad-445b-8cd2-213f4e15ab3d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:18.821688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f3a1318-93ad-445b-8cd2-213f4e15ab3d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:18.957529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4f3a1318-93ad-445b-8cd2-213f4e15ab3d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:18.965377 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4f3a1318-93ad-445b-8cd2-213f4e15ab3d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:18.966909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4f3a1318-93ad-445b-8cd2-213f4e15ab3d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:18.968013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4f3a1318-93ad-445b-8cd2-213f4e15ab3d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1406 microversion: 2.20 time: 0.159491 Aug 01 15:59:18.969217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1346/3018] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:18 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:59:19.522267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-097cecd4-eaad-4fea-8faf-46b772612366 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:19.522887 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-097cecd4-eaad-4fea-8faf-46b772612366 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:19.529041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-097cecd4-eaad-4fea-8faf-46b772612366 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:19.529493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-097cecd4-eaad-4fea-8faf-46b772612366 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:19.530287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-097cecd4-eaad-4fea-8faf-46b772612366 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:19.531377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-097cecd4-eaad-4fea-8faf-46b772612366 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:19.591994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-097cecd4-eaad-4fea-8faf-46b772612366 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:19.600557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-097cecd4-eaad-4fea-8faf-46b772612366 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082397 Aug 01 15:59:19.601116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1673/3019] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:19 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:19.712078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-97432667-46be-4974-9d8b-5af4549dca0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:19.712704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-97432667-46be-4974-9d8b-5af4549dca0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:19.720652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-97432667-46be-4974-9d8b-5af4549dca0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:19.721094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-97432667-46be-4974-9d8b-5af4549dca0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:19.721874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-97432667-46be-4974-9d8b-5af4549dca0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:19.722343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-97432667-46be-4974-9d8b-5af4549dca0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:19.863615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-97432667-46be-4974-9d8b-5af4549dca0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:19.871785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-97432667-46be-4974-9d8b-5af4549dca0b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.163643 Aug 01 15:59:19.872346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1347/3020] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:19 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:20.067135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-716bb443-922e-4aa7-b1e4-8f31a1d01efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:20.067747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-716bb443-922e-4aa7-b1e4-8f31a1d01efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:20.073745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-716bb443-922e-4aa7-b1e4-8f31a1d01efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:20.074228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-716bb443-922e-4aa7-b1e4-8f31a1d01efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:20.074994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-716bb443-922e-4aa7-b1e4-8f31a1d01efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:20.075431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-716bb443-922e-4aa7-b1e4-8f31a1d01efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:20.206316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-716bb443-922e-4aa7-b1e4-8f31a1d01efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:20.214362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-716bb443-922e-4aa7-b1e4-8f31a1d01efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:20.215868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-716bb443-922e-4aa7-b1e4-8f31a1d01efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:20.217035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-716bb443-922e-4aa7-b1e4-8f31a1d01efe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1598 microversion: 2.20 time: 0.229148 Aug 01 15:59:20.217594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1674/3021] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 15:59:19 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1598 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:59:20.239617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c4814f17-9b36-47df-b40e-f6f252c784c6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:20.240117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c4814f17-9b36-47df-b40e-f6f252c784c6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:20.246244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c4814f17-9b36-47df-b40e-f6f252c784c6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:20.246690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c4814f17-9b36-47df-b40e-f6f252c784c6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:20.247452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c4814f17-9b36-47df-b40e-f6f252c784c6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:20.247895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c4814f17-9b36-47df-b40e-f6f252c784c6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:20.330028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c4814f17-9b36-47df-b40e-f6f252c784c6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094201 Aug 01 15:59:20.330626 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1348/3022] 10.222.0.83 () {60 vars in 1316 bytes} [Mon Aug 1 15:59:20 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:59:20.621248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bac18582-4ece-4d55-a505-4c0904a68449 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:20.621867 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bac18582-4ece-4d55-a505-4c0904a68449 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:20.629803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bac18582-4ece-4d55-a505-4c0904a68449 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:20.630293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bac18582-4ece-4d55-a505-4c0904a68449 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:20.631081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bac18582-4ece-4d55-a505-4c0904a68449 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:20.631521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bac18582-4ece-4d55-a505-4c0904a68449 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:20.705290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bac18582-4ece-4d55-a505-4c0904a68449 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:20.713217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bac18582-4ece-4d55-a505-4c0904a68449 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.096239 Aug 01 15:59:20.725982 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1675/3023] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:20 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:20.895672 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-732fae48-34e7-4a93-963a-9436e0f7287c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:20.896250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-732fae48-34e7-4a93-963a-9436e0f7287c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:20.902683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-732fae48-34e7-4a93-963a-9436e0f7287c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:20.903135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-732fae48-34e7-4a93-963a-9436e0f7287c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:20.903908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-732fae48-34e7-4a93-963a-9436e0f7287c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:20.904338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-732fae48-34e7-4a93-963a-9436e0f7287c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:21.127321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-732fae48-34e7-4a93-963a-9436e0f7287c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:21.135676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-732fae48-34e7-4a93-963a-9436e0f7287c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.245223 Aug 01 15:59:21.136284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1349/3024] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:20 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:21.661471 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-1cdba289-1c78-4e29-894c-66ec5f424cfc req-4091b780-ffda-4c10-be99-9f2781637f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1ace13-28cc-4664-b4d7-7d9672ea2580", "tag": "9d09335e-4f0c-46f3-91bb-850f5252b8d7"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:59:21.672640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-1cdba289-1c78-4e29-894c-66ec5f424cfc req-4091b780-ffda-4c10-be99-9f2781637f4a service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:21.673085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-1cdba289-1c78-4e29-894c-66ec5f424cfc req-4091b780-ffda-4c10-be99-9f2781637f4a service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:21.685136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-1cdba289-1c78-4e29-894c-66ec5f424cfc req-4091b780-ffda-4c10-be99-9f2781637f4a service nova] Creating event network-changed:9d09335e-4f0c-46f3-91bb-850f5252b8d7 for instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 on hv-cinder-84753 Aug 01 15:59:21.690992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-1cdba289-1c78-4e29-894c-66ec5f424cfc req-4091b780-ffda-4c10-be99-9f2781637f4a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033060 Aug 01 15:59:21.691601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1676/3025] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 15:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:59:21.734670 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c2cbc2fc-3cbd-4276-a9d3-85ed9d6140dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:21.735496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c2cbc2fc-3cbd-4276-a9d3-85ed9d6140dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:21.742009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2cbc2fc-3cbd-4276-a9d3-85ed9d6140dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:21.742475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2cbc2fc-3cbd-4276-a9d3-85ed9d6140dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:21.743264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2cbc2fc-3cbd-4276-a9d3-85ed9d6140dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:21.743704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2cbc2fc-3cbd-4276-a9d3-85ed9d6140dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:21.807957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c2cbc2fc-3cbd-4276-a9d3-85ed9d6140dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:21.817977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c2cbc2fc-3cbd-4276-a9d3-85ed9d6140dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087606 Aug 01 15:59:21.830066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1350/3026] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:21 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:22.162633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3de5ffbe-0628-4f59-917d-be140f15b6bd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:22.163340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3de5ffbe-0628-4f59-917d-be140f15b6bd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:22.170003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3de5ffbe-0628-4f59-917d-be140f15b6bd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:22.170453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3de5ffbe-0628-4f59-917d-be140f15b6bd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:22.171792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3de5ffbe-0628-4f59-917d-be140f15b6bd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:22.172303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3de5ffbe-0628-4f59-917d-be140f15b6bd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:22.313242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3de5ffbe-0628-4f59-917d-be140f15b6bd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:22.322174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3de5ffbe-0628-4f59-917d-be140f15b6bd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.163824 Aug 01 15:59:22.323025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1677/3027] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:22 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:22.839716 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-928d297b-267e-4a3f-9741-1d17d0f03fdb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:22.840335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-928d297b-267e-4a3f-9741-1d17d0f03fdb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:22.847132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-928d297b-267e-4a3f-9741-1d17d0f03fdb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:22.847703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-928d297b-267e-4a3f-9741-1d17d0f03fdb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:22.848564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-928d297b-267e-4a3f-9741-1d17d0f03fdb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:22.849042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-928d297b-267e-4a3f-9741-1d17d0f03fdb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:22.912003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-928d297b-267e-4a3f-9741-1d17d0f03fdb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:22.919985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-928d297b-267e-4a3f-9741-1d17d0f03fdb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084194 Aug 01 15:59:22.920556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1351/3028] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:22 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:23.344201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-85b5fb4f-b1be-41b5-a128-f5ba80c2d793 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:23.344910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-85b5fb4f-b1be-41b5-a128-f5ba80c2d793 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:23.351866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85b5fb4f-b1be-41b5-a128-f5ba80c2d793 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:23.352581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85b5fb4f-b1be-41b5-a128-f5ba80c2d793 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:23.353343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85b5fb4f-b1be-41b5-a128-f5ba80c2d793 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:23.353785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-85b5fb4f-b1be-41b5-a128-f5ba80c2d793 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:23.486635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-85b5fb4f-b1be-41b5-a128-f5ba80c2d793 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:23.494415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-85b5fb4f-b1be-41b5-a128-f5ba80c2d793 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154228 Aug 01 15:59:23.494982 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1678/3029] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:23 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:23.940851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fc3102e4-9495-4994-a73d-e86e7294946f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:23.941573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fc3102e4-9495-4994-a73d-e86e7294946f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:23.948052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc3102e4-9495-4994-a73d-e86e7294946f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:23.948497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc3102e4-9495-4994-a73d-e86e7294946f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:23.949250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc3102e4-9495-4994-a73d-e86e7294946f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:23.949681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc3102e4-9495-4994-a73d-e86e7294946f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:24.013934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fc3102e4-9495-4994-a73d-e86e7294946f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:24.022880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fc3102e4-9495-4994-a73d-e86e7294946f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086154 Aug 01 15:59:24.023440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1352/3030] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:23 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:24.517152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-43ee129c-1cc3-42f3-9277-5014605b6258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:24.518063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-43ee129c-1cc3-42f3-9277-5014605b6258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:24.524102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43ee129c-1cc3-42f3-9277-5014605b6258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:24.524552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43ee129c-1cc3-42f3-9277-5014605b6258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:24.525321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43ee129c-1cc3-42f3-9277-5014605b6258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:24.525758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43ee129c-1cc3-42f3-9277-5014605b6258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:24.653576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-43ee129c-1cc3-42f3-9277-5014605b6258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:24.661571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-43ee129c-1cc3-42f3-9277-5014605b6258 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.148975 Aug 01 15:59:24.662168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1679/3031] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:24 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:25.044254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d24c0189-73b7-4e05-959a-81c8768afb18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:25.044870 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d24c0189-73b7-4e05-959a-81c8768afb18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:25.051989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d24c0189-73b7-4e05-959a-81c8768afb18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:25.052444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d24c0189-73b7-4e05-959a-81c8768afb18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:25.053226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d24c0189-73b7-4e05-959a-81c8768afb18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:25.053667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d24c0189-73b7-4e05-959a-81c8768afb18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:25.118601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d24c0189-73b7-4e05-959a-81c8768afb18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:25.126841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d24c0189-73b7-4e05-959a-81c8768afb18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086479 Aug 01 15:59:25.127404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1353/3032] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:25 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:25.684090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5bdd495e-2b92-474a-ad06-c9d10d387c24 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:25.684702 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5bdd495e-2b92-474a-ad06-c9d10d387c24 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:25.692298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5bdd495e-2b92-474a-ad06-c9d10d387c24 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:25.692751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5bdd495e-2b92-474a-ad06-c9d10d387c24 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:25.693517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5bdd495e-2b92-474a-ad06-c9d10d387c24 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:25.693986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5bdd495e-2b92-474a-ad06-c9d10d387c24 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:25.833963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5bdd495e-2b92-474a-ad06-c9d10d387c24 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:25.842366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5bdd495e-2b92-474a-ad06-c9d10d387c24 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.162856 Aug 01 15:59:25.843057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1680/3033] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:25 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:26.148282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-428f5b9f-1511-4511-95d6-fe6af7de396c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:26.149078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-428f5b9f-1511-4511-95d6-fe6af7de396c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:26.155802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-428f5b9f-1511-4511-95d6-fe6af7de396c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:26.156258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-428f5b9f-1511-4511-95d6-fe6af7de396c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:26.157023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-428f5b9f-1511-4511-95d6-fe6af7de396c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:26.157459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-428f5b9f-1511-4511-95d6-fe6af7de396c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:26.221547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-428f5b9f-1511-4511-95d6-fe6af7de396c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:26.230201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-428f5b9f-1511-4511-95d6-fe6af7de396c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085828 Aug 01 15:59:26.230770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1354/3034] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:26 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:26.864782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-28682dee-7a16-42f9-8821-a3125207e1ad tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:26.865398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-28682dee-7a16-42f9-8821-a3125207e1ad tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:26.872029 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28682dee-7a16-42f9-8821-a3125207e1ad tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:26.872480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28682dee-7a16-42f9-8821-a3125207e1ad tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:26.873253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28682dee-7a16-42f9-8821-a3125207e1ad tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:26.873693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-28682dee-7a16-42f9-8821-a3125207e1ad tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:27.007088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-28682dee-7a16-42f9-8821-a3125207e1ad tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:27.016445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-28682dee-7a16-42f9-8821-a3125207e1ad tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155559 Aug 01 15:59:27.017019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1681/3035] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:26 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:27.251429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c202cc60-8ebf-423f-b864-639e68091f69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:27.251996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c202cc60-8ebf-423f-b864-639e68091f69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:27.258619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c202cc60-8ebf-423f-b864-639e68091f69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:27.259069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c202cc60-8ebf-423f-b864-639e68091f69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:27.259860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c202cc60-8ebf-423f-b864-639e68091f69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:27.260296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c202cc60-8ebf-423f-b864-639e68091f69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:27.324779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c202cc60-8ebf-423f-b864-639e68091f69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:27.333436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c202cc60-8ebf-423f-b864-639e68091f69 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085921 Aug 01 15:59:27.334030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1355/3036] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:27 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:28.038085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5dfe633f-97e8-4b9b-b8dc-3e002b4aa669 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:28.038652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5dfe633f-97e8-4b9b-b8dc-3e002b4aa669 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:28.045389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5dfe633f-97e8-4b9b-b8dc-3e002b4aa669 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:28.045848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5dfe633f-97e8-4b9b-b8dc-3e002b4aa669 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:28.047284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5dfe633f-97e8-4b9b-b8dc-3e002b4aa669 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:28.047726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5dfe633f-97e8-4b9b-b8dc-3e002b4aa669 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:28.177505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5dfe633f-97e8-4b9b-b8dc-3e002b4aa669 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:28.185599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5dfe633f-97e8-4b9b-b8dc-3e002b4aa669 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151641 Aug 01 15:59:28.186207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1682/3037] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:28 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:28.354765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4320efc6-98cd-48ce-b2bf-10fb24063f6e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:28.355329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4320efc6-98cd-48ce-b2bf-10fb24063f6e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:28.362598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4320efc6-98cd-48ce-b2bf-10fb24063f6e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:28.363057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4320efc6-98cd-48ce-b2bf-10fb24063f6e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:28.363821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4320efc6-98cd-48ce-b2bf-10fb24063f6e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:28.364264 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4320efc6-98cd-48ce-b2bf-10fb24063f6e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:28.425376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4320efc6-98cd-48ce-b2bf-10fb24063f6e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:28.433428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4320efc6-98cd-48ce-b2bf-10fb24063f6e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082926 Aug 01 15:59:28.434013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1356/3038] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:28 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:29.207518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-600937e3-0066-43a5-b11e-f251a947b311 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:29.208124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-600937e3-0066-43a5-b11e-f251a947b311 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:29.214861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-600937e3-0066-43a5-b11e-f251a947b311 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:29.215313 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-600937e3-0066-43a5-b11e-f251a947b311 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:29.216071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-600937e3-0066-43a5-b11e-f251a947b311 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:29.216503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-600937e3-0066-43a5-b11e-f251a947b311 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:29.348248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-600937e3-0066-43a5-b11e-f251a947b311 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:29.356428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-600937e3-0066-43a5-b11e-f251a947b311 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152768 Aug 01 15:59:29.356986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1683/3039] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:29 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:29.454886 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2f6fbb18-842b-4b08-9065-03aebcf2e9b9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:29.455511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2f6fbb18-842b-4b08-9065-03aebcf2e9b9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:29.462458 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f6fbb18-842b-4b08-9065-03aebcf2e9b9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:29.462961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f6fbb18-842b-4b08-9065-03aebcf2e9b9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:29.463707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f6fbb18-842b-4b08-9065-03aebcf2e9b9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:29.464157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f6fbb18-842b-4b08-9065-03aebcf2e9b9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:29.527860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2f6fbb18-842b-4b08-9065-03aebcf2e9b9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:29.537207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2f6fbb18-842b-4b08-9065-03aebcf2e9b9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086627 Aug 01 15:59:29.537959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1357/3040] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:29 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:30.377607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-803bf45e-9c8d-4295-a1b4-26b3250b555c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:30.378252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-803bf45e-9c8d-4295-a1b4-26b3250b555c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:30.384888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-803bf45e-9c8d-4295-a1b4-26b3250b555c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:30.385339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-803bf45e-9c8d-4295-a1b4-26b3250b555c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:30.386136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-803bf45e-9c8d-4295-a1b4-26b3250b555c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:30.386574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-803bf45e-9c8d-4295-a1b4-26b3250b555c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:30.523403 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-803bf45e-9c8d-4295-a1b4-26b3250b555c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:30.531591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-803bf45e-9c8d-4295-a1b4-26b3250b555c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.157831 Aug 01 15:59:30.532174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1684/3041] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:30 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:30.558187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-58641843-ad18-43de-ac16-081b2c1724ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:30.558842 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-58641843-ad18-43de-ac16-081b2c1724ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:30.566039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-58641843-ad18-43de-ac16-081b2c1724ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:30.566492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-58641843-ad18-43de-ac16-081b2c1724ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:30.567257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-58641843-ad18-43de-ac16-081b2c1724ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:30.567694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-58641843-ad18-43de-ac16-081b2c1724ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:30.634589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-58641843-ad18-43de-ac16-081b2c1724ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:30.642783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-58641843-ad18-43de-ac16-081b2c1724ef tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088434 Aug 01 15:59:30.643355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1358/3042] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:30 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:31.553234 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d90a8723-0395-46e1-8785-f8979ffa4a09 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:31.553826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d90a8723-0395-46e1-8785-f8979ffa4a09 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:31.560308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d90a8723-0395-46e1-8785-f8979ffa4a09 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:31.560749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d90a8723-0395-46e1-8785-f8979ffa4a09 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:31.561511 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d90a8723-0395-46e1-8785-f8979ffa4a09 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:31.561979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d90a8723-0395-46e1-8785-f8979ffa4a09 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:31.663829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-122c57fd-1e94-4e35-84a2-ac21df916182 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:31.664445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-122c57fd-1e94-4e35-84a2-ac21df916182 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:31.671680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-122c57fd-1e94-4e35-84a2-ac21df916182 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:31.672134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-122c57fd-1e94-4e35-84a2-ac21df916182 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:31.672897 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-122c57fd-1e94-4e35-84a2-ac21df916182 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:31.673333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-122c57fd-1e94-4e35-84a2-ac21df916182 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:31.690101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d90a8723-0395-46e1-8785-f8979ffa4a09 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:31.698171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d90a8723-0395-46e1-8785-f8979ffa4a09 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.148745 Aug 01 15:59:31.699266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1685/3043] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:31 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:31.737834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-122c57fd-1e94-4e35-84a2-ac21df916182 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:31.746369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-122c57fd-1e94-4e35-84a2-ac21df916182 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086376 Aug 01 15:59:31.746944 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1359/3044] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:31 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:32.720400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d60c2df3-ed03-4139-a0e1-6321931517f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:32.720945 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d60c2df3-ed03-4139-a0e1-6321931517f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:32.727826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d60c2df3-ed03-4139-a0e1-6321931517f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:32.728283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d60c2df3-ed03-4139-a0e1-6321931517f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:32.729053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d60c2df3-ed03-4139-a0e1-6321931517f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:32.729495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d60c2df3-ed03-4139-a0e1-6321931517f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:32.767542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b081477a-8b40-447e-aade-a877d60aecd1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:32.768262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b081477a-8b40-447e-aade-a877d60aecd1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:32.774961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b081477a-8b40-447e-aade-a877d60aecd1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:32.775438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b081477a-8b40-447e-aade-a877d60aecd1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:32.776209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b081477a-8b40-447e-aade-a877d60aecd1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:32.776641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b081477a-8b40-447e-aade-a877d60aecd1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:32.853261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b081477a-8b40-447e-aade-a877d60aecd1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:32.861603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b081477a-8b40-447e-aade-a877d60aecd1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.097818 Aug 01 15:59:32.862199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1360/3045] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:32 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:32.883761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d60c2df3-ed03-4139-a0e1-6321931517f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:32.891624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d60c2df3-ed03-4139-a0e1-6321931517f1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.175306 Aug 01 15:59:32.892169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1686/3046] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:32 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:33.885229 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-45ac6edc-a670-435f-b1c6-026ff0fe5aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:33.885851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-45ac6edc-a670-435f-b1c6-026ff0fe5aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:33.892525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45ac6edc-a670-435f-b1c6-026ff0fe5aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:33.892976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45ac6edc-a670-435f-b1c6-026ff0fe5aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:33.893744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45ac6edc-a670-435f-b1c6-026ff0fe5aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:33.894212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-45ac6edc-a670-435f-b1c6-026ff0fe5aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:33.912819 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-67ff5b8e-8e46-4d5e-8c79-e04633d27626 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:33.913569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-67ff5b8e-8e46-4d5e-8c79-e04633d27626 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:33.920236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67ff5b8e-8e46-4d5e-8c79-e04633d27626 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:33.920685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67ff5b8e-8e46-4d5e-8c79-e04633d27626 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:33.922064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67ff5b8e-8e46-4d5e-8c79-e04633d27626 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:33.922503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67ff5b8e-8e46-4d5e-8c79-e04633d27626 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:33.958995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-45ac6edc-a670-435f-b1c6-026ff0fe5aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:33.967134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-45ac6edc-a670-435f-b1c6-026ff0fe5aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085825 Aug 01 15:59:33.968214 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1361/3047] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:33 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:34.053330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-67ff5b8e-8e46-4d5e-8c79-e04633d27626 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:34.061368 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-67ff5b8e-8e46-4d5e-8c79-e04633d27626 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152417 Aug 01 15:59:34.061994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1687/3048] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:33 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:34.991590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b76911e1-3e90-484a-847d-de3fe6a471f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:34.992708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b76911e1-3e90-484a-847d-de3fe6a471f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:35.000026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b76911e1-3e90-484a-847d-de3fe6a471f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:35.000469 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b76911e1-3e90-484a-847d-de3fe6a471f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:35.001233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b76911e1-3e90-484a-847d-de3fe6a471f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:35.001669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b76911e1-3e90-484a-847d-de3fe6a471f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:35.005672 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:35.069085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b76911e1-3e90-484a-847d-de3fe6a471f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:35.077114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b76911e1-3e90-484a-847d-de3fe6a471f0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.091535 Aug 01 15:59:35.077708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1362/3049] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:34 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:35.084361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-48fd345e-07b4-4b43-8373-4f8e276ffcac tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:35.084979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-48fd345e-07b4-4b43-8373-4f8e276ffcac tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:35.087434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=80 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:35.093535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48fd345e-07b4-4b43-8373-4f8e276ffcac tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:35.093962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48fd345e-07b4-4b43-8373-4f8e276ffcac tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:35.094729 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48fd345e-07b4-4b43-8373-4f8e276ffcac tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:35.095172 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48fd345e-07b4-4b43-8373-4f8e276ffcac tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:35.230432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48fd345e-07b4-4b43-8373-4f8e276ffcac tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:35.234347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:35.239950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-48fd345e-07b4-4b43-8373-4f8e276ffcac tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159404 Aug 01 15:59:35.240477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1688/3050] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:35 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:36.099436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3d44f122-a841-4fc7-abeb-13a92cd2981f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:36.100178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3d44f122-a841-4fc7-abeb-13a92cd2981f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:36.108279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d44f122-a841-4fc7-abeb-13a92cd2981f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:36.108866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d44f122-a841-4fc7-abeb-13a92cd2981f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:36.109757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d44f122-a841-4fc7-abeb-13a92cd2981f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:36.110499 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d44f122-a841-4fc7-abeb-13a92cd2981f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:36.171994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3d44f122-a841-4fc7-abeb-13a92cd2981f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:36.180226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3d44f122-a841-4fc7-abeb-13a92cd2981f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085400 Aug 01 15:59:36.180804 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1363/3051] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:36 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:36.261535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f4602f52-1149-494b-a5ad-32baf3ab27c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:36.262209 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f4602f52-1149-494b-a5ad-32baf3ab27c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:36.270675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4602f52-1149-494b-a5ad-32baf3ab27c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:36.271109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4602f52-1149-494b-a5ad-32baf3ab27c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:36.271888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4602f52-1149-494b-a5ad-32baf3ab27c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:36.272328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f4602f52-1149-494b-a5ad-32baf3ab27c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:36.403717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f4602f52-1149-494b-a5ad-32baf3ab27c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:36.411800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f4602f52-1149-494b-a5ad-32baf3ab27c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154031 Aug 01 15:59:36.412370 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1689/3052] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:36 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:37.202610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1d996dbf-2e46-46a7-9c82-723968fec5b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:37.203234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1d996dbf-2e46-46a7-9c82-723968fec5b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:37.209769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d996dbf-2e46-46a7-9c82-723968fec5b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:37.210266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d996dbf-2e46-46a7-9c82-723968fec5b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:37.211027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d996dbf-2e46-46a7-9c82-723968fec5b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:37.211463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d996dbf-2e46-46a7-9c82-723968fec5b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:37.277478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1d996dbf-2e46-46a7-9c82-723968fec5b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:37.285606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1d996dbf-2e46-46a7-9c82-723968fec5b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086836 Aug 01 15:59:37.286210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1364/3053] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:37 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:37.432952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5c59ccff-5b19-48ed-8fcb-a8652470c88f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:37.433632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5c59ccff-5b19-48ed-8fcb-a8652470c88f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:37.440743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c59ccff-5b19-48ed-8fcb-a8652470c88f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:37.441186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c59ccff-5b19-48ed-8fcb-a8652470c88f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:37.441961 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c59ccff-5b19-48ed-8fcb-a8652470c88f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:37.442394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5c59ccff-5b19-48ed-8fcb-a8652470c88f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:37.579725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5c59ccff-5b19-48ed-8fcb-a8652470c88f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:37.590136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5c59ccff-5b19-48ed-8fcb-a8652470c88f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.160941 Aug 01 15:59:37.590707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1690/3054] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:37 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:38.307112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9ccbeb5a-d108-4350-84fe-9261b7255acd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:38.307694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9ccbeb5a-d108-4350-84fe-9261b7255acd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:38.315733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ccbeb5a-d108-4350-84fe-9261b7255acd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:38.316299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ccbeb5a-d108-4350-84fe-9261b7255acd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:38.317110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ccbeb5a-d108-4350-84fe-9261b7255acd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:38.317634 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ccbeb5a-d108-4350-84fe-9261b7255acd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:38.382031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9ccbeb5a-d108-4350-84fe-9261b7255acd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:38.391270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9ccbeb5a-d108-4350-84fe-9261b7255acd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088123 Aug 01 15:59:38.391827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1365/3055] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:38 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:38.612538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-84a5cc60-b1bd-43b6-8adc-94d351163e1b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:38.613104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-84a5cc60-b1bd-43b6-8adc-94d351163e1b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:38.619814 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84a5cc60-b1bd-43b6-8adc-94d351163e1b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:38.620264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84a5cc60-b1bd-43b6-8adc-94d351163e1b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:38.621043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84a5cc60-b1bd-43b6-8adc-94d351163e1b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:38.621483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-84a5cc60-b1bd-43b6-8adc-94d351163e1b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:38.753341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-84a5cc60-b1bd-43b6-8adc-94d351163e1b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:38.761363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-84a5cc60-b1bd-43b6-8adc-94d351163e1b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152827 Aug 01 15:59:38.761965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1691/3056] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:38 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:39.412484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bde583c6-2090-410e-b066-fee2a110fc1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:39.413100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bde583c6-2090-410e-b066-fee2a110fc1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:39.419615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bde583c6-2090-410e-b066-fee2a110fc1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:39.420062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bde583c6-2090-410e-b066-fee2a110fc1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:39.420822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bde583c6-2090-410e-b066-fee2a110fc1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:39.421255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bde583c6-2090-410e-b066-fee2a110fc1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:39.483722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bde583c6-2090-410e-b066-fee2a110fc1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:39.491606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bde583c6-2090-410e-b066-fee2a110fc1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083031 Aug 01 15:59:39.492170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1366/3057] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:39 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:39.784192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8d3aa318-62f0-4a62-90e3-58714f26fd86 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:39.784746 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8d3aa318-62f0-4a62-90e3-58714f26fd86 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:39.791422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d3aa318-62f0-4a62-90e3-58714f26fd86 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:39.791878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d3aa318-62f0-4a62-90e3-58714f26fd86 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:39.792676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d3aa318-62f0-4a62-90e3-58714f26fd86 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:39.793115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8d3aa318-62f0-4a62-90e3-58714f26fd86 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:39.931446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8d3aa318-62f0-4a62-90e3-58714f26fd86 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:39.940670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8d3aa318-62f0-4a62-90e3-58714f26fd86 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.160371 Aug 01 15:59:39.941293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1692/3058] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:39 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:40.512680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-65240e91-0119-429f-a637-3f2763c68279 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:40.513326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-65240e91-0119-429f-a637-3f2763c68279 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:40.519925 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65240e91-0119-429f-a637-3f2763c68279 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:40.520380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65240e91-0119-429f-a637-3f2763c68279 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:40.521143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65240e91-0119-429f-a637-3f2763c68279 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:40.521583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65240e91-0119-429f-a637-3f2763c68279 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:40.584529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-65240e91-0119-429f-a637-3f2763c68279 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:40.593303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-65240e91-0119-429f-a637-3f2763c68279 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083920 Aug 01 15:59:40.593728 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1367/3059] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:40 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:40.963053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c5188028-1310-48e2-9f6f-75273fa45454 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:40.963664 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c5188028-1310-48e2-9f6f-75273fa45454 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:40.971026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5188028-1310-48e2-9f6f-75273fa45454 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:40.971476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5188028-1310-48e2-9f6f-75273fa45454 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:40.972247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5188028-1310-48e2-9f6f-75273fa45454 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:40.972682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5188028-1310-48e2-9f6f-75273fa45454 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:41.106359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c5188028-1310-48e2-9f6f-75273fa45454 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:41.114515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c5188028-1310-48e2-9f6f-75273fa45454 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155225 Aug 01 15:59:41.115084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1693/3060] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:40 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:41.614833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f9989554-cb8f-4d17-9b07-e4e846f7f395 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:41.615435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f9989554-cb8f-4d17-9b07-e4e846f7f395 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:41.627001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f9989554-cb8f-4d17-9b07-e4e846f7f395 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:41.627448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f9989554-cb8f-4d17-9b07-e4e846f7f395 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:41.628335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f9989554-cb8f-4d17-9b07-e4e846f7f395 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:41.628781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f9989554-cb8f-4d17-9b07-e4e846f7f395 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:41.694231 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f9989554-cb8f-4d17-9b07-e4e846f7f395 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:41.702253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f9989554-cb8f-4d17-9b07-e4e846f7f395 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.091183 Aug 01 15:59:41.703160 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1368/3061] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:41 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:42.135849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4045b93a-b430-4d0b-b9c8-bb55d68b0722 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:42.136465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4045b93a-b430-4d0b-b9c8-bb55d68b0722 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:42.143067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4045b93a-b430-4d0b-b9c8-bb55d68b0722 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:42.143519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4045b93a-b430-4d0b-b9c8-bb55d68b0722 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:42.144290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4045b93a-b430-4d0b-b9c8-bb55d68b0722 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:42.144730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4045b93a-b430-4d0b-b9c8-bb55d68b0722 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:42.274575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4045b93a-b430-4d0b-b9c8-bb55d68b0722 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:42.283187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4045b93a-b430-4d0b-b9c8-bb55d68b0722 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151178 Aug 01 15:59:42.283761 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1694/3062] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:42 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:42.724818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4d2e012d-9d18-4367-a021-35e56c866dee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:42.725426 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4d2e012d-9d18-4367-a021-35e56c866dee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:42.727983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=64 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:42.733719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d2e012d-9d18-4367-a021-35e56c866dee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:42.734141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d2e012d-9d18-4367-a021-35e56c866dee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:42.734895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d2e012d-9d18-4367-a021-35e56c866dee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:42.735329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4d2e012d-9d18-4367-a021-35e56c866dee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:42.796754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4d2e012d-9d18-4367-a021-35e56c866dee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:42.804866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4d2e012d-9d18-4367-a021-35e56c866dee tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083949 Aug 01 15:59:42.805429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1369/3063] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:42 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:43.305326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fda77e1c-345f-4143-8453-be450e562bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:43.306015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fda77e1c-345f-4143-8453-be450e562bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:43.313245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fda77e1c-345f-4143-8453-be450e562bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:43.313698 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fda77e1c-345f-4143-8453-be450e562bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:43.314499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fda77e1c-345f-4143-8453-be450e562bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:43.315407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fda77e1c-345f-4143-8453-be450e562bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:43.446228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fda77e1c-345f-4143-8453-be450e562bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:43.454232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fda77e1c-345f-4143-8453-be450e562bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152855 Aug 01 15:59:43.454806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1695/3064] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:43 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:43.826398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-673974d3-f885-4bd1-af4f-756b48d73ab3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:43.827019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-673974d3-f885-4bd1-af4f-756b48d73ab3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:43.833580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-673974d3-f885-4bd1-af4f-756b48d73ab3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:43.834064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-673974d3-f885-4bd1-af4f-756b48d73ab3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:43.834838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-673974d3-f885-4bd1-af4f-756b48d73ab3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:43.835276 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-673974d3-f885-4bd1-af4f-756b48d73ab3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:43.897282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-673974d3-f885-4bd1-af4f-756b48d73ab3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:43.906011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-673974d3-f885-4bd1-af4f-756b48d73ab3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082886 Aug 01 15:59:43.906596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1370/3065] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:43 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:44.475786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-67cba99d-f40b-4d43-a14c-c7ae2e48a5c7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:44.476405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-67cba99d-f40b-4d43-a14c-c7ae2e48a5c7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:44.483743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67cba99d-f40b-4d43-a14c-c7ae2e48a5c7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:44.484240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67cba99d-f40b-4d43-a14c-c7ae2e48a5c7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:44.485009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67cba99d-f40b-4d43-a14c-c7ae2e48a5c7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:44.485451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67cba99d-f40b-4d43-a14c-c7ae2e48a5c7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:44.613905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-67cba99d-f40b-4d43-a14c-c7ae2e48a5c7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:44.621829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-67cba99d-f40b-4d43-a14c-c7ae2e48a5c7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.149948 Aug 01 15:59:44.622420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1696/3066] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:44 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:44.926729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3a52330e-54da-47b5-abc5-38861bf619d6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:44.927347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3a52330e-54da-47b5-abc5-38861bf619d6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:44.933880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a52330e-54da-47b5-abc5-38861bf619d6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:44.934360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a52330e-54da-47b5-abc5-38861bf619d6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:44.935118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a52330e-54da-47b5-abc5-38861bf619d6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:44.935555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3a52330e-54da-47b5-abc5-38861bf619d6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:45.001532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3a52330e-54da-47b5-abc5-38861bf619d6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:45.009573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3a52330e-54da-47b5-abc5-38861bf619d6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086733 Aug 01 15:59:45.010162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1371/3067] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:44 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:45.644390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a1e15f4d-805d-4dd5-9890-a15772ec1d76 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:45.644997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a1e15f4d-805d-4dd5-9890-a15772ec1d76 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:45.651660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a1e15f4d-805d-4dd5-9890-a15772ec1d76 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:45.652102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a1e15f4d-805d-4dd5-9890-a15772ec1d76 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:45.652861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a1e15f4d-805d-4dd5-9890-a15772ec1d76 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:45.653291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a1e15f4d-805d-4dd5-9890-a15772ec1d76 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:45.790148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a1e15f4d-805d-4dd5-9890-a15772ec1d76 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:45.799423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a1e15f4d-805d-4dd5-9890-a15772ec1d76 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.158853 Aug 01 15:59:45.800013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1697/3068] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:45 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:46.033057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-56f77bbc-369c-40d9-a7d4-6308789d14a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:46.033603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-56f77bbc-369c-40d9-a7d4-6308789d14a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:46.040198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56f77bbc-369c-40d9-a7d4-6308789d14a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:46.040656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56f77bbc-369c-40d9-a7d4-6308789d14a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:46.041432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56f77bbc-369c-40d9-a7d4-6308789d14a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:46.041874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56f77bbc-369c-40d9-a7d4-6308789d14a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:46.106685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-56f77bbc-369c-40d9-a7d4-6308789d14a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:46.114642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-56f77bbc-369c-40d9-a7d4-6308789d14a6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085847 Aug 01 15:59:46.115207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1372/3069] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:46 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:46.822957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-86d58c5f-09b2-4552-b75e-0fe6ddfe158b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:46.823492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-86d58c5f-09b2-4552-b75e-0fe6ddfe158b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:46.830129 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-86d58c5f-09b2-4552-b75e-0fe6ddfe158b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:46.830583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-86d58c5f-09b2-4552-b75e-0fe6ddfe158b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:46.831344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-86d58c5f-09b2-4552-b75e-0fe6ddfe158b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:46.831782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-86d58c5f-09b2-4552-b75e-0fe6ddfe158b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:46.963478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-86d58c5f-09b2-4552-b75e-0fe6ddfe158b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:46.972302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-86d58c5f-09b2-4552-b75e-0fe6ddfe158b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153322 Aug 01 15:59:46.972870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1698/3070] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:46 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:47.136331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e4f65382-0bcc-48e5-8606-74356aa32ea7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:47.136952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e4f65382-0bcc-48e5-8606-74356aa32ea7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:47.144220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e4f65382-0bcc-48e5-8606-74356aa32ea7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:47.144746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e4f65382-0bcc-48e5-8606-74356aa32ea7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:47.145576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e4f65382-0bcc-48e5-8606-74356aa32ea7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:47.146070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e4f65382-0bcc-48e5-8606-74356aa32ea7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:47.207484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e4f65382-0bcc-48e5-8606-74356aa32ea7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:47.215470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e4f65382-0bcc-48e5-8606-74356aa32ea7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083090 Aug 01 15:59:47.216034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1373/3071] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:47 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:47.993803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fa601ec8-1513-42fd-88db-711909d5d7c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:47.994460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fa601ec8-1513-42fd-88db-711909d5d7c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:48.001733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fa601ec8-1513-42fd-88db-711909d5d7c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:48.002229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fa601ec8-1513-42fd-88db-711909d5d7c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:48.003006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fa601ec8-1513-42fd-88db-711909d5d7c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:48.003441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fa601ec8-1513-42fd-88db-711909d5d7c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:48.138623 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fa601ec8-1513-42fd-88db-711909d5d7c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:48.149103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fa601ec8-1513-42fd-88db-711909d5d7c2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159123 Aug 01 15:59:48.149676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1699/3072] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:47 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:48.237777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-df8a3e0b-9ee0-4ac6-a752-3d5f7f7efacc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:48.238425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-df8a3e0b-9ee0-4ac6-a752-3d5f7f7efacc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:48.245011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df8a3e0b-9ee0-4ac6-a752-3d5f7f7efacc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:48.245462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df8a3e0b-9ee0-4ac6-a752-3d5f7f7efacc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:48.246283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df8a3e0b-9ee0-4ac6-a752-3d5f7f7efacc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:48.246720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df8a3e0b-9ee0-4ac6-a752-3d5f7f7efacc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:48.310929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-df8a3e0b-9ee0-4ac6-a752-3d5f7f7efacc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:48.318973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-df8a3e0b-9ee0-4ac6-a752-3d5f7f7efacc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085688 Aug 01 15:59:48.319532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1374/3073] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:48 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:49.171961 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3cd0af17-bd35-4f59-a41c-37873c145fec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:49.172586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3cd0af17-bd35-4f59-a41c-37873c145fec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:49.179674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cd0af17-bd35-4f59-a41c-37873c145fec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:49.180128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cd0af17-bd35-4f59-a41c-37873c145fec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:49.180904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cd0af17-bd35-4f59-a41c-37873c145fec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:49.181347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3cd0af17-bd35-4f59-a41c-37873c145fec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:49.309025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3cd0af17-bd35-4f59-a41c-37873c145fec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:49.317593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3cd0af17-bd35-4f59-a41c-37873c145fec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150136 Aug 01 15:59:49.318205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1700/3074] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:49 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:49.338811 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9d4bf56f-6772-418f-836a-907c26ef467d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:49.339475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9d4bf56f-6772-418f-836a-907c26ef467d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:49.346110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d4bf56f-6772-418f-836a-907c26ef467d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:49.346561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d4bf56f-6772-418f-836a-907c26ef467d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:49.347318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d4bf56f-6772-418f-836a-907c26ef467d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:49.347754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9d4bf56f-6772-418f-836a-907c26ef467d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:49.409215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9d4bf56f-6772-418f-836a-907c26ef467d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:49.417256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9d4bf56f-6772-418f-836a-907c26ef467d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082267 Aug 01 15:59:49.417815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1375/3075] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:49 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:50.339136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-21b3eb3c-4639-4071-b47b-c7902fbd8bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:50.339689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-21b3eb3c-4639-4071-b47b-c7902fbd8bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:50.346390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-21b3eb3c-4639-4071-b47b-c7902fbd8bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:50.346863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-21b3eb3c-4639-4071-b47b-c7902fbd8bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:50.347628 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-21b3eb3c-4639-4071-b47b-c7902fbd8bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:50.348062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-21b3eb3c-4639-4071-b47b-c7902fbd8bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:50.438899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-be79663e-9fee-48e6-a567-77808689d341 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:50.439520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-be79663e-9fee-48e6-a567-77808689d341 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:50.446453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-be79663e-9fee-48e6-a567-77808689d341 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:50.446908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-be79663e-9fee-48e6-a567-77808689d341 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:50.447783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-be79663e-9fee-48e6-a567-77808689d341 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:50.448129 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-be79663e-9fee-48e6-a567-77808689d341 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:50.482285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-21b3eb3c-4639-4071-b47b-c7902fbd8bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:50.490235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-21b3eb3c-4639-4071-b47b-c7902fbd8bf4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155091 Aug 01 15:59:50.490818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1701/3076] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:50 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:50.510363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-be79663e-9fee-48e6-a567-77808689d341 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:50.519088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-be79663e-9fee-48e6-a567-77808689d341 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084499 Aug 01 15:59:50.519655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1376/3077] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:50 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:51.512361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5e0ce5ff-c7df-4f9b-ae66-d6c79b8863b2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:51.513005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5e0ce5ff-c7df-4f9b-ae66-d6c79b8863b2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:51.520122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e0ce5ff-c7df-4f9b-ae66-d6c79b8863b2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:51.520569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e0ce5ff-c7df-4f9b-ae66-d6c79b8863b2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:51.521318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e0ce5ff-c7df-4f9b-ae66-d6c79b8863b2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:51.521750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e0ce5ff-c7df-4f9b-ae66-d6c79b8863b2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:51.539803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-769d4e46-640b-423b-9471-6af8ab272650 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:51.540420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-769d4e46-640b-423b-9471-6af8ab272650 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:51.547050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-769d4e46-640b-423b-9471-6af8ab272650 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:51.547505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-769d4e46-640b-423b-9471-6af8ab272650 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:51.548273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-769d4e46-640b-423b-9471-6af8ab272650 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:51.548713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-769d4e46-640b-423b-9471-6af8ab272650 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:51.616226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-769d4e46-640b-423b-9471-6af8ab272650 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:51.624187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-769d4e46-640b-423b-9471-6af8ab272650 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088224 Aug 01 15:59:51.624801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1377/3078] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:51 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:51.676022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5e0ce5ff-c7df-4f9b-ae66-d6c79b8863b2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:51.683933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5e0ce5ff-c7df-4f9b-ae66-d6c79b8863b2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.175450 Aug 01 15:59:51.684510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1702/3079] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:51 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:52.645766 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-25eb77eb-e726-422c-8203-227f2167aae1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:52.646432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-25eb77eb-e726-422c-8203-227f2167aae1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:52.653044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25eb77eb-e726-422c-8203-227f2167aae1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:52.653501 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25eb77eb-e726-422c-8203-227f2167aae1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:52.654302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25eb77eb-e726-422c-8203-227f2167aae1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:52.655240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25eb77eb-e726-422c-8203-227f2167aae1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:52.704661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0b82ec8e-ebbb-42ea-b0a7-12e95388b14b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:52.705275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0b82ec8e-ebbb-42ea-b0a7-12e95388b14b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:52.711902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b82ec8e-ebbb-42ea-b0a7-12e95388b14b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:52.712351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b82ec8e-ebbb-42ea-b0a7-12e95388b14b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:52.713122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b82ec8e-ebbb-42ea-b0a7-12e95388b14b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:52.714309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0b82ec8e-ebbb-42ea-b0a7-12e95388b14b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:52.715964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-25eb77eb-e726-422c-8203-227f2167aae1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:52.719990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:52.725538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-25eb77eb-e726-422c-8203-227f2167aae1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083661 Aug 01 15:59:52.726142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1378/3080] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:52 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:52.852060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0b82ec8e-ebbb-42ea-b0a7-12e95388b14b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:52.861694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0b82ec8e-ebbb-42ea-b0a7-12e95388b14b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.160911 Aug 01 15:59:52.862303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1703/3081] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:52 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:59:53.747845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fb6dd9ae-a830-49cb-976c-832bc35cfd49 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:53.748436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fb6dd9ae-a830-49cb-976c-832bc35cfd49 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:53.755567 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fb6dd9ae-a830-49cb-976c-832bc35cfd49 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:53.756014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fb6dd9ae-a830-49cb-976c-832bc35cfd49 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:53.756777 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fb6dd9ae-a830-49cb-976c-832bc35cfd49 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:53.757214 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fb6dd9ae-a830-49cb-976c-832bc35cfd49 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:53.822201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fb6dd9ae-a830-49cb-976c-832bc35cfd49 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:53.830072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fb6dd9ae-a830-49cb-976c-832bc35cfd49 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086266 Aug 01 15:59:53.830627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1379/3082] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:53 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:53.882966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-67afe480-d7ed-4180-9998-4fa34e68dca9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:53.883578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-67afe480-d7ed-4180-9998-4fa34e68dca9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:53.890147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67afe480-d7ed-4180-9998-4fa34e68dca9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:53.890586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67afe480-d7ed-4180-9998-4fa34e68dca9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:53.891348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67afe480-d7ed-4180-9998-4fa34e68dca9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:53.891779 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67afe480-d7ed-4180-9998-4fa34e68dca9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:54.025847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-67afe480-d7ed-4180-9998-4fa34e68dca9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:54.034356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-67afe480-d7ed-4180-9998-4fa34e68dca9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155196 Aug 01 15:59:54.034947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1704/3083] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:53 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:54.850996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3883086f-4ad2-4e6d-b426-5134c53790aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:54.851736 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3883086f-4ad2-4e6d-b426-5134c53790aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:54.859006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3883086f-4ad2-4e6d-b426-5134c53790aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:54.859461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3883086f-4ad2-4e6d-b426-5134c53790aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:54.860230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3883086f-4ad2-4e6d-b426-5134c53790aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:54.860666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3883086f-4ad2-4e6d-b426-5134c53790aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:54.923532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3883086f-4ad2-4e6d-b426-5134c53790aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:54.931959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3883086f-4ad2-4e6d-b426-5134c53790aa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084935 Aug 01 15:59:54.932530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1380/3084] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:54 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:55.056126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bacf28da-40bf-4a64-8db5-c1a8f1002a41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:55.056740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bacf28da-40bf-4a64-8db5-c1a8f1002a41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:55.064213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bacf28da-40bf-4a64-8db5-c1a8f1002a41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:55.064662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bacf28da-40bf-4a64-8db5-c1a8f1002a41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:55.065433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bacf28da-40bf-4a64-8db5-c1a8f1002a41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:55.065864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bacf28da-40bf-4a64-8db5-c1a8f1002a41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:55.084394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:59:55.199576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bacf28da-40bf-4a64-8db5-c1a8f1002a41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:55.207716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bacf28da-40bf-4a64-8db5-c1a8f1002a41 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155468 Aug 01 15:59:55.208275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1705/3085] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:55 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:55.953314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a6cd623d-f539-4572-ac7d-072d6e8e2f2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:55.953963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a6cd623d-f539-4572-ac7d-072d6e8e2f2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:55.960651 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6cd623d-f539-4572-ac7d-072d6e8e2f2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:55.961095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6cd623d-f539-4572-ac7d-072d6e8e2f2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:55.961848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6cd623d-f539-4572-ac7d-072d6e8e2f2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:55.962306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a6cd623d-f539-4572-ac7d-072d6e8e2f2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:56.034006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a6cd623d-f539-4572-ac7d-072d6e8e2f2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:56.042175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a6cd623d-f539-4572-ac7d-072d6e8e2f2b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.092938 Aug 01 15:59:56.042738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1381/3086] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:55 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:56.228991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c5502073-4170-4229-b480-5f8fdc477dda tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:56.229558 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c5502073-4170-4229-b480-5f8fdc477dda tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:56.236596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5502073-4170-4229-b480-5f8fdc477dda tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:56.237053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5502073-4170-4229-b480-5f8fdc477dda tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:56.237818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5502073-4170-4229-b480-5f8fdc477dda tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:56.238357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c5502073-4170-4229-b480-5f8fdc477dda tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:56.367345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c5502073-4170-4229-b480-5f8fdc477dda tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:56.375348 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c5502073-4170-4229-b480-5f8fdc477dda tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150578 Aug 01 15:59:56.375916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1706/3087] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:56 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:57.073979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-65070806-3abe-41be-9b34-341d034a7fe2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:57.074603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-65070806-3abe-41be-9b34-341d034a7fe2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:57.081827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65070806-3abe-41be-9b34-341d034a7fe2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:57.082333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65070806-3abe-41be-9b34-341d034a7fe2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:57.083094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65070806-3abe-41be-9b34-341d034a7fe2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:57.083532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-65070806-3abe-41be-9b34-341d034a7fe2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:57.145440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-65070806-3abe-41be-9b34-341d034a7fe2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:57.153607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-65070806-3abe-41be-9b34-341d034a7fe2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083667 Aug 01 15:59:57.154197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1382/3088] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:57 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:57.396825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-823f3152-f154-4885-9abc-c9defe804a04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:57.397703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-823f3152-f154-4885-9abc-c9defe804a04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:57.404444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-823f3152-f154-4885-9abc-c9defe804a04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:57.404902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-823f3152-f154-4885-9abc-c9defe804a04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:57.405773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-823f3152-f154-4885-9abc-c9defe804a04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:57.406246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-823f3152-f154-4885-9abc-c9defe804a04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:57.543084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-823f3152-f154-4885-9abc-c9defe804a04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:57.551876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-823f3152-f154-4885-9abc-c9defe804a04 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159048 Aug 01 15:59:57.552364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1707/3089] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:57 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:57.825504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-21994147-927a-406d-86de-efce4226d7d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:57.826025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-21994147-927a-406d-86de-efce4226d7d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:57.832572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21994147-927a-406d-86de-efce4226d7d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:57.833019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21994147-927a-406d-86de-efce4226d7d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:57.833765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21994147-927a-406d-86de-efce4226d7d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:57.834232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-21994147-927a-406d-86de-efce4226d7d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:57.857259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-21994147-927a-406d-86de-efce4226d7d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580/ips" status: 200 len: 151 microversion: 2.20 time: 0.035620 Aug 01 15:59:57.857814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1383/3090] 10.222.0.83 () {60 vars in 1289 bytes} [Mon Aug 1 15:59:57 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:59:58.175268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d0455d8f-7065-456d-9fe6-84de4a81b1eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:58.175880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d0455d8f-7065-456d-9fe6-84de4a81b1eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:58.182019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0455d8f-7065-456d-9fe6-84de4a81b1eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:58.182476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0455d8f-7065-456d-9fe6-84de4a81b1eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:58.183244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0455d8f-7065-456d-9fe6-84de4a81b1eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:58.183682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0455d8f-7065-456d-9fe6-84de4a81b1eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:58.244774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d0455d8f-7065-456d-9fe6-84de4a81b1eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:58.253265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d0455d8f-7065-456d-9fe6-84de4a81b1eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.081977 Aug 01 15:59:58.253833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1708/3091] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:58 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:58.572629 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0fdbb14c-04a6-4690-a199-56f69881d65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:58.573319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0fdbb14c-04a6-4690-a199-56f69881d65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:58.579948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0fdbb14c-04a6-4690-a199-56f69881d65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:58.580403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0fdbb14c-04a6-4690-a199-56f69881d65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:58.581163 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0fdbb14c-04a6-4690-a199-56f69881d65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:58.581607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0fdbb14c-04a6-4690-a199-56f69881d65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:58.713492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0fdbb14c-04a6-4690-a199-56f69881d65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:58.721827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0fdbb14c-04a6-4690-a199-56f69881d65c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153068 Aug 01 15:59:58.722420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1384/3092] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:58 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:59.274793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aa8742fd-4f2d-49c5-9a99-bbea8c54512e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:59.275404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aa8742fd-4f2d-49c5-9a99-bbea8c54512e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:59.282012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa8742fd-4f2d-49c5-9a99-bbea8c54512e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:59.282460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa8742fd-4f2d-49c5-9a99-bbea8c54512e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:59.283216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa8742fd-4f2d-49c5-9a99-bbea8c54512e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:59.283648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aa8742fd-4f2d-49c5-9a99-bbea8c54512e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:59.345314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aa8742fd-4f2d-49c5-9a99-bbea8c54512e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:59.353619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aa8742fd-4f2d-49c5-9a99-bbea8c54512e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082671 Aug 01 15:59:59.354229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1709/3093] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:59 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:59:59.743914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-551960f8-edf1-4ec9-9a0e-4146796d6ab8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:59:59.744521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-551960f8-edf1-4ec9-9a0e-4146796d6ab8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:59:59.751140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-551960f8-edf1-4ec9-9a0e-4146796d6ab8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:59.751588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-551960f8-edf1-4ec9-9a0e-4146796d6ab8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:59.752345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-551960f8-edf1-4ec9-9a0e-4146796d6ab8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:59:59.752784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-551960f8-edf1-4ec9-9a0e-4146796d6ab8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:59:59.880999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-551960f8-edf1-4ec9-9a0e-4146796d6ab8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:59:59.889047 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-551960f8-edf1-4ec9-9a0e-4146796d6ab8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.149036 Aug 01 15:59:59.889604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1385/3094] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 15:59:59 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:00.375044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6b27efc1-df1f-4cfc-9929-77b80fbc5b05 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:00.376152 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6b27efc1-df1f-4cfc-9929-77b80fbc5b05 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:00.382755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b27efc1-df1f-4cfc-9929-77b80fbc5b05 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:00.383196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b27efc1-df1f-4cfc-9929-77b80fbc5b05 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:00.383948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b27efc1-df1f-4cfc-9929-77b80fbc5b05 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:00.384382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6b27efc1-df1f-4cfc-9929-77b80fbc5b05 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:00.444999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6b27efc1-df1f-4cfc-9929-77b80fbc5b05 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:00.452964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6b27efc1-df1f-4cfc-9929-77b80fbc5b05 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.081749 Aug 01 16:00:00.454300 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1710/3095] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:00 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:00.910589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a8ace516-9eb6-471f-bcc2-757fc1afdcb4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:00.911190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a8ace516-9eb6-471f-bcc2-757fc1afdcb4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:00.918057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a8ace516-9eb6-471f-bcc2-757fc1afdcb4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:00.918505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a8ace516-9eb6-471f-bcc2-757fc1afdcb4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:00.919262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a8ace516-9eb6-471f-bcc2-757fc1afdcb4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:00.919698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a8ace516-9eb6-471f-bcc2-757fc1afdcb4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:01.055576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a8ace516-9eb6-471f-bcc2-757fc1afdcb4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:01.064374 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a8ace516-9eb6-471f-bcc2-757fc1afdcb4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.157703 Aug 01 16:00:01.064943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1386/3096] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:00 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:01.587156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d2572901-8bed-4a8c-bd77-4d0de57af0c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:01.587803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d2572901-8bed-4a8c-bd77-4d0de57af0c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:01.593835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2572901-8bed-4a8c-bd77-4d0de57af0c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:01.594939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2572901-8bed-4a8c-bd77-4d0de57af0c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:01.595707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2572901-8bed-4a8c-bd77-4d0de57af0c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:01.596143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2572901-8bed-4a8c-bd77-4d0de57af0c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:01.816765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d2572901-8bed-4a8c-bd77-4d0de57af0c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:01.825051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d2572901-8bed-4a8c-bd77-4d0de57af0c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.353855 Aug 01 16:00:01.825616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1711/3097] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:01 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:02.086420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-29683128-599d-4f80-ad6c-ecbd0871b85b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:02.087002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-29683128-599d-4f80-ad6c-ecbd0871b85b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:02.093575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-29683128-599d-4f80-ad6c-ecbd0871b85b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:02.094059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-29683128-599d-4f80-ad6c-ecbd0871b85b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:02.094829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-29683128-599d-4f80-ad6c-ecbd0871b85b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:02.095268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-29683128-599d-4f80-ad6c-ecbd0871b85b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:02.227525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-29683128-599d-4f80-ad6c-ecbd0871b85b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:02.236658 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-29683128-599d-4f80-ad6c-ecbd0871b85b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154174 Aug 01 16:00:02.237244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1387/3098] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:02 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:02.846931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bdee0d6e-7212-4a76-ace9-5a7c0db55c6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:02.847488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bdee0d6e-7212-4a76-ace9-5a7c0db55c6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:02.854210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bdee0d6e-7212-4a76-ace9-5a7c0db55c6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:02.854648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bdee0d6e-7212-4a76-ace9-5a7c0db55c6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:02.855393 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bdee0d6e-7212-4a76-ace9-5a7c0db55c6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:02.855830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bdee0d6e-7212-4a76-ace9-5a7c0db55c6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:02.916400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bdee0d6e-7212-4a76-ace9-5a7c0db55c6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:02.925068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bdee0d6e-7212-4a76-ace9-5a7c0db55c6a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082533 Aug 01 16:00:02.925629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1712/3099] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:02 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:03.259508 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-33c7fbe2-6625-4332-8a4e-7ce6e6f5888f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:03.260115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-33c7fbe2-6625-4332-8a4e-7ce6e6f5888f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:03.267225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-33c7fbe2-6625-4332-8a4e-7ce6e6f5888f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:03.267670 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-33c7fbe2-6625-4332-8a4e-7ce6e6f5888f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:03.268417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-33c7fbe2-6625-4332-8a4e-7ce6e6f5888f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:03.268845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-33c7fbe2-6625-4332-8a4e-7ce6e6f5888f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:03.399344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-33c7fbe2-6625-4332-8a4e-7ce6e6f5888f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:03.407386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-33c7fbe2-6625-4332-8a4e-7ce6e6f5888f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151686 Aug 01 16:00:03.407965 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1388/3100] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:03 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:03.946162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aefb79df-283e-4456-b92f-368c4c45cc38 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:03.946832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aefb79df-283e-4456-b92f-368c4c45cc38 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:03.953455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aefb79df-283e-4456-b92f-368c4c45cc38 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:03.953932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aefb79df-283e-4456-b92f-368c4c45cc38 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:03.954736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aefb79df-283e-4456-b92f-368c4c45cc38 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:03.955178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aefb79df-283e-4456-b92f-368c4c45cc38 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:04.018652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aefb79df-283e-4456-b92f-368c4c45cc38 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:04.026522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aefb79df-283e-4456-b92f-368c4c45cc38 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084329 Aug 01 16:00:04.027072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1713/3101] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:03 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:04.428568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-efcff63e-45e5-4803-afd2-db47ddfb2962 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:04.429185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-efcff63e-45e5-4803-afd2-db47ddfb2962 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:04.435859 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-efcff63e-45e5-4803-afd2-db47ddfb2962 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:04.436306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-efcff63e-45e5-4803-afd2-db47ddfb2962 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:04.437066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-efcff63e-45e5-4803-afd2-db47ddfb2962 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:04.437505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-efcff63e-45e5-4803-afd2-db47ddfb2962 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:04.567371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-efcff63e-45e5-4803-afd2-db47ddfb2962 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:04.575487 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-efcff63e-45e5-4803-afd2-db47ddfb2962 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150816 Aug 01 16:00:04.576049 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1389/3102] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:04 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:05.047173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-89b7482f-158c-4641-8a98-60ade2e195fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:05.047896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-89b7482f-158c-4641-8a98-60ade2e195fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:05.055035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89b7482f-158c-4641-8a98-60ade2e195fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:05.055035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89b7482f-158c-4641-8a98-60ade2e195fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:05.055670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89b7482f-158c-4641-8a98-60ade2e195fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:05.056102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89b7482f-158c-4641-8a98-60ade2e195fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:05.118336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-89b7482f-158c-4641-8a98-60ade2e195fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:05.126787 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-89b7482f-158c-4641-8a98-60ade2e195fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083519 Aug 01 16:00:05.127335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1714/3103] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:05 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:05.597391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ea5594e0-fa36-49c4-b830-30bccdf5ff9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:05.598024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ea5594e0-fa36-49c4-b830-30bccdf5ff9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:05.604858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ea5594e0-fa36-49c4-b830-30bccdf5ff9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:05.605271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ea5594e0-fa36-49c4-b830-30bccdf5ff9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:05.606077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ea5594e0-fa36-49c4-b830-30bccdf5ff9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:05.606510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ea5594e0-fa36-49c4-b830-30bccdf5ff9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:05.739184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ea5594e0-fa36-49c4-b830-30bccdf5ff9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:05.747134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ea5594e0-fa36-49c4-b830-30bccdf5ff9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154243 Aug 01 16:00:05.747797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1390/3104] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:05 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:06.147792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e59614b9-421b-41b9-800b-0203f32e08e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:06.149256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e59614b9-421b-41b9-800b-0203f32e08e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:06.151985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=54 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:06.158064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e59614b9-421b-41b9-800b-0203f32e08e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:06.158513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e59614b9-421b-41b9-800b-0203f32e08e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:06.159278 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e59614b9-421b-41b9-800b-0203f32e08e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:06.159713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e59614b9-421b-41b9-800b-0203f32e08e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:06.224820 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e59614b9-421b-41b9-800b-0203f32e08e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:06.233141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e59614b9-421b-41b9-800b-0203f32e08e5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.089584 Aug 01 16:00:06.233706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1715/3105] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:06 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:06.768610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-721738c8-babd-44bf-b1a5-5503159791f0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:06.769219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-721738c8-babd-44bf-b1a5-5503159791f0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:06.775980 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-721738c8-babd-44bf-b1a5-5503159791f0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:06.776425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-721738c8-babd-44bf-b1a5-5503159791f0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:06.777182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-721738c8-babd-44bf-b1a5-5503159791f0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:06.777612 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-721738c8-babd-44bf-b1a5-5503159791f0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:06.907548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-721738c8-babd-44bf-b1a5-5503159791f0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:06.916281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-721738c8-babd-44bf-b1a5-5503159791f0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151438 Aug 01 16:00:06.916856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1391/3106] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:06 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:07.254461 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c9646f24-c52e-4729-ba83-f330c6dd1dd5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:07.255181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c9646f24-c52e-4729-ba83-f330c6dd1dd5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:07.262312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9646f24-c52e-4729-ba83-f330c6dd1dd5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:07.262756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9646f24-c52e-4729-ba83-f330c6dd1dd5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:07.263514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9646f24-c52e-4729-ba83-f330c6dd1dd5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:07.263940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c9646f24-c52e-4729-ba83-f330c6dd1dd5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:07.324939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c9646f24-c52e-4729-ba83-f330c6dd1dd5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:07.333116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c9646f24-c52e-4729-ba83-f330c6dd1dd5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082957 Aug 01 16:00:07.333668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1716/3107] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:07 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:07.939287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-490b1c44-ceb0-49cb-bef7-6654a3c699f2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:07.940009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-490b1c44-ceb0-49cb-bef7-6654a3c699f2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:07.946825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-490b1c44-ceb0-49cb-bef7-6654a3c699f2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:07.947281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-490b1c44-ceb0-49cb-bef7-6654a3c699f2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:07.948047 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-490b1c44-ceb0-49cb-bef7-6654a3c699f2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:07.948488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-490b1c44-ceb0-49cb-bef7-6654a3c699f2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:08.097284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-490b1c44-ceb0-49cb-bef7-6654a3c699f2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:08.105652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-490b1c44-ceb0-49cb-bef7-6654a3c699f2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.171273 Aug 01 16:00:08.106329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1392/3108] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:07 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:08.355321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7c2fec4a-1a1c-43d0-bdf7-d1f9842c808e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:08.355899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7c2fec4a-1a1c-43d0-bdf7-d1f9842c808e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:08.362957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c2fec4a-1a1c-43d0-bdf7-d1f9842c808e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:08.363406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c2fec4a-1a1c-43d0-bdf7-d1f9842c808e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:08.364170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c2fec4a-1a1c-43d0-bdf7-d1f9842c808e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:08.364606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7c2fec4a-1a1c-43d0-bdf7-d1f9842c808e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:08.429189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7c2fec4a-1a1c-43d0-bdf7-d1f9842c808e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:08.437584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7c2fec4a-1a1c-43d0-bdf7-d1f9842c808e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086436 Aug 01 16:00:08.438874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1717/3109] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:08 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:09.126645 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-237f57bd-1022-41e0-8b0c-b3b0ec483e3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:09.127245 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-237f57bd-1022-41e0-8b0c-b3b0ec483e3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:09.133535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-237f57bd-1022-41e0-8b0c-b3b0ec483e3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:09.134011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-237f57bd-1022-41e0-8b0c-b3b0ec483e3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:09.134760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-237f57bd-1022-41e0-8b0c-b3b0ec483e3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:09.135189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-237f57bd-1022-41e0-8b0c-b3b0ec483e3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:09.264375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-237f57bd-1022-41e0-8b0c-b3b0ec483e3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:09.272583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-237f57bd-1022-41e0-8b0c-b3b0ec483e3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.149748 Aug 01 16:00:09.273150 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1393/3110] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:09 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:09.459782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-578c16af-4a8f-4b36-8690-5ab974aa4f92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:09.460398 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-578c16af-4a8f-4b36-8690-5ab974aa4f92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:09.466998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-578c16af-4a8f-4b36-8690-5ab974aa4f92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:09.467449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-578c16af-4a8f-4b36-8690-5ab974aa4f92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:09.468210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-578c16af-4a8f-4b36-8690-5ab974aa4f92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:09.468649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-578c16af-4a8f-4b36-8690-5ab974aa4f92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:09.529203 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-578c16af-4a8f-4b36-8690-5ab974aa4f92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:09.539603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-578c16af-4a8f-4b36-8690-5ab974aa4f92 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084213 Aug 01 16:00:09.540184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1718/3111] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:09 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:10.294354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e9a1ab45-5db3-47de-9542-eb6fe501fce9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:10.294907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e9a1ab45-5db3-47de-9542-eb6fe501fce9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:10.302261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9a1ab45-5db3-47de-9542-eb6fe501fce9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:10.302706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9a1ab45-5db3-47de-9542-eb6fe501fce9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:10.303454 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9a1ab45-5db3-47de-9542-eb6fe501fce9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:10.303885 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9a1ab45-5db3-47de-9542-eb6fe501fce9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:10.434808 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e9a1ab45-5db3-47de-9542-eb6fe501fce9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:10.443470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e9a1ab45-5db3-47de-9542-eb6fe501fce9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153032 Aug 01 16:00:10.444037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1394/3112] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:10 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:10.560516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8f8baf94-2103-437e-9410-fd200c71e54c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:10.561121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8f8baf94-2103-437e-9410-fd200c71e54c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:10.567727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f8baf94-2103-437e-9410-fd200c71e54c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:10.568169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f8baf94-2103-437e-9410-fd200c71e54c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:10.568917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f8baf94-2103-437e-9410-fd200c71e54c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:10.569351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f8baf94-2103-437e-9410-fd200c71e54c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:10.634884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f8baf94-2103-437e-9410-fd200c71e54c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:10.643688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8f8baf94-2103-437e-9410-fd200c71e54c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087020 Aug 01 16:00:10.644284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1719/3113] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:10 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:11.465044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-759394ae-8db2-48a6-b4c3-e531fd70ed80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:11.465684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-759394ae-8db2-48a6-b4c3-e531fd70ed80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:11.472346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-759394ae-8db2-48a6-b4c3-e531fd70ed80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:11.472808 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-759394ae-8db2-48a6-b4c3-e531fd70ed80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:11.473538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-759394ae-8db2-48a6-b4c3-e531fd70ed80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:11.473995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-759394ae-8db2-48a6-b4c3-e531fd70ed80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:11.610489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-759394ae-8db2-48a6-b4c3-e531fd70ed80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:11.614572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:11.620012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-759394ae-8db2-48a6-b4c3-e531fd70ed80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.158837 Aug 01 16:00:11.620574 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1395/3114] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:11 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:11.665653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5210e7a4-a2f5-4513-9419-b6c6248782e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:11.666293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5210e7a4-a2f5-4513-9419-b6c6248782e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:11.672781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5210e7a4-a2f5-4513-9419-b6c6248782e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:11.673223 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5210e7a4-a2f5-4513-9419-b6c6248782e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:11.674009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5210e7a4-a2f5-4513-9419-b6c6248782e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:11.674443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5210e7a4-a2f5-4513-9419-b6c6248782e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:11.736223 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5210e7a4-a2f5-4513-9419-b6c6248782e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:11.744969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5210e7a4-a2f5-4513-9419-b6c6248782e6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083211 Aug 01 16:00:11.745542 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1720/3115] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:11 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:12.642280 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-41332640-323f-4a44-b0fa-38b95cc73845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:12.642902 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-41332640-323f-4a44-b0fa-38b95cc73845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:12.649776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41332640-323f-4a44-b0fa-38b95cc73845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:12.650268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41332640-323f-4a44-b0fa-38b95cc73845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:12.651443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41332640-323f-4a44-b0fa-38b95cc73845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:12.651667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-41332640-323f-4a44-b0fa-38b95cc73845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:12.766525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-400e80ca-0731-46c4-b358-45343df2fb03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:12.767262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-400e80ca-0731-46c4-b358-45343df2fb03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:12.773800 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-400e80ca-0731-46c4-b358-45343df2fb03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:12.774328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-400e80ca-0731-46c4-b358-45343df2fb03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:12.775053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-400e80ca-0731-46c4-b358-45343df2fb03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:12.775493 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-400e80ca-0731-46c4-b358-45343df2fb03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:12.788471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-41332640-323f-4a44-b0fa-38b95cc73845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:12.796967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-41332640-323f-4a44-b0fa-38b95cc73845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.158840 Aug 01 16:00:12.797557 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1396/3116] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:12 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:12.840305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-400e80ca-0731-46c4-b358-45343df2fb03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:12.848909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-400e80ca-0731-46c4-b358-45343df2fb03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086318 Aug 01 16:00:12.849479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1721/3117] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:12 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:13.819683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ce89d03f-c5c6-4dfc-b8ed-bd81e676807d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:13.820282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ce89d03f-c5c6-4dfc-b8ed-bd81e676807d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:13.822611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=56 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:13.827937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ce89d03f-c5c6-4dfc-b8ed-bd81e676807d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:13.828400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ce89d03f-c5c6-4dfc-b8ed-bd81e676807d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:13.829151 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ce89d03f-c5c6-4dfc-b8ed-bd81e676807d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:13.829586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ce89d03f-c5c6-4dfc-b8ed-bd81e676807d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:13.869924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-534eb454-12a1-4c9b-9cb8-6f4d2e7a3491 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:13.870640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-534eb454-12a1-4c9b-9cb8-6f4d2e7a3491 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:13.877183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-534eb454-12a1-4c9b-9cb8-6f4d2e7a3491 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:13.877626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-534eb454-12a1-4c9b-9cb8-6f4d2e7a3491 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:13.879111 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-534eb454-12a1-4c9b-9cb8-6f4d2e7a3491 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:13.879548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-534eb454-12a1-4c9b-9cb8-6f4d2e7a3491 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:13.883674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:13.951114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-534eb454-12a1-4c9b-9cb8-6f4d2e7a3491 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:13.959157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-534eb454-12a1-4c9b-9cb8-6f4d2e7a3491 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.093024 Aug 01 16:00:13.959745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1722/3118] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:13 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:13.980251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ce89d03f-c5c6-4dfc-b8ed-bd81e676807d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:13.988752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ce89d03f-c5c6-4dfc-b8ed-bd81e676807d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.173486 Aug 01 16:00:13.989325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1397/3119] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:13 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:14.980693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d3ae3746-4d7e-4741-b3fe-0f91eebd73fb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:14.981339 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d3ae3746-4d7e-4741-b3fe-0f91eebd73fb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:14.988003 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3ae3746-4d7e-4741-b3fe-0f91eebd73fb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:14.988452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3ae3746-4d7e-4741-b3fe-0f91eebd73fb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:14.989222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3ae3746-4d7e-4741-b3fe-0f91eebd73fb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:14.989661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3ae3746-4d7e-4741-b3fe-0f91eebd73fb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:15.010413 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fc90e9c9-d8a9-449f-a2f2-34eaea930c35 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:15.011038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fc90e9c9-d8a9-449f-a2f2-34eaea930c35 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:15.017612 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc90e9c9-d8a9-449f-a2f2-34eaea930c35 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:15.018111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc90e9c9-d8a9-449f-a2f2-34eaea930c35 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:15.018969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc90e9c9-d8a9-449f-a2f2-34eaea930c35 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:15.020003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc90e9c9-d8a9-449f-a2f2-34eaea930c35 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:15.069632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d3ae3746-4d7e-4741-b3fe-0f91eebd73fb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:15.077795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d3ae3746-4d7e-4741-b3fe-0f91eebd73fb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.101170 Aug 01 16:00:15.078473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1723/3120] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:14 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:15.157936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fc90e9c9-d8a9-449f-a2f2-34eaea930c35 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:15.165794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fc90e9c9-d8a9-449f-a2f2-34eaea930c35 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159329 Aug 01 16:00:15.166375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1398/3121] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:15 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:16.100323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a4556f0e-f915-4c7b-aa72-60e1bf47f7b7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:16.100933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a4556f0e-f915-4c7b-aa72-60e1bf47f7b7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:16.110347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4556f0e-f915-4c7b-aa72-60e1bf47f7b7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:16.110804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4556f0e-f915-4c7b-aa72-60e1bf47f7b7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:16.111695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4556f0e-f915-4c7b-aa72-60e1bf47f7b7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:16.112013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a4556f0e-f915-4c7b-aa72-60e1bf47f7b7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:16.173483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a4556f0e-f915-4c7b-aa72-60e1bf47f7b7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:16.181860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a4556f0e-f915-4c7b-aa72-60e1bf47f7b7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086111 Aug 01 16:00:16.182843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1724/3122] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:16 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:16.186630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-80bc71be-1aba-4038-b326-0609c473aa9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:16.187276 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-80bc71be-1aba-4038-b326-0609c473aa9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:16.194288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80bc71be-1aba-4038-b326-0609c473aa9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:16.194745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80bc71be-1aba-4038-b326-0609c473aa9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:16.195517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80bc71be-1aba-4038-b326-0609c473aa9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:16.195976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-80bc71be-1aba-4038-b326-0609c473aa9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:16.331038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-80bc71be-1aba-4038-b326-0609c473aa9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:16.339764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-80bc71be-1aba-4038-b326-0609c473aa9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.157163 Aug 01 16:00:16.340324 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1399/3123] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:16 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:17.203633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-23d0bf46-cec5-4e1b-bdb7-546bb1c21d9a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:17.204245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-23d0bf46-cec5-4e1b-bdb7-546bb1c21d9a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:17.210858 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23d0bf46-cec5-4e1b-bdb7-546bb1c21d9a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:17.211307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23d0bf46-cec5-4e1b-bdb7-546bb1c21d9a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:17.212076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23d0bf46-cec5-4e1b-bdb7-546bb1c21d9a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:17.212513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-23d0bf46-cec5-4e1b-bdb7-546bb1c21d9a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:17.273826 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-23d0bf46-cec5-4e1b-bdb7-546bb1c21d9a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:17.282115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-23d0bf46-cec5-4e1b-bdb7-546bb1c21d9a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082314 Aug 01 16:00:17.282686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1725/3124] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:17 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:17.362613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8746af94-d37a-41db-9c54-138b24f77651 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:17.363861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8746af94-d37a-41db-9c54-138b24f77651 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:17.370455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8746af94-d37a-41db-9c54-138b24f77651 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:17.370897 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8746af94-d37a-41db-9c54-138b24f77651 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:17.371690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8746af94-d37a-41db-9c54-138b24f77651 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:17.372117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8746af94-d37a-41db-9c54-138b24f77651 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:17.519876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8746af94-d37a-41db-9c54-138b24f77651 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:17.528930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8746af94-d37a-41db-9c54-138b24f77651 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.170266 Aug 01 16:00:17.529495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1400/3125] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:17 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:18.304076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bd14a2e3-0704-46c9-a7f5-af88c4f11f54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:18.304710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bd14a2e3-0704-46c9-a7f5-af88c4f11f54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:18.311186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd14a2e3-0704-46c9-a7f5-af88c4f11f54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:18.311630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd14a2e3-0704-46c9-a7f5-af88c4f11f54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:18.312418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd14a2e3-0704-46c9-a7f5-af88c4f11f54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:18.312852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd14a2e3-0704-46c9-a7f5-af88c4f11f54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:18.377477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bd14a2e3-0704-46c9-a7f5-af88c4f11f54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:18.386221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bd14a2e3-0704-46c9-a7f5-af88c4f11f54 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086624 Aug 01 16:00:18.386803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1726/3126] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:18 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:18.553480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ca443271-41c4-4a8f-b990-b44555a13134 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:18.554132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ca443271-41c4-4a8f-b990-b44555a13134 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:18.560737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca443271-41c4-4a8f-b990-b44555a13134 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:18.561115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca443271-41c4-4a8f-b990-b44555a13134 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:18.561863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca443271-41c4-4a8f-b990-b44555a13134 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:18.562320 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca443271-41c4-4a8f-b990-b44555a13134 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:18.693296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ca443271-41c4-4a8f-b990-b44555a13134 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:18.701183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ca443271-41c4-4a8f-b990-b44555a13134 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152174 Aug 01 16:00:18.701737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1401/3127] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:18 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:19.407642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bac54cac-3695-4f8c-b83b-390bcd78c149 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:19.408257 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bac54cac-3695-4f8c-b83b-390bcd78c149 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:19.415022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bac54cac-3695-4f8c-b83b-390bcd78c149 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:19.415477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bac54cac-3695-4f8c-b83b-390bcd78c149 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:19.416238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bac54cac-3695-4f8c-b83b-390bcd78c149 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:19.416682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bac54cac-3695-4f8c-b83b-390bcd78c149 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:19.477610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bac54cac-3695-4f8c-b83b-390bcd78c149 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:19.485735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bac54cac-3695-4f8c-b83b-390bcd78c149 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082140 Aug 01 16:00:19.486318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1727/3128] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:19 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:19.723589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8af308a0-0e95-4105-90fc-8b6808aae9b5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:19.724177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8af308a0-0e95-4105-90fc-8b6808aae9b5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:19.731353 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8af308a0-0e95-4105-90fc-8b6808aae9b5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:19.731798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8af308a0-0e95-4105-90fc-8b6808aae9b5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:19.732565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8af308a0-0e95-4105-90fc-8b6808aae9b5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:19.732997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8af308a0-0e95-4105-90fc-8b6808aae9b5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:19.869463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8af308a0-0e95-4105-90fc-8b6808aae9b5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:19.877660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8af308a0-0e95-4105-90fc-8b6808aae9b5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.157872 Aug 01 16:00:19.878338 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1402/3129] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:19 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:20.506891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8b0718df-60cf-493d-a9ff-6ff3c3409357 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:20.507535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8b0718df-60cf-493d-a9ff-6ff3c3409357 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:20.518272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b0718df-60cf-493d-a9ff-6ff3c3409357 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:20.518741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b0718df-60cf-493d-a9ff-6ff3c3409357 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:20.519536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b0718df-60cf-493d-a9ff-6ff3c3409357 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:20.519979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b0718df-60cf-493d-a9ff-6ff3c3409357 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:20.585444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8b0718df-60cf-493d-a9ff-6ff3c3409357 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:20.593574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8b0718df-60cf-493d-a9ff-6ff3c3409357 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.090586 Aug 01 16:00:20.594179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1728/3130] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:20 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:20.899318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1b92aff4-7a2a-46b8-9a61-44616c95d2db tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:20.900023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1b92aff4-7a2a-46b8-9a61-44616c95d2db tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:20.906802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b92aff4-7a2a-46b8-9a61-44616c95d2db tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:20.907247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b92aff4-7a2a-46b8-9a61-44616c95d2db tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:20.908012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b92aff4-7a2a-46b8-9a61-44616c95d2db tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:20.908444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b92aff4-7a2a-46b8-9a61-44616c95d2db tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:21.040362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1b92aff4-7a2a-46b8-9a61-44616c95d2db tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:21.048365 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1b92aff4-7a2a-46b8-9a61-44616c95d2db tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152915 Aug 01 16:00:21.048929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1403/3131] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:20 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:21.616419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8ad72439-434a-4ee7-8aac-c80d44937826 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:21.617085 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8ad72439-434a-4ee7-8aac-c80d44937826 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:21.624410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ad72439-434a-4ee7-8aac-c80d44937826 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:21.624864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ad72439-434a-4ee7-8aac-c80d44937826 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:21.625642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ad72439-434a-4ee7-8aac-c80d44937826 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:21.626131 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8ad72439-434a-4ee7-8aac-c80d44937826 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:21.696360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8ad72439-434a-4ee7-8aac-c80d44937826 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:21.704784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8ad72439-434a-4ee7-8aac-c80d44937826 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.092260 Aug 01 16:00:21.705363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1729/3132] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:21 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:22.070380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b33f110a-e1ae-4759-8b1a-ee43dd44b655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:22.071014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b33f110a-e1ae-4759-8b1a-ee43dd44b655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:22.077775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b33f110a-e1ae-4759-8b1a-ee43dd44b655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:22.078263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b33f110a-e1ae-4759-8b1a-ee43dd44b655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:22.079021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b33f110a-e1ae-4759-8b1a-ee43dd44b655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:22.079456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b33f110a-e1ae-4759-8b1a-ee43dd44b655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:22.210317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b33f110a-e1ae-4759-8b1a-ee43dd44b655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:22.218801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b33f110a-e1ae-4759-8b1a-ee43dd44b655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152279 Aug 01 16:00:22.219398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1404/3133] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:22 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:22.726640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2a2f30f7-bd72-49bb-aa76-0eb9b6f256db tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:22.727255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2a2f30f7-bd72-49bb-aa76-0eb9b6f256db tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:22.734316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a2f30f7-bd72-49bb-aa76-0eb9b6f256db tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:22.734771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a2f30f7-bd72-49bb-aa76-0eb9b6f256db tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:22.735999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a2f30f7-bd72-49bb-aa76-0eb9b6f256db tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:22.736451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a2f30f7-bd72-49bb-aa76-0eb9b6f256db tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:22.799988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2a2f30f7-bd72-49bb-aa76-0eb9b6f256db tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:22.808472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2a2f30f7-bd72-49bb-aa76-0eb9b6f256db tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085721 Aug 01 16:00:22.808960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1730/3134] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:22 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:23.242520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c3ab781f-2ac9-4b46-9443-7f3291528738 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:23.243846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c3ab781f-2ac9-4b46-9443-7f3291528738 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:23.250808 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3ab781f-2ac9-4b46-9443-7f3291528738 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:23.251263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3ab781f-2ac9-4b46-9443-7f3291528738 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:23.252033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3ab781f-2ac9-4b46-9443-7f3291528738 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:23.252475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c3ab781f-2ac9-4b46-9443-7f3291528738 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:23.385329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c3ab781f-2ac9-4b46-9443-7f3291528738 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:23.393654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c3ab781f-2ac9-4b46-9443-7f3291528738 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155462 Aug 01 16:00:23.394284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1405/3135] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:23 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:23.829619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7033d3de-2581-4eca-b121-9293dbd86fb4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:23.830308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7033d3de-2581-4eca-b121-9293dbd86fb4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:23.838253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7033d3de-2581-4eca-b121-9293dbd86fb4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:23.838789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7033d3de-2581-4eca-b121-9293dbd86fb4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:23.839557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7033d3de-2581-4eca-b121-9293dbd86fb4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:23.840017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7033d3de-2581-4eca-b121-9293dbd86fb4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:23.909409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7033d3de-2581-4eca-b121-9293dbd86fb4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:23.918151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7033d3de-2581-4eca-b121-9293dbd86fb4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.092672 Aug 01 16:00:23.918798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1731/3136] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:23 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:24.415821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f5e95622-71cb-42d2-b79c-42905318242e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:24.416535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f5e95622-71cb-42d2-b79c-42905318242e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:24.423628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f5e95622-71cb-42d2-b79c-42905318242e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:24.424082 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f5e95622-71cb-42d2-b79c-42905318242e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:24.424849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f5e95622-71cb-42d2-b79c-42905318242e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:24.425301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f5e95622-71cb-42d2-b79c-42905318242e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:24.558306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f5e95622-71cb-42d2-b79c-42905318242e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:24.566447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f5e95622-71cb-42d2-b79c-42905318242e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154940 Aug 01 16:00:24.567039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1406/3137] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:24 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:24.940488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c44d4200-6064-47c6-a309-843762687fac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:24.941198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c44d4200-6064-47c6-a309-843762687fac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:24.947634 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c44d4200-6064-47c6-a309-843762687fac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:24.948080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c44d4200-6064-47c6-a309-843762687fac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:24.948839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c44d4200-6064-47c6-a309-843762687fac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:24.949270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c44d4200-6064-47c6-a309-843762687fac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:25.012788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c44d4200-6064-47c6-a309-843762687fac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:25.020794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c44d4200-6064-47c6-a309-843762687fac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084187 Aug 01 16:00:25.021354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1732/3138] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:24 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:25.589822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-52ef69a4-97f7-4bc3-b963-56b533f8208a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:25.590542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-52ef69a4-97f7-4bc3-b963-56b533f8208a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:25.596979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52ef69a4-97f7-4bc3-b963-56b533f8208a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:25.597429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52ef69a4-97f7-4bc3-b963-56b533f8208a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:25.598228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52ef69a4-97f7-4bc3-b963-56b533f8208a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:25.598669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52ef69a4-97f7-4bc3-b963-56b533f8208a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:25.730332 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-52ef69a4-97f7-4bc3-b963-56b533f8208a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:25.738235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-52ef69a4-97f7-4bc3-b963-56b533f8208a tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153010 Aug 01 16:00:25.738792 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1407/3139] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:25 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:26.042593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c829fe64-4b15-4e61-ac2c-adf069b39280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:26.043828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c829fe64-4b15-4e61-ac2c-adf069b39280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:26.050492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c829fe64-4b15-4e61-ac2c-adf069b39280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:26.050998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c829fe64-4b15-4e61-ac2c-adf069b39280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:26.051726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c829fe64-4b15-4e61-ac2c-adf069b39280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:26.052167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c829fe64-4b15-4e61-ac2c-adf069b39280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:26.115090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c829fe64-4b15-4e61-ac2c-adf069b39280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:26.124807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c829fe64-4b15-4e61-ac2c-adf069b39280 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085930 Aug 01 16:00:26.125383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1733/3140] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:26 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:26.759410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5ad4b4bf-f7d5-40b7-8bf3-4169c0a09a9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:26.759993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5ad4b4bf-f7d5-40b7-8bf3-4169c0a09a9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:26.767423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ad4b4bf-f7d5-40b7-8bf3-4169c0a09a9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:26.768012 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ad4b4bf-f7d5-40b7-8bf3-4169c0a09a9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:26.769191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ad4b4bf-f7d5-40b7-8bf3-4169c0a09a9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:26.769576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5ad4b4bf-f7d5-40b7-8bf3-4169c0a09a9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:26.903252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5ad4b4bf-f7d5-40b7-8bf3-4169c0a09a9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:26.912412 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5ad4b4bf-f7d5-40b7-8bf3-4169c0a09a9f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156767 Aug 01 16:00:26.913014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1408/3141] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:26 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:27.145154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eaa45f31-43ab-4d13-a5de-ec32ff7f8336 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:27.145772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eaa45f31-43ab-4d13-a5de-ec32ff7f8336 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:27.153290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaa45f31-43ab-4d13-a5de-ec32ff7f8336 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:27.153745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaa45f31-43ab-4d13-a5de-ec32ff7f8336 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:27.154555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaa45f31-43ab-4d13-a5de-ec32ff7f8336 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:27.155236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaa45f31-43ab-4d13-a5de-ec32ff7f8336 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:27.219449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eaa45f31-43ab-4d13-a5de-ec32ff7f8336 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:27.227377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eaa45f31-43ab-4d13-a5de-ec32ff7f8336 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086106 Aug 01 16:00:27.227935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1734/3142] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:27 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:27.934954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-049a57ed-0188-47af-813c-abe0575dfde0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:27.935557 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-049a57ed-0188-47af-813c-abe0575dfde0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:27.942698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-049a57ed-0188-47af-813c-abe0575dfde0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:27.943138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-049a57ed-0188-47af-813c-abe0575dfde0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:27.943970 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-049a57ed-0188-47af-813c-abe0575dfde0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:27.944355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-049a57ed-0188-47af-813c-abe0575dfde0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:28.076366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-049a57ed-0188-47af-813c-abe0575dfde0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:28.084578 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-049a57ed-0188-47af-813c-abe0575dfde0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154189 Aug 01 16:00:28.085184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1409/3143] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:27 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:28.248725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-89611b72-625d-41c6-be18-cc4f3497e00f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:28.249335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-89611b72-625d-41c6-be18-cc4f3497e00f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:28.255983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89611b72-625d-41c6-be18-cc4f3497e00f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:28.256438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89611b72-625d-41c6-be18-cc4f3497e00f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:28.257222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89611b72-625d-41c6-be18-cc4f3497e00f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:28.257651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89611b72-625d-41c6-be18-cc4f3497e00f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:28.323476 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-89611b72-625d-41c6-be18-cc4f3497e00f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:28.331701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-89611b72-625d-41c6-be18-cc4f3497e00f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086900 Aug 01 16:00:28.332263 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1735/3144] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:28 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:29.107342 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ed89baca-a5d4-403b-ac10-3e8d59aa732d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:29.107955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ed89baca-a5d4-403b-ac10-3e8d59aa732d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:29.114783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed89baca-a5d4-403b-ac10-3e8d59aa732d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:29.115233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed89baca-a5d4-403b-ac10-3e8d59aa732d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:29.116005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed89baca-a5d4-403b-ac10-3e8d59aa732d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:29.116441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed89baca-a5d4-403b-ac10-3e8d59aa732d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:29.246089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ed89baca-a5d4-403b-ac10-3e8d59aa732d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:29.254244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ed89baca-a5d4-403b-ac10-3e8d59aa732d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151444 Aug 01 16:00:29.254802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1410/3145] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:29 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:29.354327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5f1c0b8e-3efb-4eed-abef-157010cb4024 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:29.354929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5f1c0b8e-3efb-4eed-abef-157010cb4024 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:29.361272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f1c0b8e-3efb-4eed-abef-157010cb4024 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:29.361719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f1c0b8e-3efb-4eed-abef-157010cb4024 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:29.362522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f1c0b8e-3efb-4eed-abef-157010cb4024 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:29.362953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f1c0b8e-3efb-4eed-abef-157010cb4024 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:29.426083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5f1c0b8e-3efb-4eed-abef-157010cb4024 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:29.434562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5f1c0b8e-3efb-4eed-abef-157010cb4024 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085132 Aug 01 16:00:29.435127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1736/3146] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:29 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:30.275034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c8485738-2e51-4cc7-ab4d-05624937d06e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:30.275677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c8485738-2e51-4cc7-ab4d-05624937d06e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:30.282546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8485738-2e51-4cc7-ab4d-05624937d06e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:30.283038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8485738-2e51-4cc7-ab4d-05624937d06e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:30.283836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8485738-2e51-4cc7-ab4d-05624937d06e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:30.284317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8485738-2e51-4cc7-ab4d-05624937d06e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:30.414344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c8485738-2e51-4cc7-ab4d-05624937d06e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:30.423135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c8485738-2e51-4cc7-ab4d-05624937d06e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152449 Aug 01 16:00:30.423741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1411/3147] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:30 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:30.455654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6fffe01f-5db7-40c3-99dd-d3eabe62ca0f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:30.456264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6fffe01f-5db7-40c3-99dd-d3eabe62ca0f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:30.463210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6fffe01f-5db7-40c3-99dd-d3eabe62ca0f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:30.463651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6fffe01f-5db7-40c3-99dd-d3eabe62ca0f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:30.464401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6fffe01f-5db7-40c3-99dd-d3eabe62ca0f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:30.464831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6fffe01f-5db7-40c3-99dd-d3eabe62ca0f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:30.526593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6fffe01f-5db7-40c3-99dd-d3eabe62ca0f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:30.534444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6fffe01f-5db7-40c3-99dd-d3eabe62ca0f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082664 Aug 01 16:00:30.535012 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1737/3148] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:30 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:31.444625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3aeb2085-559b-476b-bd02-7d8a3a2b4622 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:31.445242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3aeb2085-559b-476b-bd02-7d8a3a2b4622 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:31.452335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3aeb2085-559b-476b-bd02-7d8a3a2b4622 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:31.452787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3aeb2085-559b-476b-bd02-7d8a3a2b4622 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:31.453544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3aeb2085-559b-476b-bd02-7d8a3a2b4622 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:31.454015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3aeb2085-559b-476b-bd02-7d8a3a2b4622 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:31.474692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:31.555747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ebef54df-b043-46f1-8ebd-1b1d63e8731d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:31.556363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ebef54df-b043-46f1-8ebd-1b1d63e8731d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:31.563227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebef54df-b043-46f1-8ebd-1b1d63e8731d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:31.563673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebef54df-b043-46f1-8ebd-1b1d63e8731d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:31.564444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebef54df-b043-46f1-8ebd-1b1d63e8731d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:31.564877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ebef54df-b043-46f1-8ebd-1b1d63e8731d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:31.588110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3aeb2085-559b-476b-bd02-7d8a3a2b4622 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:31.596137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3aeb2085-559b-476b-bd02-7d8a3a2b4622 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155354 Aug 01 16:00:31.596698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1412/3149] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:31 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:31.644252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ebef54df-b043-46f1-8ebd-1b1d63e8731d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:31.649985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:31.658873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ebef54df-b043-46f1-8ebd-1b1d63e8731d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.107089 Aug 01 16:00:31.659449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1738/3150] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:31 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:32.617783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-bbf0e614-884d-4bd1-81f6-b8fb82c97472 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:32.618938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-bbf0e614-884d-4bd1-81f6-b8fb82c97472 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:32.625708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bbf0e614-884d-4bd1-81f6-b8fb82c97472 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:32.626209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bbf0e614-884d-4bd1-81f6-b8fb82c97472 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:32.627038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bbf0e614-884d-4bd1-81f6-b8fb82c97472 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:32.627480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-bbf0e614-884d-4bd1-81f6-b8fb82c97472 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:32.680202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-20bbe85d-9e2b-494b-a923-97457605c1bf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:32.681318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-20bbe85d-9e2b-494b-a923-97457605c1bf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:32.688232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-20bbe85d-9e2b-494b-a923-97457605c1bf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:32.688684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-20bbe85d-9e2b-494b-a923-97457605c1bf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:32.689456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-20bbe85d-9e2b-494b-a923-97457605c1bf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:32.689908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-20bbe85d-9e2b-494b-a923-97457605c1bf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:32.764098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-20bbe85d-9e2b-494b-a923-97457605c1bf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:32.772066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-20bbe85d-9e2b-494b-a923-97457605c1bf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.095907 Aug 01 16:00:32.772643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1739/3151] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:32 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:32.780522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-bbf0e614-884d-4bd1-81f6-b8fb82c97472 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:32.788420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-bbf0e614-884d-4bd1-81f6-b8fb82c97472 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.174536 Aug 01 16:00:32.788977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1413/3152] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:32 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:33.794279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bf57f99a-3549-4f21-a56d-fa75aaf1319e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:33.794986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bf57f99a-3549-4f21-a56d-fa75aaf1319e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:33.802079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf57f99a-3549-4f21-a56d-fa75aaf1319e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:33.802527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf57f99a-3549-4f21-a56d-fa75aaf1319e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:33.803324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf57f99a-3549-4f21-a56d-fa75aaf1319e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:33.803774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bf57f99a-3549-4f21-a56d-fa75aaf1319e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:33.809318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-160be07e-156f-4793-987b-54cb894bfeb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:33.810029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-160be07e-156f-4793-987b-54cb894bfeb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:33.817130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-160be07e-156f-4793-987b-54cb894bfeb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:33.817630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-160be07e-156f-4793-987b-54cb894bfeb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:33.818601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-160be07e-156f-4793-987b-54cb894bfeb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:33.819046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-160be07e-156f-4793-987b-54cb894bfeb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:33.869995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bf57f99a-3549-4f21-a56d-fa75aaf1319e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:33.879031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bf57f99a-3549-4f21-a56d-fa75aaf1319e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.089552 Aug 01 16:00:33.879735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1740/3153] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:33 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:33.971571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-160be07e-156f-4793-987b-54cb894bfeb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:33.980493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-160be07e-156f-4793-987b-54cb894bfeb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.175836 Aug 01 16:00:33.981064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1414/3154] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:33 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:34.902227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-189c07c2-20a4-4a4c-9148-fcd358137959 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:34.903049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-189c07c2-20a4-4a4c-9148-fcd358137959 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:34.910652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-189c07c2-20a4-4a4c-9148-fcd358137959 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:34.911208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-189c07c2-20a4-4a4c-9148-fcd358137959 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:34.912034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-189c07c2-20a4-4a4c-9148-fcd358137959 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:34.912473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-189c07c2-20a4-4a4c-9148-fcd358137959 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:34.974973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-189c07c2-20a4-4a4c-9148-fcd358137959 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:34.984021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-189c07c2-20a4-4a4c-9148-fcd358137959 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087034 Aug 01 16:00:34.984593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1741/3155] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:34 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:35.001921 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-22590041-b3fe-4c65-9e40-dcf596f491ed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:35.002540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-22590041-b3fe-4c65-9e40-dcf596f491ed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:35.009773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22590041-b3fe-4c65-9e40-dcf596f491ed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:35.010259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22590041-b3fe-4c65-9e40-dcf596f491ed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:35.011057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22590041-b3fe-4c65-9e40-dcf596f491ed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:35.011503 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-22590041-b3fe-4c65-9e40-dcf596f491ed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:35.143024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-22590041-b3fe-4c65-9e40-dcf596f491ed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:35.151144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-22590041-b3fe-4c65-9e40-dcf596f491ed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153045 Aug 01 16:00:35.151710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1415/3156] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:34 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:36.005801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a8aae082-8164-480e-b10a-1a04de9c27ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:36.006446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a8aae082-8164-480e-b10a-1a04de9c27ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:36.013710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8aae082-8164-480e-b10a-1a04de9c27ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:36.014187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8aae082-8164-480e-b10a-1a04de9c27ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:36.014959 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8aae082-8164-480e-b10a-1a04de9c27ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:36.015396 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8aae082-8164-480e-b10a-1a04de9c27ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:36.079553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a8aae082-8164-480e-b10a-1a04de9c27ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:36.087610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a8aae082-8164-480e-b10a-1a04de9c27ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085751 Aug 01 16:00:36.088851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1742/3157] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:36 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:36.172490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-38f61b6b-4438-48ce-b881-47851e56fd0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:36.173138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-38f61b6b-4438-48ce-b881-47851e56fd0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:36.179738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-38f61b6b-4438-48ce-b881-47851e56fd0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:36.180189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-38f61b6b-4438-48ce-b881-47851e56fd0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:36.180947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-38f61b6b-4438-48ce-b881-47851e56fd0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:36.181389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-38f61b6b-4438-48ce-b881-47851e56fd0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:36.310625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-38f61b6b-4438-48ce-b881-47851e56fd0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:36.318805 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-38f61b6b-4438-48ce-b881-47851e56fd0d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150201 Aug 01 16:00:36.319377 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1416/3158] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:36 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:37.109456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-658987e9-1256-4135-8057-bd3e99427418 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:37.110107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-658987e9-1256-4135-8057-bd3e99427418 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:37.112453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=56 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:37.117903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-658987e9-1256-4135-8057-bd3e99427418 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:37.118378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-658987e9-1256-4135-8057-bd3e99427418 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:37.119207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-658987e9-1256-4135-8057-bd3e99427418 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:37.119718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-658987e9-1256-4135-8057-bd3e99427418 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:37.183336 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-658987e9-1256-4135-8057-bd3e99427418 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:37.191363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-658987e9-1256-4135-8057-bd3e99427418 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086072 Aug 01 16:00:37.191921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1743/3159] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:37 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:37.343252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cdc546ac-a16e-4ebb-b884-67e16cd57875 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:37.343804 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cdc546ac-a16e-4ebb-b884-67e16cd57875 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:37.350345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cdc546ac-a16e-4ebb-b884-67e16cd57875 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:37.350797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cdc546ac-a16e-4ebb-b884-67e16cd57875 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:37.351555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cdc546ac-a16e-4ebb-b884-67e16cd57875 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:37.351995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cdc546ac-a16e-4ebb-b884-67e16cd57875 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:37.484899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cdc546ac-a16e-4ebb-b884-67e16cd57875 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:37.492986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cdc546ac-a16e-4ebb-b884-67e16cd57875 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153802 Aug 01 16:00:37.493561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1417/3160] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:37 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:38.212727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-381ffd66-78a6-4e1a-8601-362d2735344b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:38.213359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-381ffd66-78a6-4e1a-8601-362d2735344b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:38.219916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-381ffd66-78a6-4e1a-8601-362d2735344b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:38.220370 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-381ffd66-78a6-4e1a-8601-362d2735344b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:38.221137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-381ffd66-78a6-4e1a-8601-362d2735344b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:38.221580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-381ffd66-78a6-4e1a-8601-362d2735344b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:38.283304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-381ffd66-78a6-4e1a-8601-362d2735344b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:38.291896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-381ffd66-78a6-4e1a-8601-362d2735344b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083053 Aug 01 16:00:38.292452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1744/3161] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:38 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:38.514668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7ae160eb-a31b-49a8-8fe4-4dec0e943c21 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:38.515267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7ae160eb-a31b-49a8-8fe4-4dec0e943c21 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:38.521995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ae160eb-a31b-49a8-8fe4-4dec0e943c21 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:38.522455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ae160eb-a31b-49a8-8fe4-4dec0e943c21 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:38.523217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ae160eb-a31b-49a8-8fe4-4dec0e943c21 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:38.523654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7ae160eb-a31b-49a8-8fe4-4dec0e943c21 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:38.655340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7ae160eb-a31b-49a8-8fe4-4dec0e943c21 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:38.663225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7ae160eb-a31b-49a8-8fe4-4dec0e943c21 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152587 Aug 01 16:00:38.663786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1418/3162] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:38 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:39.313547 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8f9bc49f-9539-46f2-9f5e-b1a76effa3ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:39.314143 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8f9bc49f-9539-46f2-9f5e-b1a76effa3ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:39.320616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f9bc49f-9539-46f2-9f5e-b1a76effa3ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:39.321128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f9bc49f-9539-46f2-9f5e-b1a76effa3ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:39.321900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f9bc49f-9539-46f2-9f5e-b1a76effa3ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:39.323007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8f9bc49f-9539-46f2-9f5e-b1a76effa3ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:39.398611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8f9bc49f-9539-46f2-9f5e-b1a76effa3ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:39.406709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8f9bc49f-9539-46f2-9f5e-b1a76effa3ca tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.097277 Aug 01 16:00:39.407282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1745/3163] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:39 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:39.686227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-381ba0c0-fa9d-47dc-924e-3225f25019f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:39.686841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-381ba0c0-fa9d-47dc-924e-3225f25019f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:39.696620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-381ba0c0-fa9d-47dc-924e-3225f25019f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:39.697088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-381ba0c0-fa9d-47dc-924e-3225f25019f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:39.697856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-381ba0c0-fa9d-47dc-924e-3225f25019f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:39.699596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-381ba0c0-fa9d-47dc-924e-3225f25019f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:39.839843 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-381ba0c0-fa9d-47dc-924e-3225f25019f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:39.848443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-381ba0c0-fa9d-47dc-924e-3225f25019f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.166703 Aug 01 16:00:39.849144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1419/3164] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:39 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:40.427873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3438bf30-a46d-4b90-8bd0-0d9afd076f6f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:40.428504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3438bf30-a46d-4b90-8bd0-0d9afd076f6f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:40.434998 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3438bf30-a46d-4b90-8bd0-0d9afd076f6f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:40.435443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3438bf30-a46d-4b90-8bd0-0d9afd076f6f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:40.436197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3438bf30-a46d-4b90-8bd0-0d9afd076f6f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:40.436625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3438bf30-a46d-4b90-8bd0-0d9afd076f6f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:40.498443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3438bf30-a46d-4b90-8bd0-0d9afd076f6f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:40.506364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3438bf30-a46d-4b90-8bd0-0d9afd076f6f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082387 Aug 01 16:00:40.506921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1746/3165] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:40 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:40.870454 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ec5ae0cd-f5ce-492e-9aa5-286b1c517009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:40.871146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ec5ae0cd-f5ce-492e-9aa5-286b1c517009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:40.877673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec5ae0cd-f5ce-492e-9aa5-286b1c517009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:40.878144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec5ae0cd-f5ce-492e-9aa5-286b1c517009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:40.878894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec5ae0cd-f5ce-492e-9aa5-286b1c517009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:40.879323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ec5ae0cd-f5ce-492e-9aa5-286b1c517009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:41.016339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ec5ae0cd-f5ce-492e-9aa5-286b1c517009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:41.024443 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ec5ae0cd-f5ce-492e-9aa5-286b1c517009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.157910 Aug 01 16:00:41.025019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1420/3166] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:40 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:41.527834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-195efd09-b7b2-46bd-931c-1e783ae54f20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:41.528524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-195efd09-b7b2-46bd-931c-1e783ae54f20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:41.535185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-195efd09-b7b2-46bd-931c-1e783ae54f20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:41.535636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-195efd09-b7b2-46bd-931c-1e783ae54f20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:41.536404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-195efd09-b7b2-46bd-931c-1e783ae54f20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:41.536844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-195efd09-b7b2-46bd-931c-1e783ae54f20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:41.599240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-195efd09-b7b2-46bd-931c-1e783ae54f20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:41.607534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-195efd09-b7b2-46bd-931c-1e783ae54f20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083713 Aug 01 16:00:41.608101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1747/3167] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:41 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:42.047252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1ec6f582-b804-4f58-8f86-03efbcd10d6c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:42.047876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1ec6f582-b804-4f58-8f86-03efbcd10d6c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:42.055101 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ec6f582-b804-4f58-8f86-03efbcd10d6c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:42.055101 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ec6f582-b804-4f58-8f86-03efbcd10d6c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:42.055843 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ec6f582-b804-4f58-8f86-03efbcd10d6c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:42.056305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ec6f582-b804-4f58-8f86-03efbcd10d6c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:42.207312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1ec6f582-b804-4f58-8f86-03efbcd10d6c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:42.216934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1ec6f582-b804-4f58-8f86-03efbcd10d6c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.173644 Aug 01 16:00:42.217523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1421/3168] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:42 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:42.628987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-32abbb90-b754-448a-8aca-3ef0077f0784 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:42.629627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-32abbb90-b754-448a-8aca-3ef0077f0784 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:42.636953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32abbb90-b754-448a-8aca-3ef0077f0784 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:42.637391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32abbb90-b754-448a-8aca-3ef0077f0784 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:42.638178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32abbb90-b754-448a-8aca-3ef0077f0784 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:42.638631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32abbb90-b754-448a-8aca-3ef0077f0784 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:42.703681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-32abbb90-b754-448a-8aca-3ef0077f0784 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:42.711676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-32abbb90-b754-448a-8aca-3ef0077f0784 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086690 Aug 01 16:00:42.712237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1748/3169] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:42 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:43.239139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-741047fe-feb5-4c31-afb2-100d1f80aeb1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:43.239732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-741047fe-feb5-4c31-afb2-100d1f80aeb1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:43.246749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-741047fe-feb5-4c31-afb2-100d1f80aeb1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:43.247189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-741047fe-feb5-4c31-afb2-100d1f80aeb1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:43.248043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-741047fe-feb5-4c31-afb2-100d1f80aeb1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:43.248480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-741047fe-feb5-4c31-afb2-100d1f80aeb1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:43.375112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-741047fe-feb5-4c31-afb2-100d1f80aeb1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:43.383406 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-741047fe-feb5-4c31-afb2-100d1f80aeb1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.148254 Aug 01 16:00:43.383971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1422/3170] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:43 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:43.733803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cc61074c-3557-411a-8a20-acc425017b2d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:43.734428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cc61074c-3557-411a-8a20-acc425017b2d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:43.741190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc61074c-3557-411a-8a20-acc425017b2d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:43.741642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc61074c-3557-411a-8a20-acc425017b2d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:43.742433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc61074c-3557-411a-8a20-acc425017b2d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:43.742876 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc61074c-3557-411a-8a20-acc425017b2d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:43.806217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cc61074c-3557-411a-8a20-acc425017b2d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:43.817219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cc61074c-3557-411a-8a20-acc425017b2d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087244 Aug 01 16:00:43.817833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1749/3171] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:43 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:44.405152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4cfb29d9-5741-4bc6-bf74-85472906964d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:44.405742 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4cfb29d9-5741-4bc6-bf74-85472906964d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:44.408103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=52 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:44.413955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4cfb29d9-5741-4bc6-bf74-85472906964d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:44.414410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4cfb29d9-5741-4bc6-bf74-85472906964d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:44.415181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4cfb29d9-5741-4bc6-bf74-85472906964d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:44.415622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4cfb29d9-5741-4bc6-bf74-85472906964d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:44.548656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4cfb29d9-5741-4bc6-bf74-85472906964d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:44.556925 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4cfb29d9-5741-4bc6-bf74-85472906964d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155991 Aug 01 16:00:44.557482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1423/3172] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:44 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:44.838985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-717d643b-72a8-43fb-9316-d84631113e85 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:44.839544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-717d643b-72a8-43fb-9316-d84631113e85 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:44.846165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-717d643b-72a8-43fb-9316-d84631113e85 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:44.846645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-717d643b-72a8-43fb-9316-d84631113e85 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:44.847408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-717d643b-72a8-43fb-9316-d84631113e85 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:44.847845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-717d643b-72a8-43fb-9316-d84631113e85 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:44.909218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-717d643b-72a8-43fb-9316-d84631113e85 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:44.917648 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-717d643b-72a8-43fb-9316-d84631113e85 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083305 Aug 01 16:00:44.918255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1750/3173] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:44 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:45.578871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-66833b76-baa9-42d4-b615-ac00347b3fe2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:45.579498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-66833b76-baa9-42d4-b615-ac00347b3fe2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:45.585667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66833b76-baa9-42d4-b615-ac00347b3fe2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:45.586153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66833b76-baa9-42d4-b615-ac00347b3fe2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:45.586934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66833b76-baa9-42d4-b615-ac00347b3fe2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:45.587378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66833b76-baa9-42d4-b615-ac00347b3fe2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:45.715361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-66833b76-baa9-42d4-b615-ac00347b3fe2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:45.723434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-66833b76-baa9-42d4-b615-ac00347b3fe2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.148630 Aug 01 16:00:45.724002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1424/3174] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:45 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:45.939235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a070f18e-da02-44c3-b6ba-3425008dc9e4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:45.939914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a070f18e-da02-44c3-b6ba-3425008dc9e4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:45.946559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a070f18e-da02-44c3-b6ba-3425008dc9e4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:45.947023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a070f18e-da02-44c3-b6ba-3425008dc9e4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:45.947794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a070f18e-da02-44c3-b6ba-3425008dc9e4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:45.948236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a070f18e-da02-44c3-b6ba-3425008dc9e4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:46.014925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a070f18e-da02-44c3-b6ba-3425008dc9e4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:46.023294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a070f18e-da02-44c3-b6ba-3425008dc9e4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087867 Aug 01 16:00:46.023871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1751/3175] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:45 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:46.237497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:00:46.237748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 16:00:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:00:46.744784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7394cfcc-40d0-48f1-ac7e-8ecfce078a3b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:46.745401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7394cfcc-40d0-48f1-ac7e-8ecfce078a3b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:46.752806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7394cfcc-40d0-48f1-ac7e-8ecfce078a3b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:46.753274 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7394cfcc-40d0-48f1-ac7e-8ecfce078a3b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:46.754141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7394cfcc-40d0-48f1-ac7e-8ecfce078a3b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:46.754717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7394cfcc-40d0-48f1-ac7e-8ecfce078a3b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:47.046290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5d46a844-67bc-4fd9-9315-40abcd7c01d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:47.047047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5d46a844-67bc-4fd9-9315-40abcd7c01d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:47.054105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d46a844-67bc-4fd9-9315-40abcd7c01d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:47.055124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d46a844-67bc-4fd9-9315-40abcd7c01d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:47.055425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d46a844-67bc-4fd9-9315-40abcd7c01d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:47.055870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d46a844-67bc-4fd9-9315-40abcd7c01d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:47.138466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5d46a844-67bc-4fd9-9315-40abcd7c01d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:47.146757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5d46a844-67bc-4fd9-9315-40abcd7c01d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.104698 Aug 01 16:00:47.147543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1752/3176] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:47 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:47.162183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7394cfcc-40d0-48f1-ac7e-8ecfce078a3b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:47.170190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7394cfcc-40d0-48f1-ac7e-8ecfce078a3b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.429314 Aug 01 16:00:47.170752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1425/3177] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:46 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:48.169409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-26c54d92-1206-42ea-a25a-7de7530438ac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:48.170042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-26c54d92-1206-42ea-a25a-7de7530438ac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:48.176550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26c54d92-1206-42ea-a25a-7de7530438ac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:48.177022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26c54d92-1206-42ea-a25a-7de7530438ac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:48.177773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26c54d92-1206-42ea-a25a-7de7530438ac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:48.178232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26c54d92-1206-42ea-a25a-7de7530438ac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:48.191523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e55e49bb-5904-47fb-8e5e-0da7ca83abf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:48.192138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e55e49bb-5904-47fb-8e5e-0da7ca83abf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:48.198739 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e55e49bb-5904-47fb-8e5e-0da7ca83abf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:48.199192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e55e49bb-5904-47fb-8e5e-0da7ca83abf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:48.199963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e55e49bb-5904-47fb-8e5e-0da7ca83abf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:48.200403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e55e49bb-5904-47fb-8e5e-0da7ca83abf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:48.241211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-26c54d92-1206-42ea-a25a-7de7530438ac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:48.249374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-26c54d92-1206-42ea-a25a-7de7530438ac tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084481 Aug 01 16:00:48.249960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1753/3178] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:48 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:48.339298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e55e49bb-5904-47fb-8e5e-0da7ca83abf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:48.347138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e55e49bb-5904-47fb-8e5e-0da7ca83abf0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159503 Aug 01 16:00:48.347696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1426/3179] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:48 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:49.269437 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9aeb336f-caa2-4c24-8eeb-cfa122429609 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:49.270087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9aeb336f-caa2-4c24-8eeb-cfa122429609 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:49.276643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aeb336f-caa2-4c24-8eeb-cfa122429609 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:49.277089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aeb336f-caa2-4c24-8eeb-cfa122429609 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:49.277841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aeb336f-caa2-4c24-8eeb-cfa122429609 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:49.278297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9aeb336f-caa2-4c24-8eeb-cfa122429609 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:49.340146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9aeb336f-caa2-4c24-8eeb-cfa122429609 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:49.348017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9aeb336f-caa2-4c24-8eeb-cfa122429609 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082518 Aug 01 16:00:49.348586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1754/3180] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:49 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:49.369979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cac47fc1-4d01-46d1-87d4-4450dad6dce2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:49.370594 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cac47fc1-4d01-46d1-87d4-4450dad6dce2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:49.377054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cac47fc1-4d01-46d1-87d4-4450dad6dce2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:49.377504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cac47fc1-4d01-46d1-87d4-4450dad6dce2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:49.378289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cac47fc1-4d01-46d1-87d4-4450dad6dce2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:49.378757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cac47fc1-4d01-46d1-87d4-4450dad6dce2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:49.511175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cac47fc1-4d01-46d1-87d4-4450dad6dce2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:49.519051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cac47fc1-4d01-46d1-87d4-4450dad6dce2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153731 Aug 01 16:00:49.519617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1427/3181] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:49 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:50.369545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-08bf05bd-6939-45f5-b9a8-0e65b734413a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:50.370193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-08bf05bd-6939-45f5-b9a8-0e65b734413a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:50.376681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08bf05bd-6939-45f5-b9a8-0e65b734413a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:50.377136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08bf05bd-6939-45f5-b9a8-0e65b734413a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:50.377933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08bf05bd-6939-45f5-b9a8-0e65b734413a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:50.378380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-08bf05bd-6939-45f5-b9a8-0e65b734413a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:50.396721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:50.440916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-08bf05bd-6939-45f5-b9a8-0e65b734413a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:50.449452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-08bf05bd-6939-45f5-b9a8-0e65b734413a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083776 Aug 01 16:00:50.450034 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1755/3182] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:50 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:50.540294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b6885ab7-a9bd-4a3c-a96b-accc8a42137c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:50.540973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b6885ab7-a9bd-4a3c-a96b-accc8a42137c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:50.547621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6885ab7-a9bd-4a3c-a96b-accc8a42137c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:50.548068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6885ab7-a9bd-4a3c-a96b-accc8a42137c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:50.548833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6885ab7-a9bd-4a3c-a96b-accc8a42137c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:50.549265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b6885ab7-a9bd-4a3c-a96b-accc8a42137c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:50.675888 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b6885ab7-a9bd-4a3c-a96b-accc8a42137c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:50.684318 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b6885ab7-a9bd-4a3c-a96b-accc8a42137c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.147880 Aug 01 16:00:50.684886 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1428/3183] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:50 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:51.470567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0a836771-c9a9-4d3e-870f-a45717507ff2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:51.471182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0a836771-c9a9-4d3e-870f-a45717507ff2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:51.477704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a836771-c9a9-4d3e-870f-a45717507ff2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:51.479081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a836771-c9a9-4d3e-870f-a45717507ff2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:51.479854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a836771-c9a9-4d3e-870f-a45717507ff2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:51.480344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a836771-c9a9-4d3e-870f-a45717507ff2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:51.543617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0a836771-c9a9-4d3e-870f-a45717507ff2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:51.551682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0a836771-c9a9-4d3e-870f-a45717507ff2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084997 Aug 01 16:00:51.552245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1756/3184] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:51 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:51.706247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-09e03076-1433-4031-b18e-7b85fed9705d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:51.706845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-09e03076-1433-4031-b18e-7b85fed9705d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:51.714020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09e03076-1433-4031-b18e-7b85fed9705d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:51.714475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09e03076-1433-4031-b18e-7b85fed9705d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:51.715241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09e03076-1433-4031-b18e-7b85fed9705d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:51.715685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-09e03076-1433-4031-b18e-7b85fed9705d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:51.719839 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:00:51.847223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-09e03076-1433-4031-b18e-7b85fed9705d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:51.855591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-09e03076-1433-4031-b18e-7b85fed9705d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153263 Aug 01 16:00:51.856145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1429/3185] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:51 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:52.572871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-65dc01cb-52fe-4d97-bcc8-973c490317f6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:52.573487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-65dc01cb-52fe-4d97-bcc8-973c490317f6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:52.580217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65dc01cb-52fe-4d97-bcc8-973c490317f6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:52.580687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65dc01cb-52fe-4d97-bcc8-973c490317f6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:52.581433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65dc01cb-52fe-4d97-bcc8-973c490317f6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:52.581868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-65dc01cb-52fe-4d97-bcc8-973c490317f6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:52.643145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-65dc01cb-52fe-4d97-bcc8-973c490317f6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:52.651708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-65dc01cb-52fe-4d97-bcc8-973c490317f6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082826 Aug 01 16:00:52.652271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1757/3186] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:52 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:52.876650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b4e43f9b-9686-45d9-8472-19ea8782c706 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:52.877265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b4e43f9b-9686-45d9-8472-19ea8782c706 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:52.883913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4e43f9b-9686-45d9-8472-19ea8782c706 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:52.884367 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4e43f9b-9686-45d9-8472-19ea8782c706 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:52.885131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4e43f9b-9686-45d9-8472-19ea8782c706 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:52.885570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4e43f9b-9686-45d9-8472-19ea8782c706 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:53.016941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b4e43f9b-9686-45d9-8472-19ea8782c706 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:53.025529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b4e43f9b-9686-45d9-8472-19ea8782c706 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152234 Aug 01 16:00:53.026126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1430/3187] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:52 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:53.672812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e3943d2f-6463-4312-9bd3-38d57f84d587 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:53.673409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e3943d2f-6463-4312-9bd3-38d57f84d587 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:53.680023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3943d2f-6463-4312-9bd3-38d57f84d587 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:53.680462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3943d2f-6463-4312-9bd3-38d57f84d587 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:53.681216 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3943d2f-6463-4312-9bd3-38d57f84d587 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:53.681649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3943d2f-6463-4312-9bd3-38d57f84d587 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:53.742981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e3943d2f-6463-4312-9bd3-38d57f84d587 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:53.751114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e3943d2f-6463-4312-9bd3-38d57f84d587 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082135 Aug 01 16:00:53.751677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1758/3188] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:53 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:54.046835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-66badd3e-7187-4be7-83ca-0d2c3c4dadee tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:54.047420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-66badd3e-7187-4be7-83ca-0d2c3c4dadee tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:54.054155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66badd3e-7187-4be7-83ca-0d2c3c4dadee tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:54.054610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66badd3e-7187-4be7-83ca-0d2c3c4dadee tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:54.055409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66badd3e-7187-4be7-83ca-0d2c3c4dadee tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:54.055800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-66badd3e-7187-4be7-83ca-0d2c3c4dadee tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:54.187780 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-66badd3e-7187-4be7-83ca-0d2c3c4dadee tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:54.195795 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-66badd3e-7187-4be7-83ca-0d2c3c4dadee tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152939 Aug 01 16:00:54.196353 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1431/3189] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:54 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:54.772087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f7619f4a-76b3-4c9e-bb4a-5dee4c4f4037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:54.772691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f7619f4a-76b3-4c9e-bb4a-5dee4c4f4037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:54.779894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7619f4a-76b3-4c9e-bb4a-5dee4c4f4037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:54.780344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7619f4a-76b3-4c9e-bb4a-5dee4c4f4037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:54.781102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7619f4a-76b3-4c9e-bb4a-5dee4c4f4037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:54.781538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f7619f4a-76b3-4c9e-bb4a-5dee4c4f4037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:54.844248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f7619f4a-76b3-4c9e-bb4a-5dee4c4f4037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:54.852406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f7619f4a-76b3-4c9e-bb4a-5dee4c4f4037 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084215 Aug 01 16:00:54.852978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1759/3190] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:54 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:55.219350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-218ada25-48d7-43e5-a1b3-336706842521 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:55.220480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-218ada25-48d7-43e5-a1b3-336706842521 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:55.226697 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-218ada25-48d7-43e5-a1b3-336706842521 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:55.227149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-218ada25-48d7-43e5-a1b3-336706842521 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:55.227910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-218ada25-48d7-43e5-a1b3-336706842521 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:55.228346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-218ada25-48d7-43e5-a1b3-336706842521 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:55.362026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-218ada25-48d7-43e5-a1b3-336706842521 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:55.370825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-218ada25-48d7-43e5-a1b3-336706842521 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156803 Aug 01 16:00:55.371401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1432/3191] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:55 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:55.873987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f29bf770-0e6f-4c5a-baf4-951698a87d20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:55.874607 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f29bf770-0e6f-4c5a-baf4-951698a87d20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:55.881225 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f29bf770-0e6f-4c5a-baf4-951698a87d20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:55.881672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f29bf770-0e6f-4c5a-baf4-951698a87d20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:55.882555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f29bf770-0e6f-4c5a-baf4-951698a87d20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:55.882993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f29bf770-0e6f-4c5a-baf4-951698a87d20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:55.945649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f29bf770-0e6f-4c5a-baf4-951698a87d20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:55.954288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f29bf770-0e6f-4c5a-baf4-951698a87d20 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084156 Aug 01 16:00:55.954844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1760/3192] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:55 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:56.392042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6ed9f8c6-723e-4259-8d4d-336c3fac2b7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:56.392731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6ed9f8c6-723e-4259-8d4d-336c3fac2b7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:56.399299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6ed9f8c6-723e-4259-8d4d-336c3fac2b7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:56.400272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6ed9f8c6-723e-4259-8d4d-336c3fac2b7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:56.401078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6ed9f8c6-723e-4259-8d4d-336c3fac2b7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:56.401521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6ed9f8c6-723e-4259-8d4d-336c3fac2b7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:56.533325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6ed9f8c6-723e-4259-8d4d-336c3fac2b7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:56.542014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6ed9f8c6-723e-4259-8d4d-336c3fac2b7e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153825 Aug 01 16:00:56.542581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1433/3193] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:56 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:56.976737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1b2e68a1-f4b5-4f77-9a0e-58914991f23e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:56.977340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1b2e68a1-f4b5-4f77-9a0e-58914991f23e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:56.984325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b2e68a1-f4b5-4f77-9a0e-58914991f23e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:56.984778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b2e68a1-f4b5-4f77-9a0e-58914991f23e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:56.985544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b2e68a1-f4b5-4f77-9a0e-58914991f23e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:56.986011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b2e68a1-f4b5-4f77-9a0e-58914991f23e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:57.047426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1b2e68a1-f4b5-4f77-9a0e-58914991f23e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:57.055496 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1b2e68a1-f4b5-4f77-9a0e-58914991f23e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082666 Aug 01 16:00:57.056102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1761/3194] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:56 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:57.563147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6849363d-912f-47f4-aa5a-24230ae31aaa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:57.563743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6849363d-912f-47f4-aa5a-24230ae31aaa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:57.570373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6849363d-912f-47f4-aa5a-24230ae31aaa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:57.570823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6849363d-912f-47f4-aa5a-24230ae31aaa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:57.571587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6849363d-912f-47f4-aa5a-24230ae31aaa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:57.572028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6849363d-912f-47f4-aa5a-24230ae31aaa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:57.698128 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6849363d-912f-47f4-aa5a-24230ae31aaa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:57.706346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6849363d-912f-47f4-aa5a-24230ae31aaa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.147109 Aug 01 16:00:57.706920 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1434/3195] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:57 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:57.952270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5d569728-756f-4655-bb5f-d7211979a7b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:57.952812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5d569728-756f-4655-bb5f-d7211979a7b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:57.959451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d569728-756f-4655-bb5f-d7211979a7b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:57.959900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d569728-756f-4655-bb5f-d7211979a7b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:57.960748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d569728-756f-4655-bb5f-d7211979a7b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:57.961188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5d569728-756f-4655-bb5f-d7211979a7b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:57.991438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5d569728-756f-4655-bb5f-d7211979a7b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:00:58.068677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5d569728-756f-4655-bb5f-d7211979a7b7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 204 len: 0 microversion: 2.20 time: 0.120265 Aug 01 16:00:58.069269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1762/3196] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 1 16:00:57 2022] DELETE /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 16:00:58.077931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a09a4e45-e684-46a8-a403-5487891841b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:58.078677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a09a4e45-e684-46a8-a403-5487891841b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:58.078968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c13f8227-1afd-4955-a742-e33d40600776 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:58.079663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c13f8227-1afd-4955-a742-e33d40600776 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:58.085302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a09a4e45-e684-46a8-a403-5487891841b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:58.085652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c13f8227-1afd-4955-a742-e33d40600776 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:58.085923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a09a4e45-e684-46a8-a403-5487891841b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:58.086123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c13f8227-1afd-4955-a742-e33d40600776 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:58.086855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a09a4e45-e684-46a8-a403-5487891841b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:58.086973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c13f8227-1afd-4955-a742-e33d40600776 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:58.087792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c13f8227-1afd-4955-a742-e33d40600776 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:58.087933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a09a4e45-e684-46a8-a403-5487891841b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:58.182174 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a09a4e45-e684-46a8-a403-5487891841b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:58.190307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a09a4e45-e684-46a8-a403-5487891841b6 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.116147 Aug 01 16:00:58.190893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1435/3197] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:58 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:58.246908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c13f8227-1afd-4955-a742-e33d40600776 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:58.254917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c13f8227-1afd-4955-a742-e33d40600776 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:58.256420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c13f8227-1afd-4955-a742-e33d40600776 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:58.257582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c13f8227-1afd-4955-a742-e33d40600776 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1722 microversion: 2.20 time: 0.183399 Aug 01 16:00:58.258176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1763/3198] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:00:58 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:00:58.727490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-751779d9-d648-4f04-a526-5862677eff80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:58.728143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-751779d9-d648-4f04-a526-5862677eff80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:58.735323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-751779d9-d648-4f04-a526-5862677eff80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:58.735768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-751779d9-d648-4f04-a526-5862677eff80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:58.736523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-751779d9-d648-4f04-a526-5862677eff80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:58.736952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-751779d9-d648-4f04-a526-5862677eff80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:58.865522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-751779d9-d648-4f04-a526-5862677eff80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:58.874041 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-751779d9-d648-4f04-a526-5862677eff80 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150365 Aug 01 16:00:58.874640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1436/3199] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:58 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:00:59.211463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-72f825d3-0de0-4dd9-ab6e-b396e64e04f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:59.212140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-72f825d3-0de0-4dd9-ab6e-b396e64e04f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:59.218684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72f825d3-0de0-4dd9-ab6e-b396e64e04f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:59.219126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72f825d3-0de0-4dd9-ab6e-b396e64e04f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:59.219875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72f825d3-0de0-4dd9-ab6e-b396e64e04f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:59.220303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-72f825d3-0de0-4dd9-ab6e-b396e64e04f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:59.280434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e7d93b64-c485-479b-a49d-f192799849a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:59.281048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e7d93b64-c485-479b-a49d-f192799849a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:59.284965 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-72f825d3-0de0-4dd9-ab6e-b396e64e04f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:59.287290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e7d93b64-c485-479b-a49d-f192799849a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:59.287739 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e7d93b64-c485-479b-a49d-f192799849a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:59.288516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e7d93b64-c485-479b-a49d-f192799849a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:59.288957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e7d93b64-c485-479b-a49d-f192799849a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:59.293983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-72f825d3-0de0-4dd9-ab6e-b396e64e04f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086327 Aug 01 16:00:59.294555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1764/3200] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:59 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:00:59.417849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e7d93b64-c485-479b-a49d-f192799849a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:59.426531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e7d93b64-c485-479b-a49d-f192799849a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:59.428015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e7d93b64-c485-479b-a49d-f192799849a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:00:59.429162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e7d93b64-c485-479b-a49d-f192799849a5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1722 microversion: 2.20 time: 0.152761 Aug 01 16:00:59.429709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1437/3201] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:00:59 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:00:59.896534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4bf09ef0-f4b0-451d-90d7-6e2d46ba0fc2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:00:59.897142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4bf09ef0-f4b0-451d-90d7-6e2d46ba0fc2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:00:59.903957 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4bf09ef0-f4b0-451d-90d7-6e2d46ba0fc2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:59.904404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4bf09ef0-f4b0-451d-90d7-6e2d46ba0fc2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:00:59.905188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4bf09ef0-f4b0-451d-90d7-6e2d46ba0fc2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:00:59.905710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4bf09ef0-f4b0-451d-90d7-6e2d46ba0fc2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:00.046807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4bf09ef0-f4b0-451d-90d7-6e2d46ba0fc2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:00.055312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4bf09ef0-f4b0-451d-90d7-6e2d46ba0fc2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.162361 Aug 01 16:01:00.055689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1765/3202] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:00:59 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:00.315214 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b51f12f0-9d5c-41e5-a4a7-fe15690db590 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:00.315979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b51f12f0-9d5c-41e5-a4a7-fe15690db590 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:00.323179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b51f12f0-9d5c-41e5-a4a7-fe15690db590 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:00.323687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b51f12f0-9d5c-41e5-a4a7-fe15690db590 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:00.324467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b51f12f0-9d5c-41e5-a4a7-fe15690db590 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:00.325067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b51f12f0-9d5c-41e5-a4a7-fe15690db590 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:00.390497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b51f12f0-9d5c-41e5-a4a7-fe15690db590 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:00.398546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b51f12f0-9d5c-41e5-a4a7-fe15690db590 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087228 Aug 01 16:01:00.399112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1438/3203] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:00 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:00.452485 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ec5c6b43-533c-4130-98b2-e9bb4c28367c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:00.453079 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ec5c6b43-533c-4130-98b2-e9bb4c28367c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:00.459903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ec5c6b43-533c-4130-98b2-e9bb4c28367c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:00.460355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ec5c6b43-533c-4130-98b2-e9bb4c28367c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:00.461127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ec5c6b43-533c-4130-98b2-e9bb4c28367c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:00.461554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ec5c6b43-533c-4130-98b2-e9bb4c28367c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:00.527665 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ec5c6b43-533c-4130-98b2-e9bb4c28367c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:00.532663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-363a62e5-0352-4d6e-878a-b2716d702229 req-7f8b864c-1e7d-4469-9e21-d1624b830b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1ace13-28cc-4664-b4d7-7d9672ea2580", "name": "network-vif-deleted", "tag": "9d09335e-4f0c-46f3-91bb-850f5252b8d7"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:01:00.543289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-363a62e5-0352-4d6e-878a-b2716d702229 req-7f8b864c-1e7d-4469-9e21-d1624b830b67 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:00.543796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-363a62e5-0352-4d6e-878a-b2716d702229 req-7f8b864c-1e7d-4469-9e21-d1624b830b67 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:00.545312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ec5c6b43-533c-4130-98b2-e9bb4c28367c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:00.546875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ec5c6b43-533c-4130-98b2-e9bb4c28367c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:00.548328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ec5c6b43-533c-4130-98b2-e9bb4c28367c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 200 len: 1654 microversion: 2.20 time: 0.099663 Aug 01 16:01:00.549183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1766/3204] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:01:00 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 1654 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:01:00.569383 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-363a62e5-0352-4d6e-878a-b2716d702229 req-7f8b864c-1e7d-4469-9e21-d1624b830b67 service nova] Creating event network-vif-deleted:9d09335e-4f0c-46f3-91bb-850f5252b8d7 for instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 on hv-cinder-84753 Aug 01 16:01:00.576818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-363a62e5-0352-4d6e-878a-b2716d702229 req-7f8b864c-1e7d-4469-9e21-d1624b830b67 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047690 Aug 01 16:01:00.577603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1439/3205] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:01:01.077212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5a86a237-6a5e-48ae-b433-2bd2f343dd50 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:01.077747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5a86a237-6a5e-48ae-b433-2bd2f343dd50 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:01.084097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a86a237-6a5e-48ae-b433-2bd2f343dd50 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:01.084847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a86a237-6a5e-48ae-b433-2bd2f343dd50 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:01.085618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a86a237-6a5e-48ae-b433-2bd2f343dd50 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:01.086098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5a86a237-6a5e-48ae-b433-2bd2f343dd50 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:01.221972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5a86a237-6a5e-48ae-b433-2bd2f343dd50 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:01.231244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5a86a237-6a5e-48ae-b433-2bd2f343dd50 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.158231 Aug 01 16:01:01.232038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1767/3206] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:01 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:01.420861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-49491256-3e0f-48ad-9ed9-71be0dc2d863 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:01.421577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-49491256-3e0f-48ad-9ed9-71be0dc2d863 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:01.428155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49491256-3e0f-48ad-9ed9-71be0dc2d863 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:01.428610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49491256-3e0f-48ad-9ed9-71be0dc2d863 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:01.429384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49491256-3e0f-48ad-9ed9-71be0dc2d863 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:01.429818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49491256-3e0f-48ad-9ed9-71be0dc2d863 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:01.493238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-49491256-3e0f-48ad-9ed9-71be0dc2d863 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:01.502515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-49491256-3e0f-48ad-9ed9-71be0dc2d863 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086347 Aug 01 16:01:01.503102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1440/3207] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:01 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:01.572320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5678cf65-0b9a-40fa-a90c-cc17c51fc8db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:01.572988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5678cf65-0b9a-40fa-a90c-cc17c51fc8db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:01.579790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5678cf65-0b9a-40fa-a90c-cc17c51fc8db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:01.580237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5678cf65-0b9a-40fa-a90c-cc17c51fc8db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:01.581091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5678cf65-0b9a-40fa-a90c-cc17c51fc8db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:01.581473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5678cf65-0b9a-40fa-a90c-cc17c51fc8db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:01.595713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-5678cf65-0b9a-40fa-a90c-cc17c51fc8db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] HTTP exception thrown: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5678cf65-0b9a-40fa-a90c-cc17c51fc8db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Request method failure captured: Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 HTTP/1.1 Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_JqCqrE9d6Rj-YKvvr1yqCsulLkWSHSQ-xUx7yqZZ0NIQRrKRdL33lIJ2-Ll2_9owvY__GsrovsVw6oTw99kqJ7zCVMDjyviYXXLNP0hgPXfcJfolBdJIqQCKkehkZPCvFusXGgSHis7oZ1rupskQbp26xOxwPe04wFccWNqkPLX74 Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: e829698141514a009e2e769854fe66f0 Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-788013046 Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:01:01.597409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:01:01.599358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e829698141514a009e2e769854fe66f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e829698141514a009e2e769854fe66f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e829698141514a009e2e769854fe66f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e829698141514a009e2e769854fe66f0"}]}] Aug 01 16:01:01.599358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-AttachVolumeShelveTestJSON-788013046 Aug 01 16:01:01.599358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: e829698141514a009e2e769854fe66f0 Aug 01 16:01:01.599358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-788013046 Aug 01 16:01:01.599358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-AttachVolumeShelveTestJSON-788013046-project Aug 01 16:01:01.599358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:01:01.599358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:01:01.599358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: 7d1b6c388c7642a892c905d16f3b8d50 Aug 01 16:01:01.599358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-AttachVolumeShelveTestJSON-788013046-project Aug 01 16:01:01.599358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 16:01:01.599358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:01.599358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': '9f1ace13-28cc-4664-b4d7-7d9672ea2580'} Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:01:01.600503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:01.602360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:01:01.604219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5678cf65-0b9a-40fa-a90c-cc17c51fc8db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Returning 404 to user: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:01:01.604219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5678cf65-0b9a-40fa-a90c-cc17c51fc8db tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 404 len: 111 microversion: 2.20 time: 0.031043 Aug 01 16:01:01.604219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1768/3208] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:01:01 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 16:01:01.608263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2b1bdf7a-3c0c-40f3-b411-12a7e1cb8d33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '.version_select at 0x7feb160055e0>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:01.628423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2b1bdf7a-3c0c-40f3-b411-12a7e1cb8d33 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754315665" status: 204 len: 0 microversion: 2.20 time: 0.024322 Aug 01 16:01:01.628992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1441/3209] 10.222.0.83 () {60 vars in 1259 bytes} [Mon Aug 1 16:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754315665 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 16:01:02.255070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-25e31dbd-34f9-48c9-b620-8cb5c0cb48c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:02.255400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1e47d9f7-ce2b-4cf7-96ad-904b473ac51e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:02.255572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-25e31dbd-34f9-48c9-b620-8cb5c0cb48c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:02.256217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1e47d9f7-ce2b-4cf7-96ad-904b473ac51e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:02.262898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e47d9f7-ce2b-4cf7-96ad-904b473ac51e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:02.263439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e47d9f7-ce2b-4cf7-96ad-904b473ac51e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:02.264101 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25e31dbd-34f9-48c9-b620-8cb5c0cb48c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:02.264349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e47d9f7-ce2b-4cf7-96ad-904b473ac51e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:02.264867 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e47d9f7-ce2b-4cf7-96ad-904b473ac51e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:02.265028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25e31dbd-34f9-48c9-b620-8cb5c0cb48c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:02.266039 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25e31dbd-34f9-48c9-b620-8cb5c0cb48c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:02.266490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-25e31dbd-34f9-48c9-b620-8cb5c0cb48c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:02.280453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-25e31dbd-34f9-48c9-b620-8cb5c0cb48c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] HTTP exception thrown: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-25e31dbd-34f9-48c9-b620-8cb5c0cb48c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Request method failure captured: Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: DELETE /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 HTTP/1.1 Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_JqCqrE9d6Rj-YKvvr1yqCsulLkWSHSQ-xUx7yqZZ0NIQRrKRdL33lIJ2-Ll2_9owvY__GsrovsVw6oTw99kqJ7zCVMDjyviYXXLNP0hgPXfcJfolBdJIqQCKkehkZPCvFusXGgSHis7oZ1rupskQbp26xOxwPe04wFccWNqkPLX74 Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: e829698141514a009e2e769854fe66f0 Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-788013046 Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:01:02.282210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:01:02.283894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e829698141514a009e2e769854fe66f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e829698141514a009e2e769854fe66f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e829698141514a009e2e769854fe66f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e829698141514a009e2e769854fe66f0"}]}] Aug 01 16:01:02.283894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeShelveTestJSON-788013046 Aug 01 16:01:02.283894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: e829698141514a009e2e769854fe66f0 Aug 01 16:01:02.283894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-788013046 Aug 01 16:01:02.283894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeShelveTestJSON-788013046-project Aug 01 16:01:02.283894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:01:02.283894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:01:02.283894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 7d1b6c388c7642a892c905d16f3b8d50 Aug 01 16:01:02.283894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeShelveTestJSON-788013046-project Aug 01 16:01:02.283894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:01:02.283894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:02.283894 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '9f1ace13-28cc-4664-b4d7-7d9672ea2580'} Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:01:02.284723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:02.286161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:01:02.288022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-25e31dbd-34f9-48c9-b620-8cb5c0cb48c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Returning 404 to user: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:01:02.288022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-25e31dbd-34f9-48c9-b620-8cb5c0cb48c5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 404 len: 111 microversion: 2.20 time: 0.032671 Aug 01 16:01:02.288022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1442/3210] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 1 16:01:02 2022] DELETE /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 16:01:02.292965 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-70c78a9d-237e-4bbe-9bfb-697b0ad15dac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:02.293581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-70c78a9d-237e-4bbe-9bfb-697b0ad15dac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 9f1ace13-28cc-4664-b4d7-7d9672ea2580] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:02.300070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70c78a9d-237e-4bbe-9bfb-697b0ad15dac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:02.300622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70c78a9d-237e-4bbe-9bfb-697b0ad15dac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:02.301398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70c78a9d-237e-4bbe-9bfb-697b0ad15dac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:02.301836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-70c78a9d-237e-4bbe-9bfb-697b0ad15dac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:02.316764 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-70c78a9d-237e-4bbe-9bfb-697b0ad15dac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] HTTP exception thrown: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-70c78a9d-237e-4bbe-9bfb-697b0ad15dac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Request method failure captured: Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 HTTP/1.1 Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_JqCqrE9d6Rj-YKvvr1yqCsulLkWSHSQ-xUx7yqZZ0NIQRrKRdL33lIJ2-Ll2_9owvY__GsrovsVw6oTw99kqJ7zCVMDjyviYXXLNP0hgPXfcJfolBdJIqQCKkehkZPCvFusXGgSHis7oZ1rupskQbp26xOxwPe04wFccWNqkPLX74 Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: e829698141514a009e2e769854fe66f0 Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-788013046 Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:01:02.318411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:01:02.320183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e829698141514a009e2e769854fe66f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e829698141514a009e2e769854fe66f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e829698141514a009e2e769854fe66f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e829698141514a009e2e769854fe66f0"}]}] Aug 01 16:01:02.320183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeShelveTestJSON-788013046 Aug 01 16:01:02.320183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: e829698141514a009e2e769854fe66f0 Aug 01 16:01:02.320183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-788013046 Aug 01 16:01:02.320183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeShelveTestJSON-788013046-project Aug 01 16:01:02.320183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:01:02.320183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:01:02.320183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 7d1b6c388c7642a892c905d16f3b8d50 Aug 01 16:01:02.320183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeShelveTestJSON-788013046-project Aug 01 16:01:02.320183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:01:02.320183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:02.320183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '9f1ace13-28cc-4664-b4d7-7d9672ea2580'} Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:01:02.321045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. Aug 01 16:01:02.322521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:01:02.323761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-70c78a9d-237e-4bbe-9bfb-697b0ad15dac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Returning 404 to user: Instance 9f1ace13-28cc-4664-b4d7-7d9672ea2580 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:01:02.323761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-70c78a9d-237e-4bbe-9bfb-697b0ad15dac tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580" status: 404 len: 111 microversion: 2.20 time: 0.031296 Aug 01 16:01:02.323761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1443/3211] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:01:02 2022] GET /compute/v2.1/servers/9f1ace13-28cc-4664-b4d7-7d9672ea2580 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 16:01:02.403865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1e47d9f7-ce2b-4cf7-96ad-904b473ac51e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:02.411866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1e47d9f7-ce2b-4cf7-96ad-904b473ac51e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.160876 Aug 01 16:01:02.412433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1769/3212] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:02 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:02.523319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1b0f037b-f35a-4d5a-9b11-1ba77d040dbd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:02.523877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1b0f037b-f35a-4d5a-9b11-1ba77d040dbd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:02.531224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b0f037b-f35a-4d5a-9b11-1ba77d040dbd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:02.531668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b0f037b-f35a-4d5a-9b11-1ba77d040dbd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:02.532423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b0f037b-f35a-4d5a-9b11-1ba77d040dbd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:02.532855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1b0f037b-f35a-4d5a-9b11-1ba77d040dbd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:02.594485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1b0f037b-f35a-4d5a-9b11-1ba77d040dbd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:02.602555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1b0f037b-f35a-4d5a-9b11-1ba77d040dbd tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083214 Aug 01 16:01:02.604071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1444/3213] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:02 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:03.435320 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dc37308d-d409-407c-aba9-6ddd4d24e56f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:03.436092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dc37308d-d409-407c-aba9-6ddd4d24e56f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:03.442685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc37308d-d409-407c-aba9-6ddd4d24e56f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:03.443140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc37308d-d409-407c-aba9-6ddd4d24e56f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:03.443910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc37308d-d409-407c-aba9-6ddd4d24e56f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:03.444354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc37308d-d409-407c-aba9-6ddd4d24e56f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:03.580584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dc37308d-d409-407c-aba9-6ddd4d24e56f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:03.588463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dc37308d-d409-407c-aba9-6ddd4d24e56f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.157803 Aug 01 16:01:03.589023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1770/3214] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:03 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:03.625283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7c14aefa-cd6c-4d56-b685-f23707daff1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:03.625852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7c14aefa-cd6c-4d56-b685-f23707daff1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:03.632564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c14aefa-cd6c-4d56-b685-f23707daff1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:03.633008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c14aefa-cd6c-4d56-b685-f23707daff1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:03.633757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c14aefa-cd6c-4d56-b685-f23707daff1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:03.634231 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7c14aefa-cd6c-4d56-b685-f23707daff1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:03.694921 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7c14aefa-cd6c-4d56-b685-f23707daff1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:03.702863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7c14aefa-cd6c-4d56-b685-f23707daff1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.081527 Aug 01 16:01:03.703433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1445/3215] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:03 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:04.334819 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-6beade87-4fe7-4e4b-9d8b-664a242a5881 req-a242c107-6974-41fd-8d22-3eeb10108040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2122c9a8-db75-40b5-bbbe-9c83c983d961", "name": "network-vif-deleted", "tag": "419fa20b-5321-45c3-bf43-01c4530aa3fc"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:01:04.346613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-6beade87-4fe7-4e4b-9d8b-664a242a5881 req-a242c107-6974-41fd-8d22-3eeb10108040 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:04.347109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-6beade87-4fe7-4e4b-9d8b-664a242a5881 req-a242c107-6974-41fd-8d22-3eeb10108040 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:04.351091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:04.360162 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-6beade87-4fe7-4e4b-9d8b-664a242a5881 req-a242c107-6974-41fd-8d22-3eeb10108040 service nova] Creating event network-vif-deleted:419fa20b-5321-45c3-bf43-01c4530aa3fc for instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 on hv-cinder-84753 Aug 01 16:01:04.365728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-6beade87-4fe7-4e4b-9d8b-664a242a5881 req-a242c107-6974-41fd-8d22-3eeb10108040 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036038 Aug 01 16:01:04.366349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1771/3216] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:01:04.610162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b7883ac6-71c2-4f35-871f-f5bb32ba9175 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:04.610783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b7883ac6-71c2-4f35-871f-f5bb32ba9175 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:04.617026 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7883ac6-71c2-4f35-871f-f5bb32ba9175 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:04.617486 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7883ac6-71c2-4f35-871f-f5bb32ba9175 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:04.618310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7883ac6-71c2-4f35-871f-f5bb32ba9175 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:04.619901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7883ac6-71c2-4f35-871f-f5bb32ba9175 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:04.724914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f66a7392-4ff4-4a75-a3d4-43644c96e164 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:04.725631 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f66a7392-4ff4-4a75-a3d4-43644c96e164 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:04.735629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f66a7392-4ff4-4a75-a3d4-43644c96e164 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:04.736149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f66a7392-4ff4-4a75-a3d4-43644c96e164 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:04.737124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f66a7392-4ff4-4a75-a3d4-43644c96e164 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:04.737569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f66a7392-4ff4-4a75-a3d4-43644c96e164 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:04.765807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b7883ac6-71c2-4f35-871f-f5bb32ba9175 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:04.774360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b7883ac6-71c2-4f35-871f-f5bb32ba9175 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.168219 Aug 01 16:01:04.775009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1446/3217] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:04 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:04.802177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f66a7392-4ff4-4a75-a3d4-43644c96e164 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:04.810764 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f66a7392-4ff4-4a75-a3d4-43644c96e164 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.091222 Aug 01 16:01:04.811328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1772/3218] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:04 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:05.796773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f1ef4f50-3a1a-44a6-bb5e-1c1e877ff0de tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:05.797398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f1ef4f50-3a1a-44a6-bb5e-1c1e877ff0de tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:05.803889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f1ef4f50-3a1a-44a6-bb5e-1c1e877ff0de tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:05.804343 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f1ef4f50-3a1a-44a6-bb5e-1c1e877ff0de tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:05.805090 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f1ef4f50-3a1a-44a6-bb5e-1c1e877ff0de tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:05.805521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f1ef4f50-3a1a-44a6-bb5e-1c1e877ff0de tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:05.832524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a99098bc-08b5-4fc3-91ce-a0e1c3504537 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:05.833132 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a99098bc-08b5-4fc3-91ce-a0e1c3504537 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:05.840280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a99098bc-08b5-4fc3-91ce-a0e1c3504537 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:05.840725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a99098bc-08b5-4fc3-91ce-a0e1c3504537 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:05.841593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a99098bc-08b5-4fc3-91ce-a0e1c3504537 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:05.841935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a99098bc-08b5-4fc3-91ce-a0e1c3504537 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:05.910530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a99098bc-08b5-4fc3-91ce-a0e1c3504537 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:05.918969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a99098bc-08b5-4fc3-91ce-a0e1c3504537 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.090319 Aug 01 16:01:05.919672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1773/3219] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:05 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:05.969628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f1ef4f50-3a1a-44a6-bb5e-1c1e877ff0de tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:05.977803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f1ef4f50-3a1a-44a6-bb5e-1c1e877ff0de tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.184812 Aug 01 16:01:05.978402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1447/3220] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:05 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:06.939311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bc7a9443-f364-4a64-bd9a-022c2050aba0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:06.939901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bc7a9443-f364-4a64-bd9a-022c2050aba0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:06.946454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc7a9443-f364-4a64-bd9a-022c2050aba0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:06.946902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc7a9443-f364-4a64-bd9a-022c2050aba0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:06.947661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc7a9443-f364-4a64-bd9a-022c2050aba0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:06.948098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bc7a9443-f364-4a64-bd9a-022c2050aba0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:06.999848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3b571a47-ab3a-4f83-9a12-8c25060f733d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:07.000463 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3b571a47-ab3a-4f83-9a12-8c25060f733d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:07.007060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3b571a47-ab3a-4f83-9a12-8c25060f733d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:07.007513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3b571a47-ab3a-4f83-9a12-8c25060f733d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:07.008562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3b571a47-ab3a-4f83-9a12-8c25060f733d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:07.008689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3b571a47-ab3a-4f83-9a12-8c25060f733d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:07.010944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bc7a9443-f364-4a64-bd9a-022c2050aba0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:07.018992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bc7a9443-f364-4a64-bd9a-022c2050aba0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083510 Aug 01 16:01:07.019564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1774/3221] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:06 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:07.142005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3b571a47-ab3a-4f83-9a12-8c25060f733d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:07.145526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:07.151599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3b571a47-ab3a-4f83-9a12-8c25060f733d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156032 Aug 01 16:01:07.152165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1448/3222] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:06 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:08.041530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7e325b3d-aabf-4a65-bc3b-50719fa6e9b4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:08.042158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7e325b3d-aabf-4a65-bc3b-50719fa6e9b4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:08.045098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:08.051589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e325b3d-aabf-4a65-bc3b-50719fa6e9b4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:08.052159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e325b3d-aabf-4a65-bc3b-50719fa6e9b4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:08.052868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e325b3d-aabf-4a65-bc3b-50719fa6e9b4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:08.053315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7e325b3d-aabf-4a65-bc3b-50719fa6e9b4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:08.119226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7e325b3d-aabf-4a65-bc3b-50719fa6e9b4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:08.127431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7e325b3d-aabf-4a65-bc3b-50719fa6e9b4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.090478 Aug 01 16:01:08.128371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1775/3223] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:08 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:08.172938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-19ac933b-58d0-4e03-8c2f-5c95f012c282 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:08.173559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-19ac933b-58d0-4e03-8c2f-5c95f012c282 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:08.180391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-19ac933b-58d0-4e03-8c2f-5c95f012c282 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:08.181523 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-19ac933b-58d0-4e03-8c2f-5c95f012c282 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:08.182323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-19ac933b-58d0-4e03-8c2f-5c95f012c282 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:08.182765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-19ac933b-58d0-4e03-8c2f-5c95f012c282 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:08.313283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-19ac933b-58d0-4e03-8c2f-5c95f012c282 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:08.321185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-19ac933b-58d0-4e03-8c2f-5c95f012c282 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152300 Aug 01 16:01:08.321748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1449/3224] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:08 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:09.154424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f307ad93-0fad-4cb6-907b-acb2b11e3425 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:09.155042 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f307ad93-0fad-4cb6-907b-acb2b11e3425 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:09.163039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f307ad93-0fad-4cb6-907b-acb2b11e3425 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:09.163495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f307ad93-0fad-4cb6-907b-acb2b11e3425 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:09.164271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f307ad93-0fad-4cb6-907b-acb2b11e3425 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:09.164713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f307ad93-0fad-4cb6-907b-acb2b11e3425 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:09.229114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f307ad93-0fad-4cb6-907b-acb2b11e3425 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:09.236978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f307ad93-0fad-4cb6-907b-acb2b11e3425 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087086 Aug 01 16:01:09.237543 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1776/3225] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:09 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:09.342713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-df1dab33-0106-44eb-bd8c-1cd9091d63c5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:09.343285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-df1dab33-0106-44eb-bd8c-1cd9091d63c5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:09.349703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df1dab33-0106-44eb-bd8c-1cd9091d63c5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:09.350183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df1dab33-0106-44eb-bd8c-1cd9091d63c5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:09.350933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df1dab33-0106-44eb-bd8c-1cd9091d63c5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:09.351366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-df1dab33-0106-44eb-bd8c-1cd9091d63c5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:09.484789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-df1dab33-0106-44eb-bd8c-1cd9091d63c5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:09.492748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-df1dab33-0106-44eb-bd8c-1cd9091d63c5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154049 Aug 01 16:01:09.493308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1450/3226] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:09 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:10.258408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cbb42f34-6b99-4e6e-aac1-d9513391d654 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:10.259614 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cbb42f34-6b99-4e6e-aac1-d9513391d654 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:10.269621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cbb42f34-6b99-4e6e-aac1-d9513391d654 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:10.270142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cbb42f34-6b99-4e6e-aac1-d9513391d654 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:10.270924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cbb42f34-6b99-4e6e-aac1-d9513391d654 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:10.271363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cbb42f34-6b99-4e6e-aac1-d9513391d654 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:10.335167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cbb42f34-6b99-4e6e-aac1-d9513391d654 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:10.343158 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cbb42f34-6b99-4e6e-aac1-d9513391d654 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088725 Aug 01 16:01:10.343724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1777/3227] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:10 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:10.514448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f5b26668-8099-40f7-a420-73eb7da8bbe1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:10.514987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f5b26668-8099-40f7-a420-73eb7da8bbe1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:10.521527 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f5b26668-8099-40f7-a420-73eb7da8bbe1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:10.522014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f5b26668-8099-40f7-a420-73eb7da8bbe1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:10.522782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f5b26668-8099-40f7-a420-73eb7da8bbe1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:10.523224 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f5b26668-8099-40f7-a420-73eb7da8bbe1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:10.666212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f5b26668-8099-40f7-a420-73eb7da8bbe1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:10.674316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f5b26668-8099-40f7-a420-73eb7da8bbe1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.163824 Aug 01 16:01:10.674872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1451/3228] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:10 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:11.364673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1ea34270-c20e-4488-8968-8e383893094b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:11.365228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1ea34270-c20e-4488-8968-8e383893094b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:11.371710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ea34270-c20e-4488-8968-8e383893094b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:11.372188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ea34270-c20e-4488-8968-8e383893094b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:11.372941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ea34270-c20e-4488-8968-8e383893094b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:11.373369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1ea34270-c20e-4488-8968-8e383893094b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:11.435505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1ea34270-c20e-4488-8968-8e383893094b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:11.443548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1ea34270-c20e-4488-8968-8e383893094b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082806 Aug 01 16:01:11.444108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1778/3229] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:11 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:11.696251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4c3fb077-0b78-4114-aa06-ec58dfed9623 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:11.697462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4c3fb077-0b78-4114-aa06-ec58dfed9623 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:11.704060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c3fb077-0b78-4114-aa06-ec58dfed9623 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:11.704509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c3fb077-0b78-4114-aa06-ec58dfed9623 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:11.705270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c3fb077-0b78-4114-aa06-ec58dfed9623 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:11.705711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c3fb077-0b78-4114-aa06-ec58dfed9623 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:11.844302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4c3fb077-0b78-4114-aa06-ec58dfed9623 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:11.853358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4c3fb077-0b78-4114-aa06-ec58dfed9623 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.160416 Aug 01 16:01:11.854254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1452/3230] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:11 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:12.465524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f2744a04-bc64-4526-9ae2-24893204c42b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:12.466187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f2744a04-bc64-4526-9ae2-24893204c42b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:12.472757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2744a04-bc64-4526-9ae2-24893204c42b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:12.473196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2744a04-bc64-4526-9ae2-24893204c42b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:12.473981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2744a04-bc64-4526-9ae2-24893204c42b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:12.474412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f2744a04-bc64-4526-9ae2-24893204c42b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:12.542046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f2744a04-bc64-4526-9ae2-24893204c42b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:12.549920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f2744a04-bc64-4526-9ae2-24893204c42b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088917 Aug 01 16:01:12.550492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1779/3231] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:12 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:12.875281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e9bfb580-7ddd-4c98-89e1-74d8b179c254 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:12.875897 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e9bfb580-7ddd-4c98-89e1-74d8b179c254 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:12.882482 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9bfb580-7ddd-4c98-89e1-74d8b179c254 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:12.882935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9bfb580-7ddd-4c98-89e1-74d8b179c254 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:12.884478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9bfb580-7ddd-4c98-89e1-74d8b179c254 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:12.885311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e9bfb580-7ddd-4c98-89e1-74d8b179c254 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:13.016566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e9bfb580-7ddd-4c98-89e1-74d8b179c254 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:13.024644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e9bfb580-7ddd-4c98-89e1-74d8b179c254 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153229 Aug 01 16:01:13.025268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1453/3232] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:12 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:13.570399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5e6dc329-3396-49c4-a89a-e992e260a344 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:13.571076 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5e6dc329-3396-49c4-a89a-e992e260a344 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:13.577822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e6dc329-3396-49c4-a89a-e992e260a344 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:13.578380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e6dc329-3396-49c4-a89a-e992e260a344 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:13.579151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e6dc329-3396-49c4-a89a-e992e260a344 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:13.579594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e6dc329-3396-49c4-a89a-e992e260a344 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:13.640992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5e6dc329-3396-49c4-a89a-e992e260a344 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:13.649235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5e6dc329-3396-49c4-a89a-e992e260a344 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082659 Aug 01 16:01:13.650370 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1780/3233] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:13 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:14.046652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ca310bf1-b16d-41ba-a78a-940358b77091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:14.047222 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ca310bf1-b16d-41ba-a78a-940358b77091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:14.053967 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca310bf1-b16d-41ba-a78a-940358b77091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:14.054682 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca310bf1-b16d-41ba-a78a-940358b77091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:14.055188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca310bf1-b16d-41ba-a78a-940358b77091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:14.055632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca310bf1-b16d-41ba-a78a-940358b77091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:14.192822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ca310bf1-b16d-41ba-a78a-940358b77091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:14.201688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ca310bf1-b16d-41ba-a78a-940358b77091 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.158911 Aug 01 16:01:14.202306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1454/3234] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:14 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:14.671228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-506f881c-afb0-494c-ac88-2e2fef3dce5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:14.671845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-506f881c-afb0-494c-ac88-2e2fef3dce5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:14.678528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-506f881c-afb0-494c-ac88-2e2fef3dce5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:14.678980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-506f881c-afb0-494c-ac88-2e2fef3dce5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:14.679747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-506f881c-afb0-494c-ac88-2e2fef3dce5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:14.680182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-506f881c-afb0-494c-ac88-2e2fef3dce5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:14.743011 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-506f881c-afb0-494c-ac88-2e2fef3dce5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:14.751676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-506f881c-afb0-494c-ac88-2e2fef3dce5d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084378 Aug 01 16:01:14.752256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1781/3235] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:14 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:15.226156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-138e1736-e95e-4a78-914c-27123b92972d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:15.226752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-138e1736-e95e-4a78-914c-27123b92972d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:15.229935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:15.235256 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-138e1736-e95e-4a78-914c-27123b92972d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:15.235706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-138e1736-e95e-4a78-914c-27123b92972d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:15.236470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-138e1736-e95e-4a78-914c-27123b92972d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:15.236907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-138e1736-e95e-4a78-914c-27123b92972d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:15.365445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-138e1736-e95e-4a78-914c-27123b92972d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:15.373690 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-138e1736-e95e-4a78-914c-27123b92972d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153768 Aug 01 16:01:15.374294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1455/3236] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:15 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:15.773299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1cd5a147-8523-4c0b-a340-51fb9e9a08bc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:15.773929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1cd5a147-8523-4c0b-a340-51fb9e9a08bc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:15.781112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cd5a147-8523-4c0b-a340-51fb9e9a08bc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:15.781564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cd5a147-8523-4c0b-a340-51fb9e9a08bc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:15.782369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cd5a147-8523-4c0b-a340-51fb9e9a08bc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:15.782810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1cd5a147-8523-4c0b-a340-51fb9e9a08bc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:15.847498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1cd5a147-8523-4c0b-a340-51fb9e9a08bc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:15.855748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1cd5a147-8523-4c0b-a340-51fb9e9a08bc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086291 Aug 01 16:01:15.856312 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1782/3237] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:15 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:16.395163 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0e953d05-767d-4f0c-ae93-5338bd442746 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:16.395755 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0e953d05-767d-4f0c-ae93-5338bd442746 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:16.402339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e953d05-767d-4f0c-ae93-5338bd442746 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:16.402791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e953d05-767d-4f0c-ae93-5338bd442746 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:16.403562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e953d05-767d-4f0c-ae93-5338bd442746 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:16.404002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e953d05-767d-4f0c-ae93-5338bd442746 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:16.533183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0e953d05-767d-4f0c-ae93-5338bd442746 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:16.542315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0e953d05-767d-4f0c-ae93-5338bd442746 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150931 Aug 01 16:01:16.543092 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1456/3238] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:16 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:16.876592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0e3bc410-c181-4965-83ce-89b8774e32cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:16.877208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0e3bc410-c181-4965-83ce-89b8774e32cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:16.883834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e3bc410-c181-4965-83ce-89b8774e32cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:16.884285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e3bc410-c181-4965-83ce-89b8774e32cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:16.885056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e3bc410-c181-4965-83ce-89b8774e32cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:16.885497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0e3bc410-c181-4965-83ce-89b8774e32cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:16.949169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0e3bc410-c181-4965-83ce-89b8774e32cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:16.957170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0e3bc410-c181-4965-83ce-89b8774e32cc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084450 Aug 01 16:01:16.957734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1783/3239] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:16 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:17.564706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-aee19214-dc03-4f47-9a60-ab2607257015 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:17.565321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-aee19214-dc03-4f47-9a60-ab2607257015 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:17.572083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aee19214-dc03-4f47-9a60-ab2607257015 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:17.572536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aee19214-dc03-4f47-9a60-ab2607257015 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:17.573295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aee19214-dc03-4f47-9a60-ab2607257015 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:17.573743 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aee19214-dc03-4f47-9a60-ab2607257015 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:17.708478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-aee19214-dc03-4f47-9a60-ab2607257015 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:17.717247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-aee19214-dc03-4f47-9a60-ab2607257015 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156373 Aug 01 16:01:17.717813 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1457/3240] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:17 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:17.978256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-abeea89e-a8d2-46d2-967e-e65beda84c15 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:17.978845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-abeea89e-a8d2-46d2-967e-e65beda84c15 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:17.985554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abeea89e-a8d2-46d2-967e-e65beda84c15 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:17.986050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abeea89e-a8d2-46d2-967e-e65beda84c15 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:17.986820 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abeea89e-a8d2-46d2-967e-e65beda84c15 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:17.987292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abeea89e-a8d2-46d2-967e-e65beda84c15 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:18.048120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-abeea89e-a8d2-46d2-967e-e65beda84c15 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:18.056769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-abeea89e-a8d2-46d2-967e-e65beda84c15 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082546 Aug 01 16:01:18.057345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1784/3241] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:17 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:18.740688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4f6a7dcf-c034-449a-8c5b-4af6a626aea2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:18.741271 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4f6a7dcf-c034-449a-8c5b-4af6a626aea2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:18.748704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f6a7dcf-c034-449a-8c5b-4af6a626aea2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:18.749153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f6a7dcf-c034-449a-8c5b-4af6a626aea2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:18.749940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f6a7dcf-c034-449a-8c5b-4af6a626aea2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:18.750378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f6a7dcf-c034-449a-8c5b-4af6a626aea2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:18.878848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4f6a7dcf-c034-449a-8c5b-4af6a626aea2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:18.886841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4f6a7dcf-c034-449a-8c5b-4af6a626aea2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150014 Aug 01 16:01:18.887947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1458/3242] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:18 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:19.077840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-541c1b33-9727-4453-96f6-9eaa41be3e02 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:19.078515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-541c1b33-9727-4453-96f6-9eaa41be3e02 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:19.084861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-541c1b33-9727-4453-96f6-9eaa41be3e02 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:19.085316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-541c1b33-9727-4453-96f6-9eaa41be3e02 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:19.086113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-541c1b33-9727-4453-96f6-9eaa41be3e02 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:19.086559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-541c1b33-9727-4453-96f6-9eaa41be3e02 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:19.151872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-541c1b33-9727-4453-96f6-9eaa41be3e02 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:19.159997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-541c1b33-9727-4453-96f6-9eaa41be3e02 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086017 Aug 01 16:01:19.160566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1785/3243] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:19 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:19.908790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c05a3289-2bfa-46cb-9842-0917690c67f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:19.909407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c05a3289-2bfa-46cb-9842-0917690c67f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:19.916142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c05a3289-2bfa-46cb-9842-0917690c67f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:19.916592 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c05a3289-2bfa-46cb-9842-0917690c67f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:19.917359 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c05a3289-2bfa-46cb-9842-0917690c67f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:19.917799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c05a3289-2bfa-46cb-9842-0917690c67f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:20.047040 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c05a3289-2bfa-46cb-9842-0917690c67f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:20.056435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c05a3289-2bfa-46cb-9842-0917690c67f9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150916 Aug 01 16:01:20.057009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1459/3244] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:19 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:20.182743 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1e33fc51-d22c-48a7-8973-ca5b351b4055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:20.183365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1e33fc51-d22c-48a7-8973-ca5b351b4055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:20.192978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e33fc51-d22c-48a7-8973-ca5b351b4055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:20.192978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e33fc51-d22c-48a7-8973-ca5b351b4055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:20.192978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e33fc51-d22c-48a7-8973-ca5b351b4055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:20.192978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1e33fc51-d22c-48a7-8973-ca5b351b4055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:20.260032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1e33fc51-d22c-48a7-8973-ca5b351b4055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:20.268430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1e33fc51-d22c-48a7-8973-ca5b351b4055 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.090456 Aug 01 16:01:20.269004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1786/3245] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:20 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:20.957297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:01:20.957583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 16:01:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:01:21.077473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-46205894-613d-49a8-a432-3c6798d9fad4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:21.078225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-46205894-613d-49a8-a432-3c6798d9fad4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:21.084949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-46205894-613d-49a8-a432-3c6798d9fad4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:21.085404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-46205894-613d-49a8-a432-3c6798d9fad4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:21.086199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-46205894-613d-49a8-a432-3c6798d9fad4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:21.086643 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-46205894-613d-49a8-a432-3c6798d9fad4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:21.218830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-46205894-613d-49a8-a432-3c6798d9fad4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:21.227144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-46205894-613d-49a8-a432-3c6798d9fad4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153588 Aug 01 16:01:21.227714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1460/3246] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:21 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:21.289327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-778ef279-c108-41bf-b387-776a49632101 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:21.290117 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-778ef279-c108-41bf-b387-776a49632101 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:21.298220 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-778ef279-c108-41bf-b387-776a49632101 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:21.298680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-778ef279-c108-41bf-b387-776a49632101 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:21.299462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-778ef279-c108-41bf-b387-776a49632101 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:21.299904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-778ef279-c108-41bf-b387-776a49632101 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:21.362092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-778ef279-c108-41bf-b387-776a49632101 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:21.370773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-778ef279-c108-41bf-b387-776a49632101 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085638 Aug 01 16:01:21.371343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1787/3247] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:21 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:22.248825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-445510a9-8552-4a96-be11-ab5c0cffbfc1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:22.249433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-445510a9-8552-4a96-be11-ab5c0cffbfc1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:22.256031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-445510a9-8552-4a96-be11-ab5c0cffbfc1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:22.256480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-445510a9-8552-4a96-be11-ab5c0cffbfc1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:22.257243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-445510a9-8552-4a96-be11-ab5c0cffbfc1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:22.257677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-445510a9-8552-4a96-be11-ab5c0cffbfc1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:22.391785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fe26306f-aa08-4b66-aea4-f9e6b387d881 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:22.392407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fe26306f-aa08-4b66-aea4-f9e6b387d881 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:22.393481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-445510a9-8552-4a96-be11-ab5c0cffbfc1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:22.399070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe26306f-aa08-4b66-aea4-f9e6b387d881 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:22.400197 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe26306f-aa08-4b66-aea4-f9e6b387d881 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:22.401541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe26306f-aa08-4b66-aea4-f9e6b387d881 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:22.402206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-445510a9-8552-4a96-be11-ab5c0cffbfc1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.157203 Aug 01 16:01:22.402389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fe26306f-aa08-4b66-aea4-f9e6b387d881 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:22.402876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1461/3248] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:22 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:22.422727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:22.470697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fe26306f-aa08-4b66-aea4-f9e6b387d881 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:22.479528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fe26306f-aa08-4b66-aea4-f9e6b387d881 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.091565 Aug 01 16:01:22.480090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1788/3249] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:22 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:23.423606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fca04d11-e112-44c3-9339-5b240ce39be3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:23.424220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fca04d11-e112-44c3-9339-5b240ce39be3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:23.431292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fca04d11-e112-44c3-9339-5b240ce39be3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:23.431741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fca04d11-e112-44c3-9339-5b240ce39be3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:23.432495 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fca04d11-e112-44c3-9339-5b240ce39be3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:23.432940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fca04d11-e112-44c3-9339-5b240ce39be3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:23.500302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2d5178ba-5b84-4c07-8267-19211511d4a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:23.500944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2d5178ba-5b84-4c07-8267-19211511d4a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:23.507886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d5178ba-5b84-4c07-8267-19211511d4a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:23.508362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d5178ba-5b84-4c07-8267-19211511d4a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:23.509774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d5178ba-5b84-4c07-8267-19211511d4a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:23.510267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d5178ba-5b84-4c07-8267-19211511d4a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:23.584772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2d5178ba-5b84-4c07-8267-19211511d4a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:23.588124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fca04d11-e112-44c3-9339-5b240ce39be3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:23.592857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2d5178ba-5b84-4c07-8267-19211511d4a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.096398 Aug 01 16:01:23.593626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1789/3250] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:23 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:23.596401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fca04d11-e112-44c3-9339-5b240ce39be3 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.176680 Aug 01 16:01:23.597044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1462/3251] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:23 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:24.614089 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a71412f4-94c9-4d8d-97c7-3e03cca3f8e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:24.614879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a71412f4-94c9-4d8d-97c7-3e03cca3f8e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:24.618326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b2dd5b00-4b73-4082-b612-7644ab205fd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:24.618933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b2dd5b00-4b73-4082-b612-7644ab205fd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:24.621617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a71412f4-94c9-4d8d-97c7-3e03cca3f8e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:24.622116 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a71412f4-94c9-4d8d-97c7-3e03cca3f8e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:24.622960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a71412f4-94c9-4d8d-97c7-3e03cca3f8e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:24.623401 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a71412f4-94c9-4d8d-97c7-3e03cca3f8e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:24.626589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b2dd5b00-4b73-4082-b612-7644ab205fd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:24.627037 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b2dd5b00-4b73-4082-b612-7644ab205fd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:24.627806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b2dd5b00-4b73-4082-b612-7644ab205fd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:24.628242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b2dd5b00-4b73-4082-b612-7644ab205fd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:24.712841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a71412f4-94c9-4d8d-97c7-3e03cca3f8e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:24.720901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a71412f4-94c9-4d8d-97c7-3e03cca3f8e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.110742 Aug 01 16:01:24.721470 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1790/3252] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:24 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:24.780601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b2dd5b00-4b73-4082-b612-7644ab205fd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:24.788593 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b2dd5b00-4b73-4082-b612-7644ab205fd5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.174778 Aug 01 16:01:24.789149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1463/3253] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:24 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:25.742346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d0a7ef02-89a6-4206-80ab-cc2e55046617 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:25.743618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d0a7ef02-89a6-4206-80ab-cc2e55046617 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:25.750188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0a7ef02-89a6-4206-80ab-cc2e55046617 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:25.750632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0a7ef02-89a6-4206-80ab-cc2e55046617 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:25.751395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0a7ef02-89a6-4206-80ab-cc2e55046617 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:25.751822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0a7ef02-89a6-4206-80ab-cc2e55046617 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:25.811769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9bc99624-3cb1-4292-930f-238f09029a9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:25.824842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d0a7ef02-89a6-4206-80ab-cc2e55046617 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:25.824842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d0a7ef02-89a6-4206-80ab-cc2e55046617 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084815 Aug 01 16:01:25.824842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1791/3254] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:25 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:25.826284 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9bc99624-3cb1-4292-930f-238f09029a9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:25.832854 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bc99624-3cb1-4292-930f-238f09029a9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:25.833305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bc99624-3cb1-4292-930f-238f09029a9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:25.834108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bc99624-3cb1-4292-930f-238f09029a9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:25.834552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bc99624-3cb1-4292-930f-238f09029a9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:25.986601 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9bc99624-3cb1-4292-930f-238f09029a9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:25.995029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9bc99624-3cb1-4292-930f-238f09029a9c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.188092 Aug 01 16:01:25.995585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1464/3255] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:25 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:26.844177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ccf6e158-1603-40b5-b279-27de6562bd18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:26.844828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ccf6e158-1603-40b5-b279-27de6562bd18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:26.851137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ccf6e158-1603-40b5-b279-27de6562bd18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:26.851579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ccf6e158-1603-40b5-b279-27de6562bd18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:26.852351 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ccf6e158-1603-40b5-b279-27de6562bd18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:26.852788 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ccf6e158-1603-40b5-b279-27de6562bd18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:26.917077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ccf6e158-1603-40b5-b279-27de6562bd18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:26.925180 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ccf6e158-1603-40b5-b279-27de6562bd18 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084927 Aug 01 16:01:26.925747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1792/3256] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:26 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:27.015940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-69efce36-a63d-4e08-8361-ed5ead727314 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:27.016585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-69efce36-a63d-4e08-8361-ed5ead727314 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:27.023191 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-69efce36-a63d-4e08-8361-ed5ead727314 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:27.023642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-69efce36-a63d-4e08-8361-ed5ead727314 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:27.024976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-69efce36-a63d-4e08-8361-ed5ead727314 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:27.025422 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-69efce36-a63d-4e08-8361-ed5ead727314 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:27.043549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:27.155102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-69efce36-a63d-4e08-8361-ed5ead727314 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:27.163075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-69efce36-a63d-4e08-8361-ed5ead727314 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151155 Aug 01 16:01:27.163647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1465/3257] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:27 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:27.946981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4c2dd57a-807b-403e-86cd-60a25dff6d4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:27.947701 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4c2dd57a-807b-403e-86cd-60a25dff6d4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:27.954522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c2dd57a-807b-403e-86cd-60a25dff6d4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:27.954971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c2dd57a-807b-403e-86cd-60a25dff6d4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:27.955825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c2dd57a-807b-403e-86cd-60a25dff6d4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:27.956266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4c2dd57a-807b-403e-86cd-60a25dff6d4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:28.020972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4c2dd57a-807b-403e-86cd-60a25dff6d4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:28.029498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4c2dd57a-807b-403e-86cd-60a25dff6d4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086413 Aug 01 16:01:28.030155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1793/3258] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:27 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:28.184393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ad735ccc-8bd9-489a-87dd-ad323a78af6b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:28.185001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ad735ccc-8bd9-489a-87dd-ad323a78af6b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:28.191513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad735ccc-8bd9-489a-87dd-ad323a78af6b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:28.191958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad735ccc-8bd9-489a-87dd-ad323a78af6b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:28.192707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad735ccc-8bd9-489a-87dd-ad323a78af6b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:28.193170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad735ccc-8bd9-489a-87dd-ad323a78af6b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:28.322745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ad735ccc-8bd9-489a-87dd-ad323a78af6b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:28.330978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ad735ccc-8bd9-489a-87dd-ad323a78af6b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150500 Aug 01 16:01:28.331542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1466/3259] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:28 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:29.051179 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-745a4aaa-7eac-4edd-9977-f0816f1dbad9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:29.051784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-745a4aaa-7eac-4edd-9977-f0816f1dbad9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:29.059000 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-745a4aaa-7eac-4edd-9977-f0816f1dbad9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:29.059449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-745a4aaa-7eac-4edd-9977-f0816f1dbad9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:29.060226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-745a4aaa-7eac-4edd-9977-f0816f1dbad9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:29.060670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-745a4aaa-7eac-4edd-9977-f0816f1dbad9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:29.124301 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-745a4aaa-7eac-4edd-9977-f0816f1dbad9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:29.132304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-745a4aaa-7eac-4edd-9977-f0816f1dbad9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085074 Aug 01 16:01:29.132870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1794/3260] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:29 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:29.353775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e8a3ccf9-501b-4d5e-99e4-0730ceb48224 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:29.354683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e8a3ccf9-501b-4d5e-99e4-0730ceb48224 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:29.361871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8a3ccf9-501b-4d5e-99e4-0730ceb48224 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:29.362339 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8a3ccf9-501b-4d5e-99e4-0730ceb48224 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:29.363099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8a3ccf9-501b-4d5e-99e4-0730ceb48224 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:29.363546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8a3ccf9-501b-4d5e-99e4-0730ceb48224 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:29.496179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e8a3ccf9-501b-4d5e-99e4-0730ceb48224 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:29.504411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e8a3ccf9-501b-4d5e-99e4-0730ceb48224 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155167 Aug 01 16:01:29.505016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1467/3261] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:29 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:30.153550 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-95743741-0f14-4d3c-90be-020c4eeaed3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:30.154177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-95743741-0f14-4d3c-90be-020c4eeaed3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:30.160797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-95743741-0f14-4d3c-90be-020c4eeaed3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:30.161240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-95743741-0f14-4d3c-90be-020c4eeaed3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:30.162037 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-95743741-0f14-4d3c-90be-020c4eeaed3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:30.162475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-95743741-0f14-4d3c-90be-020c4eeaed3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:30.223618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-95743741-0f14-4d3c-90be-020c4eeaed3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:30.232546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-95743741-0f14-4d3c-90be-020c4eeaed3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083405 Aug 01 16:01:30.233114 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1795/3262] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:30 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:30.526623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f83edd3e-10a8-48e7-9db6-e9671bcd0f99 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:30.527279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f83edd3e-10a8-48e7-9db6-e9671bcd0f99 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:30.533990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f83edd3e-10a8-48e7-9db6-e9671bcd0f99 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:30.534441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f83edd3e-10a8-48e7-9db6-e9671bcd0f99 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:30.535234 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f83edd3e-10a8-48e7-9db6-e9671bcd0f99 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:30.535674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f83edd3e-10a8-48e7-9db6-e9671bcd0f99 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:30.665747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f83edd3e-10a8-48e7-9db6-e9671bcd0f99 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:30.673854 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f83edd3e-10a8-48e7-9db6-e9671bcd0f99 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151100 Aug 01 16:01:30.674441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1468/3263] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:30 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:31.253916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-664abc20-9496-457a-aebf-929778219e2c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:31.254574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-664abc20-9496-457a-aebf-929778219e2c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:31.261091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-664abc20-9496-457a-aebf-929778219e2c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:31.261577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-664abc20-9496-457a-aebf-929778219e2c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:31.262400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-664abc20-9496-457a-aebf-929778219e2c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:31.262835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-664abc20-9496-457a-aebf-929778219e2c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:31.325868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-664abc20-9496-457a-aebf-929778219e2c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:31.333875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-664abc20-9496-457a-aebf-929778219e2c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083847 Aug 01 16:01:31.334456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1796/3264] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:31 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:31.696966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6bab6b03-9ca7-4f46-a9c7-db8b2103e550 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:31.697570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6bab6b03-9ca7-4f46-a9c7-db8b2103e550 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:31.704184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bab6b03-9ca7-4f46-a9c7-db8b2103e550 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:31.704627 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bab6b03-9ca7-4f46-a9c7-db8b2103e550 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:31.705376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bab6b03-9ca7-4f46-a9c7-db8b2103e550 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:31.705806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6bab6b03-9ca7-4f46-a9c7-db8b2103e550 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:31.839001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6bab6b03-9ca7-4f46-a9c7-db8b2103e550 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:31.847006 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6bab6b03-9ca7-4f46-a9c7-db8b2103e550 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154552 Aug 01 16:01:31.847564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1469/3265] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:31 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:32.355834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-67fc5d3f-2f32-46e1-9f00-1aec8a48588b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:32.356425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-67fc5d3f-2f32-46e1-9f00-1aec8a48588b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:32.362829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67fc5d3f-2f32-46e1-9f00-1aec8a48588b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:32.363280 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67fc5d3f-2f32-46e1-9f00-1aec8a48588b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:32.364027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67fc5d3f-2f32-46e1-9f00-1aec8a48588b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:32.364455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-67fc5d3f-2f32-46e1-9f00-1aec8a48588b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:32.428798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-67fc5d3f-2f32-46e1-9f00-1aec8a48588b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:32.437497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-67fc5d3f-2f32-46e1-9f00-1aec8a48588b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085868 Aug 01 16:01:32.438103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1797/3266] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:32 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:32.869295 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3761f8b5-82c9-4dda-9eaa-7f7b35acecdb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:32.869948 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3761f8b5-82c9-4dda-9eaa-7f7b35acecdb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:32.876643 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3761f8b5-82c9-4dda-9eaa-7f7b35acecdb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:32.877092 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3761f8b5-82c9-4dda-9eaa-7f7b35acecdb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:32.877853 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3761f8b5-82c9-4dda-9eaa-7f7b35acecdb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:32.878320 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3761f8b5-82c9-4dda-9eaa-7f7b35acecdb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:33.009337 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3761f8b5-82c9-4dda-9eaa-7f7b35acecdb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:33.017475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3761f8b5-82c9-4dda-9eaa-7f7b35acecdb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152707 Aug 01 16:01:33.018083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1470/3267] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:32 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:33.458974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b432118f-a10c-41fc-a291-1c82f7f08b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:33.459569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b432118f-a10c-41fc-a291-1c82f7f08b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:33.466671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b432118f-a10c-41fc-a291-1c82f7f08b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:33.467121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b432118f-a10c-41fc-a291-1c82f7f08b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:33.467881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b432118f-a10c-41fc-a291-1c82f7f08b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:33.468315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b432118f-a10c-41fc-a291-1c82f7f08b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:33.531909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b432118f-a10c-41fc-a291-1c82f7f08b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:33.540528 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b432118f-a10c-41fc-a291-1c82f7f08b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084755 Aug 01 16:01:33.541126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1798/3268] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:33 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:34.041524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4bcf4535-7292-47b7-bced-781392ab58ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:34.042147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4bcf4535-7292-47b7-bced-781392ab58ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:34.048776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4bcf4535-7292-47b7-bced-781392ab58ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:34.049230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4bcf4535-7292-47b7-bced-781392ab58ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:34.050021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4bcf4535-7292-47b7-bced-781392ab58ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:34.050465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4bcf4535-7292-47b7-bced-781392ab58ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:34.178792 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4bcf4535-7292-47b7-bced-781392ab58ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:34.187325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4bcf4535-7292-47b7-bced-781392ab58ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.149797 Aug 01 16:01:34.187891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1471/3269] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:34 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:34.561286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0de01ec2-74bb-4fb8-8967-95b7a4a75d96 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:34.561925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0de01ec2-74bb-4fb8-8967-95b7a4a75d96 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:34.568452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0de01ec2-74bb-4fb8-8967-95b7a4a75d96 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:34.568902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0de01ec2-74bb-4fb8-8967-95b7a4a75d96 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:34.569675 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0de01ec2-74bb-4fb8-8967-95b7a4a75d96 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:34.570125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0de01ec2-74bb-4fb8-8967-95b7a4a75d96 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:34.634256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0de01ec2-74bb-4fb8-8967-95b7a4a75d96 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:34.642258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0de01ec2-74bb-4fb8-8967-95b7a4a75d96 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084952 Aug 01 16:01:34.642822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1799/3270] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:34 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:35.209255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0ce62ce2-6b3d-4275-a785-d05564f78103 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:35.209868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0ce62ce2-6b3d-4275-a785-d05564f78103 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:35.217119 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ce62ce2-6b3d-4275-a785-d05564f78103 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:35.217576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ce62ce2-6b3d-4275-a785-d05564f78103 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:35.218373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ce62ce2-6b3d-4275-a785-d05564f78103 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:35.218821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0ce62ce2-6b3d-4275-a785-d05564f78103 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:35.359674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0ce62ce2-6b3d-4275-a785-d05564f78103 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:35.367552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0ce62ce2-6b3d-4275-a785-d05564f78103 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.162156 Aug 01 16:01:35.368124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1472/3271] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:35 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:35.663850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bccba74f-42d9-4e5f-8dad-742db1e12767 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:35.664510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bccba74f-42d9-4e5f-8dad-742db1e12767 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:35.671321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bccba74f-42d9-4e5f-8dad-742db1e12767 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:35.671770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bccba74f-42d9-4e5f-8dad-742db1e12767 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:35.672533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bccba74f-42d9-4e5f-8dad-742db1e12767 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:35.672972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bccba74f-42d9-4e5f-8dad-742db1e12767 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:35.734304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bccba74f-42d9-4e5f-8dad-742db1e12767 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:35.742276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bccba74f-42d9-4e5f-8dad-742db1e12767 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082333 Aug 01 16:01:35.743338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1800/3272] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:35 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:36.388544 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9277943f-a9d0-4cc2-ad55-c8831b7764cb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:36.389161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9277943f-a9d0-4cc2-ad55-c8831b7764cb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:36.395731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9277943f-a9d0-4cc2-ad55-c8831b7764cb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:36.396175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9277943f-a9d0-4cc2-ad55-c8831b7764cb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:36.396927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9277943f-a9d0-4cc2-ad55-c8831b7764cb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:36.397354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9277943f-a9d0-4cc2-ad55-c8831b7764cb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:36.528376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9277943f-a9d0-4cc2-ad55-c8831b7764cb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:36.536490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9277943f-a9d0-4cc2-ad55-c8831b7764cb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151782 Aug 01 16:01:36.537075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1473/3273] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:36 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:36.763525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e1228f68-e847-4ca4-b639-3069c672ced2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:36.764165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e1228f68-e847-4ca4-b639-3069c672ced2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:36.770734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1228f68-e847-4ca4-b639-3069c672ced2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:36.771188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1228f68-e847-4ca4-b639-3069c672ced2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:36.771952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1228f68-e847-4ca4-b639-3069c672ced2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:36.772390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e1228f68-e847-4ca4-b639-3069c672ced2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:36.835785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e1228f68-e847-4ca4-b639-3069c672ced2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:36.844454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e1228f68-e847-4ca4-b639-3069c672ced2 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084998 Aug 01 16:01:36.845023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1801/3274] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:36 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:37.559257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-33ceb18f-fab6-4b8e-abea-e20ba59321c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:37.559865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-33ceb18f-fab6-4b8e-abea-e20ba59321c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:37.566453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-33ceb18f-fab6-4b8e-abea-e20ba59321c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:37.566905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-33ceb18f-fab6-4b8e-abea-e20ba59321c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:37.567670 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-33ceb18f-fab6-4b8e-abea-e20ba59321c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:37.568124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-33ceb18f-fab6-4b8e-abea-e20ba59321c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:37.698123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-33ceb18f-fab6-4b8e-abea-e20ba59321c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:37.706118 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-33ceb18f-fab6-4b8e-abea-e20ba59321c9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151330 Aug 01 16:01:37.706682 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1474/3275] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:37 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:37.865047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ab18a03f-3b1b-4338-a056-bf20a859254e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:37.865587 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ab18a03f-3b1b-4338-a056-bf20a859254e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:37.872778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab18a03f-3b1b-4338-a056-bf20a859254e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:37.873255 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab18a03f-3b1b-4338-a056-bf20a859254e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:37.874056 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab18a03f-3b1b-4338-a056-bf20a859254e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:37.874498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab18a03f-3b1b-4338-a056-bf20a859254e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:37.935783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ab18a03f-3b1b-4338-a056-bf20a859254e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:37.943955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ab18a03f-3b1b-4338-a056-bf20a859254e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083075 Aug 01 16:01:37.944583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1802/3276] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:37 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:38.727050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4c82bd6f-2f7a-4781-8c2b-ed10b536ae12 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:38.728406 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4c82bd6f-2f7a-4781-8c2b-ed10b536ae12 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:38.735258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c82bd6f-2f7a-4781-8c2b-ed10b536ae12 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:38.735701 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c82bd6f-2f7a-4781-8c2b-ed10b536ae12 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:38.736456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c82bd6f-2f7a-4781-8c2b-ed10b536ae12 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:38.736886 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c82bd6f-2f7a-4781-8c2b-ed10b536ae12 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:38.870602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4c82bd6f-2f7a-4781-8c2b-ed10b536ae12 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:38.878729 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4c82bd6f-2f7a-4781-8c2b-ed10b536ae12 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155381 Aug 01 16:01:38.879067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1475/3277] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:38 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:38.966513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5e5503ac-b050-4a1f-8e09-18461d79642d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:38.967099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5e5503ac-b050-4a1f-8e09-18461d79642d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:38.969404 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=56 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:38.974994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e5503ac-b050-4a1f-8e09-18461d79642d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:38.975439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e5503ac-b050-4a1f-8e09-18461d79642d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:38.976193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e5503ac-b050-4a1f-8e09-18461d79642d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:38.976621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5e5503ac-b050-4a1f-8e09-18461d79642d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:39.048678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5e5503ac-b050-4a1f-8e09-18461d79642d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:39.057791 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5e5503ac-b050-4a1f-8e09-18461d79642d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.095102 Aug 01 16:01:39.058466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1803/3278] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:38 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:39.900625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e3f38e8c-535a-4196-a801-d86ef05da3c4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:39.901361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e3f38e8c-535a-4196-a801-d86ef05da3c4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:39.908215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e3f38e8c-535a-4196-a801-d86ef05da3c4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:39.908660 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e3f38e8c-535a-4196-a801-d86ef05da3c4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:39.909432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e3f38e8c-535a-4196-a801-d86ef05da3c4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:39.909864 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e3f38e8c-535a-4196-a801-d86ef05da3c4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:40.040649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e3f38e8c-535a-4196-a801-d86ef05da3c4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:40.048831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e3f38e8c-535a-4196-a801-d86ef05da3c4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152764 Aug 01 16:01:40.049398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1476/3279] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:39 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:40.078663 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f61ee4f7-eb56-42a9-b521-82e9314a2c03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:40.079273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f61ee4f7-eb56-42a9-b521-82e9314a2c03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:40.085956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f61ee4f7-eb56-42a9-b521-82e9314a2c03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:40.086410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f61ee4f7-eb56-42a9-b521-82e9314a2c03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:40.087204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f61ee4f7-eb56-42a9-b521-82e9314a2c03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:40.087643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f61ee4f7-eb56-42a9-b521-82e9314a2c03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:40.152839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f61ee4f7-eb56-42a9-b521-82e9314a2c03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:40.160927 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f61ee4f7-eb56-42a9-b521-82e9314a2c03 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086075 Aug 01 16:01:40.161525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1804/3280] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:40 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:41.071585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-292f57ed-a301-4f44-9647-1c9bc45ea41e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:41.072205 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-292f57ed-a301-4f44-9647-1c9bc45ea41e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:41.078787 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-292f57ed-a301-4f44-9647-1c9bc45ea41e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:41.079285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-292f57ed-a301-4f44-9647-1c9bc45ea41e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:41.080151 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-292f57ed-a301-4f44-9647-1c9bc45ea41e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:41.080599 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-292f57ed-a301-4f44-9647-1c9bc45ea41e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:41.181795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6a402258-2a79-4c2b-9fb0-c7791446167e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:41.182427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6a402258-2a79-4c2b-9fb0-c7791446167e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:41.189057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a402258-2a79-4c2b-9fb0-c7791446167e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:41.189509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a402258-2a79-4c2b-9fb0-c7791446167e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:41.190303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a402258-2a79-4c2b-9fb0-c7791446167e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:41.190810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6a402258-2a79-4c2b-9fb0-c7791446167e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:41.195770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:41.211044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-292f57ed-a301-4f44-9647-1c9bc45ea41e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:41.219934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-292f57ed-a301-4f44-9647-1c9bc45ea41e tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152637 Aug 01 16:01:41.220533 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1477/3281] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:41 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:41.253509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6a402258-2a79-4c2b-9fb0-c7791446167e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:41.262097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6a402258-2a79-4c2b-9fb0-c7791446167e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084181 Aug 01 16:01:41.262667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1805/3282] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:41 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:42.243083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-447ea3c2-d72a-48b5-9bb2-85e900d45a20 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:42.243648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-447ea3c2-d72a-48b5-9bb2-85e900d45a20 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:42.250367 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-447ea3c2-d72a-48b5-9bb2-85e900d45a20 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:42.250819 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-447ea3c2-d72a-48b5-9bb2-85e900d45a20 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:42.251583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-447ea3c2-d72a-48b5-9bb2-85e900d45a20 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:42.252018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-447ea3c2-d72a-48b5-9bb2-85e900d45a20 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:42.283488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d7fd7a4e-878a-43b7-ab76-13a3b06436fe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:42.284229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d7fd7a4e-878a-43b7-ab76-13a3b06436fe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:42.291560 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7fd7a4e-878a-43b7-ab76-13a3b06436fe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:42.292211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7fd7a4e-878a-43b7-ab76-13a3b06436fe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:42.292999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7fd7a4e-878a-43b7-ab76-13a3b06436fe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:42.293436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d7fd7a4e-878a-43b7-ab76-13a3b06436fe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:42.373816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d7fd7a4e-878a-43b7-ab76-13a3b06436fe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:42.381711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d7fd7a4e-878a-43b7-ab76-13a3b06436fe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.101993 Aug 01 16:01:42.382318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1806/3283] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:42 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:42.403308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-447ea3c2-d72a-48b5-9bb2-85e900d45a20 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:42.411583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-447ea3c2-d72a-48b5-9bb2-85e900d45a20 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.172230 Aug 01 16:01:42.411938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1478/3284] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:42 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:43.401967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-efa43c54-a984-49a1-98be-22be6e0628df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:43.402581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-efa43c54-a984-49a1-98be-22be6e0628df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:43.409268 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efa43c54-a984-49a1-98be-22be6e0628df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:43.409721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efa43c54-a984-49a1-98be-22be6e0628df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:43.410513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efa43c54-a984-49a1-98be-22be6e0628df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:43.410950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-efa43c54-a984-49a1-98be-22be6e0628df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:43.433204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-aeab28fd-e740-4c26-8bb8-f926881e5be7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:43.433860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-aeab28fd-e740-4c26-8bb8-f926881e5be7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:43.440540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aeab28fd-e740-4c26-8bb8-f926881e5be7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:43.440989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aeab28fd-e740-4c26-8bb8-f926881e5be7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:43.441765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aeab28fd-e740-4c26-8bb8-f926881e5be7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:43.442233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-aeab28fd-e740-4c26-8bb8-f926881e5be7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:43.472270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-efa43c54-a984-49a1-98be-22be6e0628df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:43.481112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-efa43c54-a984-49a1-98be-22be6e0628df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083039 Aug 01 16:01:43.481685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1807/3285] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:43 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:43.571015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-aeab28fd-e740-4c26-8bb8-f926881e5be7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:43.578970 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-aeab28fd-e740-4c26-8bb8-f926881e5be7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150217 Aug 01 16:01:43.579533 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1479/3286] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:43 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:44.502854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0a843ac4-ef1e-4bc0-98a5-4e65177d6071 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:44.503468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0a843ac4-ef1e-4bc0-98a5-4e65177d6071 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:44.510660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a843ac4-ef1e-4bc0-98a5-4e65177d6071 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:44.511110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a843ac4-ef1e-4bc0-98a5-4e65177d6071 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:44.511869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a843ac4-ef1e-4bc0-98a5-4e65177d6071 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:44.512303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0a843ac4-ef1e-4bc0-98a5-4e65177d6071 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:44.579309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0a843ac4-ef1e-4bc0-98a5-4e65177d6071 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:44.588009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0a843ac4-ef1e-4bc0-98a5-4e65177d6071 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.089032 Aug 01 16:01:44.588577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1808/3287] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:44 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:44.600935 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f4661352-6b83-4df9-9c47-2e388f81db23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:44.601545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f4661352-6b83-4df9-9c47-2e388f81db23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:44.608330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4661352-6b83-4df9-9c47-2e388f81db23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:44.608767 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4661352-6b83-4df9-9c47-2e388f81db23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:44.609513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4661352-6b83-4df9-9c47-2e388f81db23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:44.609972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f4661352-6b83-4df9-9c47-2e388f81db23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:44.740417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f4661352-6b83-4df9-9c47-2e388f81db23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:44.749196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f4661352-6b83-4df9-9c47-2e388f81db23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152147 Aug 01 16:01:44.749771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1480/3288] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:44 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:45.608952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ae52516a-2ac8-4d0e-bd06-bf36690cbf7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:45.609571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ae52516a-2ac8-4d0e-bd06-bf36690cbf7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:45.616136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae52516a-2ac8-4d0e-bd06-bf36690cbf7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:45.616594 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae52516a-2ac8-4d0e-bd06-bf36690cbf7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:45.617363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae52516a-2ac8-4d0e-bd06-bf36690cbf7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:45.617933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae52516a-2ac8-4d0e-bd06-bf36690cbf7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:45.678270 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ae52516a-2ac8-4d0e-bd06-bf36690cbf7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:45.686150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ae52516a-2ac8-4d0e-bd06-bf36690cbf7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.081311 Aug 01 16:01:45.686719 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1809/3289] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:45 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:45.770909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4b177785-30a0-4efe-8f43-26ab8edf5572 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:45.771606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4b177785-30a0-4efe-8f43-26ab8edf5572 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:45.773408 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=52 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:45.778846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b177785-30a0-4efe-8f43-26ab8edf5572 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:45.779293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b177785-30a0-4efe-8f43-26ab8edf5572 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:45.780049 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b177785-30a0-4efe-8f43-26ab8edf5572 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:45.780481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b177785-30a0-4efe-8f43-26ab8edf5572 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:45.911613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4b177785-30a0-4efe-8f43-26ab8edf5572 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:45.920472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4b177785-30a0-4efe-8f43-26ab8edf5572 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153612 Aug 01 16:01:45.921042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1481/3290] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:45 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:46.707426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b89fbb0b-1b00-4027-87b5-df6ba50fcb63 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:46.708038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b89fbb0b-1b00-4027-87b5-df6ba50fcb63 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:46.714680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b89fbb0b-1b00-4027-87b5-df6ba50fcb63 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:46.715606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b89fbb0b-1b00-4027-87b5-df6ba50fcb63 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:46.715901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b89fbb0b-1b00-4027-87b5-df6ba50fcb63 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:46.716334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b89fbb0b-1b00-4027-87b5-df6ba50fcb63 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:46.779977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b89fbb0b-1b00-4027-87b5-df6ba50fcb63 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:46.789951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b89fbb0b-1b00-4027-87b5-df6ba50fcb63 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086360 Aug 01 16:01:46.790522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1810/3291] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:46 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:46.941429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-96bbce53-5b9e-4220-87f0-0d765283bebb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:46.942071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-96bbce53-5b9e-4220-87f0-0d765283bebb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:46.949259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96bbce53-5b9e-4220-87f0-0d765283bebb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:46.949733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96bbce53-5b9e-4220-87f0-0d765283bebb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:46.950524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96bbce53-5b9e-4220-87f0-0d765283bebb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:46.950969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-96bbce53-5b9e-4220-87f0-0d765283bebb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:46.955004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:47.082263 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-96bbce53-5b9e-4220-87f0-0d765283bebb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:47.090273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-96bbce53-5b9e-4220-87f0-0d765283bebb tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152675 Aug 01 16:01:47.090838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1482/3292] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:46 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:47.813608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ab064827-70d6-4028-80f3-36a8140c265f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:47.814267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ab064827-70d6-4028-80f3-36a8140c265f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:47.820849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab064827-70d6-4028-80f3-36a8140c265f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:47.821287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab064827-70d6-4028-80f3-36a8140c265f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:47.822082 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab064827-70d6-4028-80f3-36a8140c265f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:47.822512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab064827-70d6-4028-80f3-36a8140c265f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:47.888642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ab064827-70d6-4028-80f3-36a8140c265f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:47.896997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ab064827-70d6-4028-80f3-36a8140c265f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087219 Aug 01 16:01:47.898335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1811/3293] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:47 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:48.112771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1fa49cd3-e3dd-4b14-8240-1c5f21b15d52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:48.113455 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1fa49cd3-e3dd-4b14-8240-1c5f21b15d52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:48.120722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1fa49cd3-e3dd-4b14-8240-1c5f21b15d52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:48.121166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1fa49cd3-e3dd-4b14-8240-1c5f21b15d52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:48.121941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1fa49cd3-e3dd-4b14-8240-1c5f21b15d52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:48.122375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1fa49cd3-e3dd-4b14-8240-1c5f21b15d52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:48.254571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1fa49cd3-e3dd-4b14-8240-1c5f21b15d52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:48.263042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1fa49cd3-e3dd-4b14-8240-1c5f21b15d52 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154207 Aug 01 16:01:48.263716 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1483/3294] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:48 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:48.917519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b5268e0e-b83b-4c72-bb46-1c258bccb976 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:48.918159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b5268e0e-b83b-4c72-bb46-1c258bccb976 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:48.925005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5268e0e-b83b-4c72-bb46-1c258bccb976 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:48.925457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5268e0e-b83b-4c72-bb46-1c258bccb976 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:48.926260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5268e0e-b83b-4c72-bb46-1c258bccb976 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:48.926697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5268e0e-b83b-4c72-bb46-1c258bccb976 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:48.992077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b5268e0e-b83b-4c72-bb46-1c258bccb976 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:49.000545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b5268e0e-b83b-4c72-bb46-1c258bccb976 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086959 Aug 01 16:01:49.001099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1812/3295] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:48 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:49.285065 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1208547e-f338-47f1-a8e2-5f198ecba359 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:49.285649 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1208547e-f338-47f1-a8e2-5f198ecba359 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:49.293107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1208547e-f338-47f1-a8e2-5f198ecba359 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:49.293553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1208547e-f338-47f1-a8e2-5f198ecba359 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:49.294510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1208547e-f338-47f1-a8e2-5f198ecba359 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:49.294803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1208547e-f338-47f1-a8e2-5f198ecba359 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:49.429861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1208547e-f338-47f1-a8e2-5f198ecba359 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:49.438483 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1208547e-f338-47f1-a8e2-5f198ecba359 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.157449 Aug 01 16:01:49.439043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1484/3296] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:49 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:50.022221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-83b56f6e-5f77-4cb4-a5f0-0a32cf4ed764 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:50.022875 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-83b56f6e-5f77-4cb4-a5f0-0a32cf4ed764 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:50.030068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83b56f6e-5f77-4cb4-a5f0-0a32cf4ed764 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:50.030529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83b56f6e-5f77-4cb4-a5f0-0a32cf4ed764 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:50.031296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83b56f6e-5f77-4cb4-a5f0-0a32cf4ed764 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:50.031739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-83b56f6e-5f77-4cb4-a5f0-0a32cf4ed764 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:50.094014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-83b56f6e-5f77-4cb4-a5f0-0a32cf4ed764 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:50.101960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-83b56f6e-5f77-4cb4-a5f0-0a32cf4ed764 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083740 Aug 01 16:01:50.102525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1813/3297] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:50 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:50.458897 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-54f723da-553f-4109-a47e-7779ffa09736 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:50.459515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-54f723da-553f-4109-a47e-7779ffa09736 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:50.466250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-54f723da-553f-4109-a47e-7779ffa09736 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:50.466704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-54f723da-553f-4109-a47e-7779ffa09736 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:50.467464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-54f723da-553f-4109-a47e-7779ffa09736 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:50.467900 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-54f723da-553f-4109-a47e-7779ffa09736 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:50.595453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-54f723da-553f-4109-a47e-7779ffa09736 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:50.603576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-54f723da-553f-4109-a47e-7779ffa09736 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.148550 Aug 01 16:01:50.604145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1485/3298] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:50 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:51.123074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-78f1ecf7-9bdf-4a97-8dc7-b2ebf55512a8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:51.124119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-78f1ecf7-9bdf-4a97-8dc7-b2ebf55512a8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:51.130860 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78f1ecf7-9bdf-4a97-8dc7-b2ebf55512a8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:51.131314 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78f1ecf7-9bdf-4a97-8dc7-b2ebf55512a8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:51.132069 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78f1ecf7-9bdf-4a97-8dc7-b2ebf55512a8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:51.132504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-78f1ecf7-9bdf-4a97-8dc7-b2ebf55512a8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:51.197537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-78f1ecf7-9bdf-4a97-8dc7-b2ebf55512a8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:51.205478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-78f1ecf7-9bdf-4a97-8dc7-b2ebf55512a8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086361 Aug 01 16:01:51.206065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1814/3299] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:51 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:51.630836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8eb23e8b-26af-44d5-8e11-c825112d639f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:51.632253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8eb23e8b-26af-44d5-8e11-c825112d639f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:51.639218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8eb23e8b-26af-44d5-8e11-c825112d639f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:51.639676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8eb23e8b-26af-44d5-8e11-c825112d639f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:51.640448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8eb23e8b-26af-44d5-8e11-c825112d639f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:51.640888 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8eb23e8b-26af-44d5-8e11-c825112d639f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:51.775675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8eb23e8b-26af-44d5-8e11-c825112d639f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:51.783547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8eb23e8b-26af-44d5-8e11-c825112d639f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156936 Aug 01 16:01:51.784107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1486/3300] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:51 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:52.226671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-eaf4d432-6e07-4ba8-a744-b8243915f51b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:52.228004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-eaf4d432-6e07-4ba8-a744-b8243915f51b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:52.234802 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaf4d432-6e07-4ba8-a744-b8243915f51b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:52.235260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaf4d432-6e07-4ba8-a744-b8243915f51b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:52.236027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaf4d432-6e07-4ba8-a744-b8243915f51b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:52.236467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-eaf4d432-6e07-4ba8-a744-b8243915f51b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:52.298236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-eaf4d432-6e07-4ba8-a744-b8243915f51b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:52.306413 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-eaf4d432-6e07-4ba8-a744-b8243915f51b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083541 Aug 01 16:01:52.306919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1815/3301] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:52 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:52.806444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b845c7bf-9f65-4f3e-9eb6-b2d2a8d496ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:52.807057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b845c7bf-9f65-4f3e-9eb6-b2d2a8d496ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:52.813607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b845c7bf-9f65-4f3e-9eb6-b2d2a8d496ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:52.814088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b845c7bf-9f65-4f3e-9eb6-b2d2a8d496ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:52.814837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b845c7bf-9f65-4f3e-9eb6-b2d2a8d496ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:52.815265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b845c7bf-9f65-4f3e-9eb6-b2d2a8d496ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:52.951691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b845c7bf-9f65-4f3e-9eb6-b2d2a8d496ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:52.959746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b845c7bf-9f65-4f3e-9eb6-b2d2a8d496ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.157671 Aug 01 16:01:52.960316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1487/3302] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:52 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:53.327406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c67c63cc-85dd-4b48-b870-12f36cd5e9c4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:53.327962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c67c63cc-85dd-4b48-b870-12f36cd5e9c4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:53.334685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c67c63cc-85dd-4b48-b870-12f36cd5e9c4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:53.335141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c67c63cc-85dd-4b48-b870-12f36cd5e9c4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:53.335897 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c67c63cc-85dd-4b48-b870-12f36cd5e9c4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:53.336343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c67c63cc-85dd-4b48-b870-12f36cd5e9c4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:53.400256 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c67c63cc-85dd-4b48-b870-12f36cd5e9c4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:53.408122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c67c63cc-85dd-4b48-b870-12f36cd5e9c4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084763 Aug 01 16:01:53.408674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1816/3303] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:53 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:53.984552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-72717a24-a3a6-465d-9112-4d992ab30d01 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:53.985196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-72717a24-a3a6-465d-9112-4d992ab30d01 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:53.991781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72717a24-a3a6-465d-9112-4d992ab30d01 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:53.992217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72717a24-a3a6-465d-9112-4d992ab30d01 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:53.992975 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72717a24-a3a6-465d-9112-4d992ab30d01 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:53.993404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-72717a24-a3a6-465d-9112-4d992ab30d01 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:54.121904 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-72717a24-a3a6-465d-9112-4d992ab30d01 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:54.130735 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-72717a24-a3a6-465d-9112-4d992ab30d01 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153554 Aug 01 16:01:54.131308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1488/3304] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:53 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:54.430580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-45fac28b-fbe3-4d7c-a8fa-b6c19773e846 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:54.431202 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-45fac28b-fbe3-4d7c-a8fa-b6c19773e846 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:54.437721 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45fac28b-fbe3-4d7c-a8fa-b6c19773e846 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:54.438206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45fac28b-fbe3-4d7c-a8fa-b6c19773e846 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:54.438974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45fac28b-fbe3-4d7c-a8fa-b6c19773e846 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:54.439411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-45fac28b-fbe3-4d7c-a8fa-b6c19773e846 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:54.503896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-45fac28b-fbe3-4d7c-a8fa-b6c19773e846 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:54.512610 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-45fac28b-fbe3-4d7c-a8fa-b6c19773e846 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086495 Aug 01 16:01:54.513178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1817/3305] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:54 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:55.153197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1946a0cc-f871-42eb-a47e-cc989a55c22b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:55.153807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1946a0cc-f871-42eb-a47e-cc989a55c22b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:55.160286 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1946a0cc-f871-42eb-a47e-cc989a55c22b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:55.160722 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1946a0cc-f871-42eb-a47e-cc989a55c22b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:55.161472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1946a0cc-f871-42eb-a47e-cc989a55c22b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:55.161910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1946a0cc-f871-42eb-a47e-cc989a55c22b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:55.291977 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1946a0cc-f871-42eb-a47e-cc989a55c22b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:55.299974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1946a0cc-f871-42eb-a47e-cc989a55c22b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151208 Aug 01 16:01:55.300535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1489/3306] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:55 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:55.533781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-29123754-a27f-49f9-b1f0-82e9f87f2b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:55.534427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-29123754-a27f-49f9-b1f0-82e9f87f2b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:55.541103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29123754-a27f-49f9-b1f0-82e9f87f2b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:55.541597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29123754-a27f-49f9-b1f0-82e9f87f2b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:55.542457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29123754-a27f-49f9-b1f0-82e9f87f2b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:55.542904 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29123754-a27f-49f9-b1f0-82e9f87f2b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:55.605771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-29123754-a27f-49f9-b1f0-82e9f87f2b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:55.614106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-29123754-a27f-49f9-b1f0-82e9f87f2b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084137 Aug 01 16:01:55.614690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1818/3307] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:55 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:56.320901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a097e94a-d39f-41c3-ad2e-7820f1142eb2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:56.321529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a097e94a-d39f-41c3-ad2e-7820f1142eb2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:56.329104 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a097e94a-d39f-41c3-ad2e-7820f1142eb2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:56.329560 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a097e94a-d39f-41c3-ad2e-7820f1142eb2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:56.330437 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a097e94a-d39f-41c3-ad2e-7820f1142eb2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:56.330879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a097e94a-d39f-41c3-ad2e-7820f1142eb2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:56.462868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a097e94a-d39f-41c3-ad2e-7820f1142eb2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:56.470950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a097e94a-d39f-41c3-ad2e-7820f1142eb2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153991 Aug 01 16:01:56.471510 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1490/3308] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:56 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:01:56.635347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-41598010-57fb-4103-b297-7ca012661c7f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:56.635949 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-41598010-57fb-4103-b297-7ca012661c7f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:56.644617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41598010-57fb-4103-b297-7ca012661c7f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:56.645068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41598010-57fb-4103-b297-7ca012661c7f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:56.645846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41598010-57fb-4103-b297-7ca012661c7f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:56.646316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-41598010-57fb-4103-b297-7ca012661c7f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:56.706769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-41598010-57fb-4103-b297-7ca012661c7f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:56.715815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-41598010-57fb-4103-b297-7ca012661c7f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084430 Aug 01 16:01:56.716380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1819/3309] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:56 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:57.493511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-68f06e81-301a-4ee7-8d04-e2af5a6a4547 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:57.494136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-68f06e81-301a-4ee7-8d04-e2af5a6a4547 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:57.500615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68f06e81-301a-4ee7-8d04-e2af5a6a4547 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:57.501054 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68f06e81-301a-4ee7-8d04-e2af5a6a4547 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:57.501803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68f06e81-301a-4ee7-8d04-e2af5a6a4547 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:57.502267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-68f06e81-301a-4ee7-8d04-e2af5a6a4547 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:57.637538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-68f06e81-301a-4ee7-8d04-e2af5a6a4547 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:57.645435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-68f06e81-301a-4ee7-8d04-e2af5a6a4547 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156320 Aug 01 16:01:57.646017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1491/3310] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:57 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:57.736766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1297b233-ef86-4623-bafc-6a417b0599f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:57.737363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1297b233-ef86-4623-bafc-6a417b0599f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:57.744661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1297b233-ef86-4623-bafc-6a417b0599f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:57.745050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1297b233-ef86-4623-bafc-6a417b0599f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:57.745817 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1297b233-ef86-4623-bafc-6a417b0599f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:57.746282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1297b233-ef86-4623-bafc-6a417b0599f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:57.811148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1297b233-ef86-4623-bafc-6a417b0599f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:57.819412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1297b233-ef86-4623-bafc-6a417b0599f9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086547 Aug 01 16:01:57.819986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1820/3311] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:57 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:58.670072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a0f98436-255b-4102-a0de-4c5e686c6e6f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:58.670739 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a0f98436-255b-4102-a0de-4c5e686c6e6f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:58.677175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0f98436-255b-4102-a0de-4c5e686c6e6f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:58.677615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0f98436-255b-4102-a0de-4c5e686c6e6f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:58.678387 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0f98436-255b-4102-a0de-4c5e686c6e6f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:58.678823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a0f98436-255b-4102-a0de-4c5e686c6e6f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:58.808312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a0f98436-255b-4102-a0de-4c5e686c6e6f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:58.816340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a0f98436-255b-4102-a0de-4c5e686c6e6f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150234 Aug 01 16:01:58.816914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1492/3312] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:58 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:58.840530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-76bf76ea-675f-450b-b329-e045b51fe44f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:58.841289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-76bf76ea-675f-450b-b329-e045b51fe44f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:58.847599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76bf76ea-675f-450b-b329-e045b51fe44f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:58.848041 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76bf76ea-675f-450b-b329-e045b51fe44f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:58.848796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76bf76ea-675f-450b-b329-e045b51fe44f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:58.849229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-76bf76ea-675f-450b-b329-e045b51fe44f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:58.912356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-76bf76ea-675f-450b-b329-e045b51fe44f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:58.915774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:01:58.921072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-76bf76ea-675f-450b-b329-e045b51fe44f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084332 Aug 01 16:01:58.921650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1821/3313] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:58 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:01:59.838638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8cd7b411-51dd-486e-a062-525e48fd7eb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:59.839258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8cd7b411-51dd-486e-a062-525e48fd7eb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:59.845824 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8cd7b411-51dd-486e-a062-525e48fd7eb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:59.846305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8cd7b411-51dd-486e-a062-525e48fd7eb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:59.847066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8cd7b411-51dd-486e-a062-525e48fd7eb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:59.847505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8cd7b411-51dd-486e-a062-525e48fd7eb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:59.942657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e387c5a4-c319-4c3c-9685-2b67ebb7ada5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:01:59.943374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e387c5a4-c319-4c3c-9685-2b67ebb7ada5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:01:59.951755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e387c5a4-c319-4c3c-9685-2b67ebb7ada5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:59.952201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e387c5a4-c319-4c3c-9685-2b67ebb7ada5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:59.952971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e387c5a4-c319-4c3c-9685-2b67ebb7ada5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:01:59.953407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e387c5a4-c319-4c3c-9685-2b67ebb7ada5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:01:59.984319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8cd7b411-51dd-486e-a062-525e48fd7eb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:01:59.992928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8cd7b411-51dd-486e-a062-525e48fd7eb9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.158784 Aug 01 16:01:59.993730 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1493/3314] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:59 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:00.019315 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e387c5a4-c319-4c3c-9685-2b67ebb7ada5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:00.027986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e387c5a4-c319-4c3c-9685-2b67ebb7ada5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.089575 Aug 01 16:02:00.028563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1822/3315] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:01:59 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:01.014789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6a81644a-2145-4933-ac23-23b6bd036f05 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:01.015394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6a81644a-2145-4933-ac23-23b6bd036f05 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:01.022109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a81644a-2145-4933-ac23-23b6bd036f05 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:01.022562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a81644a-2145-4933-ac23-23b6bd036f05 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:01.023316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a81644a-2145-4933-ac23-23b6bd036f05 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:01.024283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6a81644a-2145-4933-ac23-23b6bd036f05 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:01.049187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d0087e62-a4b0-4770-8c13-c994a556d06a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:01.049865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d0087e62-a4b0-4770-8c13-c994a556d06a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:01.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0087e62-a4b0-4770-8c13-c994a556d06a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:01.059140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0087e62-a4b0-4770-8c13-c994a556d06a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:01.060033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0087e62-a4b0-4770-8c13-c994a556d06a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:01.060538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d0087e62-a4b0-4770-8c13-c994a556d06a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:01.141189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d0087e62-a4b0-4770-8c13-c994a556d06a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:01.149727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d0087e62-a4b0-4770-8c13-c994a556d06a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.104496 Aug 01 16:02:01.150608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1823/3316] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:01 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:01.171751 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6a81644a-2145-4933-ac23-23b6bd036f05 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:01.180444 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6a81644a-2145-4933-ac23-23b6bd036f05 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.169473 Aug 01 16:02:01.181016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1494/3317] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:01 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:02.171428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-43c3266d-2a1b-4752-b8d6-4e07f525c56b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:02.172035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-43c3266d-2a1b-4752-b8d6-4e07f525c56b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:02.178566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43c3266d-2a1b-4752-b8d6-4e07f525c56b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:02.179018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43c3266d-2a1b-4752-b8d6-4e07f525c56b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:02.180408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43c3266d-2a1b-4752-b8d6-4e07f525c56b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:02.180935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-43c3266d-2a1b-4752-b8d6-4e07f525c56b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:02.246020 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-43c3266d-2a1b-4752-b8d6-4e07f525c56b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:02.254810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-43c3266d-2a1b-4752-b8d6-4e07f525c56b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087283 Aug 01 16:02:02.255395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1824/3318] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:02 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:02.346997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b0def121-f00f-42f0-a56e-c48a0bb65631 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:02.347614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b0def121-f00f-42f0-a56e-c48a0bb65631 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:02.353783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0def121-f00f-42f0-a56e-c48a0bb65631 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:02.354272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0def121-f00f-42f0-a56e-c48a0bb65631 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:02.355285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0def121-f00f-42f0-a56e-c48a0bb65631 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:02.355790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0def121-f00f-42f0-a56e-c48a0bb65631 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:02.485911 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b0def121-f00f-42f0-a56e-c48a0bb65631 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:02.494340 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b0def121-f00f-42f0-a56e-c48a0bb65631 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.296143 Aug 01 16:02:02.495022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1495/3319] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:02 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:03.276070 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a2da393f-594c-40b7-a633-e4d4c4e5131b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:03.276680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a2da393f-594c-40b7-a633-e4d4c4e5131b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:03.283251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2da393f-594c-40b7-a633-e4d4c4e5131b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:03.283707 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2da393f-594c-40b7-a633-e4d4c4e5131b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:03.284477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2da393f-594c-40b7-a633-e4d4c4e5131b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:03.284924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a2da393f-594c-40b7-a633-e4d4c4e5131b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:03.345881 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a2da393f-594c-40b7-a633-e4d4c4e5131b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:03.354477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a2da393f-594c-40b7-a633-e4d4c4e5131b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082822 Aug 01 16:02:03.355322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1825/3320] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:03 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:03.518038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ddb4c44e-44d6-4104-aafd-14c74daaaf22 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:03.518645 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ddb4c44e-44d6-4104-aafd-14c74daaaf22 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:03.525135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddb4c44e-44d6-4104-aafd-14c74daaaf22 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:03.525576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddb4c44e-44d6-4104-aafd-14c74daaaf22 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:03.526353 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddb4c44e-44d6-4104-aafd-14c74daaaf22 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:03.526780 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ddb4c44e-44d6-4104-aafd-14c74daaaf22 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:03.657072 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ddb4c44e-44d6-4104-aafd-14c74daaaf22 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:03.665663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ddb4c44e-44d6-4104-aafd-14c74daaaf22 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151490 Aug 01 16:02:03.666260 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1496/3321] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:03 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:04.376195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-09643b6c-883f-4a12-bc65-b3e4349248ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:04.376812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-09643b6c-883f-4a12-bc65-b3e4349248ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:04.383435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09643b6c-883f-4a12-bc65-b3e4349248ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:04.383891 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09643b6c-883f-4a12-bc65-b3e4349248ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:04.385148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09643b6c-883f-4a12-bc65-b3e4349248ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:04.385590 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-09643b6c-883f-4a12-bc65-b3e4349248ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:04.445804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-09643b6c-883f-4a12-bc65-b3e4349248ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:04.455067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-09643b6c-883f-4a12-bc65-b3e4349248ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082677 Aug 01 16:02:04.455637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1826/3322] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:04 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:04.693023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-717b38ad-8d97-497e-bb7f-acacf98e83b1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:04.693606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-717b38ad-8d97-497e-bb7f-acacf98e83b1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:04.700872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-717b38ad-8d97-497e-bb7f-acacf98e83b1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:04.701323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-717b38ad-8d97-497e-bb7f-acacf98e83b1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:04.702141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-717b38ad-8d97-497e-bb7f-acacf98e83b1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:04.702584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-717b38ad-8d97-497e-bb7f-acacf98e83b1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:04.831386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-717b38ad-8d97-497e-bb7f-acacf98e83b1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:04.840106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-717b38ad-8d97-497e-bb7f-acacf98e83b1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155304 Aug 01 16:02:04.840675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1497/3323] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:04 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:05.476592 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-612c2dd0-8ee8-4cdf-a6be-3dd2214b679a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:05.477186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-612c2dd0-8ee8-4cdf-a6be-3dd2214b679a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:05.484717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-612c2dd0-8ee8-4cdf-a6be-3dd2214b679a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:05.485167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-612c2dd0-8ee8-4cdf-a6be-3dd2214b679a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:05.485969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-612c2dd0-8ee8-4cdf-a6be-3dd2214b679a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:05.486409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-612c2dd0-8ee8-4cdf-a6be-3dd2214b679a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:05.549728 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-612c2dd0-8ee8-4cdf-a6be-3dd2214b679a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:05.557745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-612c2dd0-8ee8-4cdf-a6be-3dd2214b679a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085049 Aug 01 16:02:05.558344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1827/3324] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:05 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:05.864675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7e52cd37-eb18-4d88-9c0f-ca1903b9d253 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:05.865222 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7e52cd37-eb18-4d88-9c0f-ca1903b9d253 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:05.871994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7e52cd37-eb18-4d88-9c0f-ca1903b9d253 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:05.872447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7e52cd37-eb18-4d88-9c0f-ca1903b9d253 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:05.873248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7e52cd37-eb18-4d88-9c0f-ca1903b9d253 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:05.873687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7e52cd37-eb18-4d88-9c0f-ca1903b9d253 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:06.247409 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7e52cd37-eb18-4d88-9c0f-ca1903b9d253 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:06.250889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:06.256180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7e52cd37-eb18-4d88-9c0f-ca1903b9d253 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.395417 Aug 01 16:02:06.256744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1498/3325] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:05 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:06.578742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9c636697-ee60-45ed-b277-419868f4f0e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:06.579354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9c636697-ee60-45ed-b277-419868f4f0e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:06.585958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c636697-ee60-45ed-b277-419868f4f0e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:06.586419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c636697-ee60-45ed-b277-419868f4f0e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:06.587188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c636697-ee60-45ed-b277-419868f4f0e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:06.587629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c636697-ee60-45ed-b277-419868f4f0e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:06.649295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9c636697-ee60-45ed-b277-419868f4f0e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:06.662873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9c636697-ee60-45ed-b277-419868f4f0e7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088132 Aug 01 16:02:06.663465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1828/3326] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:06 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:07.279393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2b2ccd13-ec65-49e0-b9f7-f463a86d1956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:07.280004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2b2ccd13-ec65-49e0-b9f7-f463a86d1956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:07.286666 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b2ccd13-ec65-49e0-b9f7-f463a86d1956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:07.287146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b2ccd13-ec65-49e0-b9f7-f463a86d1956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:07.287896 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b2ccd13-ec65-49e0-b9f7-f463a86d1956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:07.288332 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b2ccd13-ec65-49e0-b9f7-f463a86d1956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:07.433212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2b2ccd13-ec65-49e0-b9f7-f463a86d1956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:07.441177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2b2ccd13-ec65-49e0-b9f7-f463a86d1956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.166521 Aug 01 16:02:07.441741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1499/3327] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:07 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:07.685969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2f2ef7b7-7c16-497d-83d9-776157d0fa8d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:07.686563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2f2ef7b7-7c16-497d-83d9-776157d0fa8d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:07.693545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f2ef7b7-7c16-497d-83d9-776157d0fa8d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:07.694039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f2ef7b7-7c16-497d-83d9-776157d0fa8d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:07.694812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f2ef7b7-7c16-497d-83d9-776157d0fa8d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:07.695254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2f2ef7b7-7c16-497d-83d9-776157d0fa8d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:07.765221 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2f2ef7b7-7c16-497d-83d9-776157d0fa8d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:07.773347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2f2ef7b7-7c16-497d-83d9-776157d0fa8d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.092960 Aug 01 16:02:07.773944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1829/3328] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:07 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:08.463087 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7303d131-33b1-40ba-92fe-57c170946845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:08.463703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7303d131-33b1-40ba-92fe-57c170946845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:08.470887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7303d131-33b1-40ba-92fe-57c170946845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:08.471344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7303d131-33b1-40ba-92fe-57c170946845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:08.472109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7303d131-33b1-40ba-92fe-57c170946845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:08.472547 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7303d131-33b1-40ba-92fe-57c170946845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:08.605110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7303d131-33b1-40ba-92fe-57c170946845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:08.613356 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7303d131-33b1-40ba-92fe-57c170946845 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154122 Aug 01 16:02:08.613938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1500/3329] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:08 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:08.794896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0993f35d-265a-40f1-8a74-b3dcdee31788 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:08.795505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0993f35d-265a-40f1-8a74-b3dcdee31788 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:08.802373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0993f35d-265a-40f1-8a74-b3dcdee31788 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:08.802830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0993f35d-265a-40f1-8a74-b3dcdee31788 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:08.803599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0993f35d-265a-40f1-8a74-b3dcdee31788 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:08.804038 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0993f35d-265a-40f1-8a74-b3dcdee31788 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:08.870935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0993f35d-265a-40f1-8a74-b3dcdee31788 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:08.879123 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0993f35d-265a-40f1-8a74-b3dcdee31788 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088310 Aug 01 16:02:08.879715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1830/3330] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:08 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:09.634633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d744bb30-228e-472f-b404-86f7deaafbbc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:09.635281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d744bb30-228e-472f-b404-86f7deaafbbc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:09.642676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d744bb30-228e-472f-b404-86f7deaafbbc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:09.643117 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d744bb30-228e-472f-b404-86f7deaafbbc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:09.643868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d744bb30-228e-472f-b404-86f7deaafbbc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:09.644298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d744bb30-228e-472f-b404-86f7deaafbbc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:09.774982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d744bb30-228e-472f-b404-86f7deaafbbc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:09.788095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d744bb30-228e-472f-b404-86f7deaafbbc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.157198 Aug 01 16:02:09.788683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1501/3331] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:09 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:09.903653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a0bc0862-fc18-4d62-b015-26fd7017a5e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:09.904307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a0bc0862-fc18-4d62-b015-26fd7017a5e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:09.906694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=56 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:09.912381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a0bc0862-fc18-4d62-b015-26fd7017a5e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:09.912834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a0bc0862-fc18-4d62-b015-26fd7017a5e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:09.913612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a0bc0862-fc18-4d62-b015-26fd7017a5e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:09.914087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a0bc0862-fc18-4d62-b015-26fd7017a5e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:09.977072 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a0bc0862-fc18-4d62-b015-26fd7017a5e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:09.985660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a0bc0862-fc18-4d62-b015-26fd7017a5e3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086053 Aug 01 16:02:09.986261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1831/3332] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:09 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:10.808648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-35eced98-995b-42de-8cfb-3ef3c9e0b956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:10.809334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-35eced98-995b-42de-8cfb-3ef3c9e0b956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:10.815815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-35eced98-995b-42de-8cfb-3ef3c9e0b956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:10.816259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-35eced98-995b-42de-8cfb-3ef3c9e0b956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:10.817131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-35eced98-995b-42de-8cfb-3ef3c9e0b956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:10.817568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-35eced98-995b-42de-8cfb-3ef3c9e0b956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:10.950287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-35eced98-995b-42de-8cfb-3ef3c9e0b956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:10.958516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-35eced98-995b-42de-8cfb-3ef3c9e0b956 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153623 Aug 01 16:02:10.959083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1502/3333] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:10 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:11.007112 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0d49d370-e7b8-4ddf-bd6a-0d2bf19c6511 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:11.007731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0d49d370-e7b8-4ddf-bd6a-0d2bf19c6511 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:11.015096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0d49d370-e7b8-4ddf-bd6a-0d2bf19c6511 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:11.015552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0d49d370-e7b8-4ddf-bd6a-0d2bf19c6511 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:11.016325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0d49d370-e7b8-4ddf-bd6a-0d2bf19c6511 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:11.016769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0d49d370-e7b8-4ddf-bd6a-0d2bf19c6511 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:11.083078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0d49d370-e7b8-4ddf-bd6a-0d2bf19c6511 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:11.092026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0d49d370-e7b8-4ddf-bd6a-0d2bf19c6511 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088732 Aug 01 16:02:11.092598 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1832/3334] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:11 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:11.980939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7bfc4a0f-f6a9-4722-809d-77fc8fbb6cf2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:11.981586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7bfc4a0f-f6a9-4722-809d-77fc8fbb6cf2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:11.988187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7bfc4a0f-f6a9-4722-809d-77fc8fbb6cf2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:11.988708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7bfc4a0f-f6a9-4722-809d-77fc8fbb6cf2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:11.989596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7bfc4a0f-f6a9-4722-809d-77fc8fbb6cf2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:11.990076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7bfc4a0f-f6a9-4722-809d-77fc8fbb6cf2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:12.112697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-75f33c13-cce4-403d-89e9-6381bcb54e73 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:12.113323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-75f33c13-cce4-403d-89e9-6381bcb54e73 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:12.120183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75f33c13-cce4-403d-89e9-6381bcb54e73 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:12.120639 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75f33c13-cce4-403d-89e9-6381bcb54e73 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:12.122274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75f33c13-cce4-403d-89e9-6381bcb54e73 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:12.126242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-75f33c13-cce4-403d-89e9-6381bcb54e73 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:12.126433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7bfc4a0f-f6a9-4722-809d-77fc8fbb6cf2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:12.131893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7bfc4a0f-f6a9-4722-809d-77fc8fbb6cf2 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155210 Aug 01 16:02:12.132473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1503/3335] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:11 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:12.206510 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-75f33c13-cce4-403d-89e9-6381bcb54e73 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:12.215706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-75f33c13-cce4-403d-89e9-6381bcb54e73 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.106669 Aug 01 16:02:12.216366 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1833/3336] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:12 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:13.154302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fd70caca-df3b-47e1-8fff-256d76a60dea tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:13.154913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fd70caca-df3b-47e1-8fff-256d76a60dea tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:13.161327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fd70caca-df3b-47e1-8fff-256d76a60dea tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:13.161795 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fd70caca-df3b-47e1-8fff-256d76a60dea tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:13.162575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fd70caca-df3b-47e1-8fff-256d76a60dea tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:13.163011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fd70caca-df3b-47e1-8fff-256d76a60dea tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:13.236997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c4ccbc92-599f-46c3-a693-12a9daba49d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:13.237697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c4ccbc92-599f-46c3-a693-12a9daba49d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:13.244413 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4ccbc92-599f-46c3-a693-12a9daba49d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:13.244856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4ccbc92-599f-46c3-a693-12a9daba49d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:13.245620 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4ccbc92-599f-46c3-a693-12a9daba49d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:13.246083 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c4ccbc92-599f-46c3-a693-12a9daba49d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:13.309099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fd70caca-df3b-47e1-8fff-256d76a60dea tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:13.317585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fd70caca-df3b-47e1-8fff-256d76a60dea tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.167557 Aug 01 16:02:13.318190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1504/3337] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:13 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:13.325949 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c4ccbc92-599f-46c3-a693-12a9daba49d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:13.334839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c4ccbc92-599f-46c3-a693-12a9daba49d7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.101725 Aug 01 16:02:13.335409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1834/3338] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:13 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:14.340724 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0f014ff2-7466-4bbb-bda4-43e35f05eb95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:14.341294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0f014ff2-7466-4bbb-bda4-43e35f05eb95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:14.347950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0f014ff2-7466-4bbb-bda4-43e35f05eb95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:14.348400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0f014ff2-7466-4bbb-bda4-43e35f05eb95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:14.349154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0f014ff2-7466-4bbb-bda4-43e35f05eb95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:14.349589 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0f014ff2-7466-4bbb-bda4-43e35f05eb95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:14.356914 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-13283d05-83bb-4f9d-b58b-65c5e610b337 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:14.357569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-13283d05-83bb-4f9d-b58b-65c5e610b337 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:14.364104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13283d05-83bb-4f9d-b58b-65c5e610b337 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:14.364559 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13283d05-83bb-4f9d-b58b-65c5e610b337 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:14.365332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13283d05-83bb-4f9d-b58b-65c5e610b337 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:14.365771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-13283d05-83bb-4f9d-b58b-65c5e610b337 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:14.447452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-13283d05-83bb-4f9d-b58b-65c5e610b337 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:14.456166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-13283d05-83bb-4f9d-b58b-65c5e610b337 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.103472 Aug 01 16:02:14.456742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1835/3339] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:14 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:14.506374 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0f014ff2-7466-4bbb-bda4-43e35f05eb95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:14.515017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0f014ff2-7466-4bbb-bda4-43e35f05eb95 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.178245 Aug 01 16:02:14.515575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1505/3340] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:14 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:15.479081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-29df32cc-6cd7-4a60-9795-73c4fd6ef0dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:15.479705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-29df32cc-6cd7-4a60-9795-73c4fd6ef0dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:15.486418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29df32cc-6cd7-4a60-9795-73c4fd6ef0dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:15.486862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29df32cc-6cd7-4a60-9795-73c4fd6ef0dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:15.487613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29df32cc-6cd7-4a60-9795-73c4fd6ef0dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:15.488050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-29df32cc-6cd7-4a60-9795-73c4fd6ef0dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:15.536566 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-071a5ef1-1807-4725-918b-9b18c3e08987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:15.537710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-071a5ef1-1807-4725-918b-9b18c3e08987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:15.544403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-071a5ef1-1807-4725-918b-9b18c3e08987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:15.544852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-071a5ef1-1807-4725-918b-9b18c3e08987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:15.545617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-071a5ef1-1807-4725-918b-9b18c3e08987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:15.546103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-071a5ef1-1807-4725-918b-9b18c3e08987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:15.553191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-29df32cc-6cd7-4a60-9795-73c4fd6ef0dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:15.561515 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-29df32cc-6cd7-4a60-9795-73c4fd6ef0dc tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086284 Aug 01 16:02:15.562192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1836/3341] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:15 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:15.679585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-071a5ef1-1807-4725-918b-9b18c3e08987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:15.687529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-071a5ef1-1807-4725-918b-9b18c3e08987 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154796 Aug 01 16:02:15.688089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1506/3342] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:15 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:16.583205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f93fecac-5e69-4a13-8b97-8c6b8e8f4ea4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:16.583807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f93fecac-5e69-4a13-8b97-8c6b8e8f4ea4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:16.590285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f93fecac-5e69-4a13-8b97-8c6b8e8f4ea4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:16.590735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f93fecac-5e69-4a13-8b97-8c6b8e8f4ea4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:16.591482 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f93fecac-5e69-4a13-8b97-8c6b8e8f4ea4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:16.591915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f93fecac-5e69-4a13-8b97-8c6b8e8f4ea4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:16.653827 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f93fecac-5e69-4a13-8b97-8c6b8e8f4ea4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:16.661873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f93fecac-5e69-4a13-8b97-8c6b8e8f4ea4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082564 Aug 01 16:02:16.662457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1837/3343] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:16 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:16.710183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f43b3d0a-3581-4434-8f5e-d097f930f837 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:16.710919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f43b3d0a-3581-4434-8f5e-d097f930f837 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:16.713262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=52 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:16.718905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f43b3d0a-3581-4434-8f5e-d097f930f837 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:16.719355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f43b3d0a-3581-4434-8f5e-d097f930f837 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:16.720115 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f43b3d0a-3581-4434-8f5e-d097f930f837 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:16.720548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f43b3d0a-3581-4434-8f5e-d097f930f837 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:16.849478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f43b3d0a-3581-4434-8f5e-d097f930f837 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:16.857731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f43b3d0a-3581-4434-8f5e-d097f930f837 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151417 Aug 01 16:02:16.858397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1507/3344] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:16 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:17.682786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b19c3fc1-35c3-470a-91b1-21d81b38f17a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:17.683438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b19c3fc1-35c3-470a-91b1-21d81b38f17a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:17.689947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b19c3fc1-35c3-470a-91b1-21d81b38f17a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:17.690406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b19c3fc1-35c3-470a-91b1-21d81b38f17a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:17.691174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b19c3fc1-35c3-470a-91b1-21d81b38f17a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:17.691618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b19c3fc1-35c3-470a-91b1-21d81b38f17a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:17.709905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:17.754500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b19c3fc1-35c3-470a-91b1-21d81b38f17a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:17.762952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b19c3fc1-35c3-470a-91b1-21d81b38f17a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084073 Aug 01 16:02:17.763503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1838/3345] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:17 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:17.880712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3ea3263d-a978-4b60-9d65-91e8dd18f6dd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:17.881323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3ea3263d-a978-4b60-9d65-91e8dd18f6dd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:17.888132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3ea3263d-a978-4b60-9d65-91e8dd18f6dd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:17.888612 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3ea3263d-a978-4b60-9d65-91e8dd18f6dd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:17.889378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3ea3263d-a978-4b60-9d65-91e8dd18f6dd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:17.889818 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3ea3263d-a978-4b60-9d65-91e8dd18f6dd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:18.027814 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3ea3263d-a978-4b60-9d65-91e8dd18f6dd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:18.035806 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3ea3263d-a978-4b60-9d65-91e8dd18f6dd tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159065 Aug 01 16:02:18.036355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1508/3346] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:17 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:18.784260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-450b114f-4aa7-4d6d-923a-66fc01d867d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:18.784879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-450b114f-4aa7-4d6d-923a-66fc01d867d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:18.791453 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-450b114f-4aa7-4d6d-923a-66fc01d867d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:18.791901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-450b114f-4aa7-4d6d-923a-66fc01d867d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:18.793220 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-450b114f-4aa7-4d6d-923a-66fc01d867d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:18.793820 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-450b114f-4aa7-4d6d-923a-66fc01d867d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:18.857028 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-450b114f-4aa7-4d6d-923a-66fc01d867d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:18.865051 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-450b114f-4aa7-4d6d-923a-66fc01d867d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084661 Aug 01 16:02:18.865615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1839/3347] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:18 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:19.058526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1661a654-75fe-4da8-96b7-1c3ee9898ee9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:19.059312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1661a654-75fe-4da8-96b7-1c3ee9898ee9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:19.066041 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1661a654-75fe-4da8-96b7-1c3ee9898ee9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:19.066500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1661a654-75fe-4da8-96b7-1c3ee9898ee9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:19.067266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1661a654-75fe-4da8-96b7-1c3ee9898ee9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:19.067704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1661a654-75fe-4da8-96b7-1c3ee9898ee9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:19.202246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1661a654-75fe-4da8-96b7-1c3ee9898ee9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:19.210769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1661a654-75fe-4da8-96b7-1c3ee9898ee9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156169 Aug 01 16:02:19.211333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1509/3348] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:19 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:19.885880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-121a099a-1570-40e2-a45b-3ae4dae9cf5c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:19.886616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-121a099a-1570-40e2-a45b-3ae4dae9cf5c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:19.893299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-121a099a-1570-40e2-a45b-3ae4dae9cf5c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:19.893739 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-121a099a-1570-40e2-a45b-3ae4dae9cf5c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:19.894529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-121a099a-1570-40e2-a45b-3ae4dae9cf5c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:19.894969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-121a099a-1570-40e2-a45b-3ae4dae9cf5c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:19.958407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-121a099a-1570-40e2-a45b-3ae4dae9cf5c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:19.966934 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-121a099a-1570-40e2-a45b-3ae4dae9cf5c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084919 Aug 01 16:02:19.967503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1840/3349] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:19 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:20.235085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f8552a1a-69f9-454f-bb88-97a2e2e1e291 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:20.235713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f8552a1a-69f9-454f-bb88-97a2e2e1e291 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:20.242505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8552a1a-69f9-454f-bb88-97a2e2e1e291 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:20.242950 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8552a1a-69f9-454f-bb88-97a2e2e1e291 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:20.243715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8552a1a-69f9-454f-bb88-97a2e2e1e291 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:20.244145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8552a1a-69f9-454f-bb88-97a2e2e1e291 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:20.374671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f8552a1a-69f9-454f-bb88-97a2e2e1e291 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:20.382799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f8552a1a-69f9-454f-bb88-97a2e2e1e291 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153686 Aug 01 16:02:20.383368 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1510/3350] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:20 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:20.988840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ff61312b-c552-44e7-abb5-801a3835dc34 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:20.989420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ff61312b-c552-44e7-abb5-801a3835dc34 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:20.996772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ff61312b-c552-44e7-abb5-801a3835dc34 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:20.997219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ff61312b-c552-44e7-abb5-801a3835dc34 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:20.998093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ff61312b-c552-44e7-abb5-801a3835dc34 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:20.998533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ff61312b-c552-44e7-abb5-801a3835dc34 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:21.061703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ff61312b-c552-44e7-abb5-801a3835dc34 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:21.069822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ff61312b-c552-44e7-abb5-801a3835dc34 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084904 Aug 01 16:02:21.070422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1841/3351] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:20 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:21.405345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5bdbab0f-f983-4f66-a945-8d4c6b99f851 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:21.405988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5bdbab0f-f983-4f66-a945-8d4c6b99f851 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:21.412594 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5bdbab0f-f983-4f66-a945-8d4c6b99f851 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:21.413044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5bdbab0f-f983-4f66-a945-8d4c6b99f851 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:21.413834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5bdbab0f-f983-4f66-a945-8d4c6b99f851 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:21.414296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5bdbab0f-f983-4f66-a945-8d4c6b99f851 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:21.549637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5bdbab0f-f983-4f66-a945-8d4c6b99f851 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:21.557698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5bdbab0f-f983-4f66-a945-8d4c6b99f851 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156942 Aug 01 16:02:21.558375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1511/3352] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:21 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:22.090697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c3940c9a-d8d0-4b64-b6fe-7304735dfe40 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:22.091307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c3940c9a-d8d0-4b64-b6fe-7304735dfe40 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:22.098195 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3940c9a-d8d0-4b64-b6fe-7304735dfe40 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:22.098813 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3940c9a-d8d0-4b64-b6fe-7304735dfe40 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:22.099625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3940c9a-d8d0-4b64-b6fe-7304735dfe40 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:22.100071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c3940c9a-d8d0-4b64-b6fe-7304735dfe40 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:22.163769 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c3940c9a-d8d0-4b64-b6fe-7304735dfe40 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:22.171694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c3940c9a-d8d0-4b64-b6fe-7304735dfe40 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084990 Aug 01 16:02:22.172248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1842/3353] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:22 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:22.579723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-49ced152-fd9e-4551-af0f-5a8d05cbafed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:22.580329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-49ced152-fd9e-4551-af0f-5a8d05cbafed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:22.591891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49ced152-fd9e-4551-af0f-5a8d05cbafed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:22.592330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49ced152-fd9e-4551-af0f-5a8d05cbafed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:22.593093 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49ced152-fd9e-4551-af0f-5a8d05cbafed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:22.593526 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49ced152-fd9e-4551-af0f-5a8d05cbafed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:22.729144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-49ced152-fd9e-4551-af0f-5a8d05cbafed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:22.738355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-49ced152-fd9e-4551-af0f-5a8d05cbafed tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.162641 Aug 01 16:02:22.738926 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1512/3354] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:22 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:23.192763 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-56e477d6-ef73-47bf-9d1f-8c5e697b5ead tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:23.193407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-56e477d6-ef73-47bf-9d1f-8c5e697b5ead tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:23.200457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56e477d6-ef73-47bf-9d1f-8c5e697b5ead tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:23.200908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56e477d6-ef73-47bf-9d1f-8c5e697b5ead tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:23.201673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56e477d6-ef73-47bf-9d1f-8c5e697b5ead tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:23.202136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-56e477d6-ef73-47bf-9d1f-8c5e697b5ead tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:23.271995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-56e477d6-ef73-47bf-9d1f-8c5e697b5ead tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:23.280636 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-56e477d6-ef73-47bf-9d1f-8c5e697b5ead tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.091719 Aug 01 16:02:23.281207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1843/3355] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:23 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:23.759424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cc6f6c5f-964b-4ed3-80ec-f2e1211b416d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:23.760058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cc6f6c5f-964b-4ed3-80ec-f2e1211b416d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:23.766931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc6f6c5f-964b-4ed3-80ec-f2e1211b416d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:23.767386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc6f6c5f-964b-4ed3-80ec-f2e1211b416d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:23.768149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc6f6c5f-964b-4ed3-80ec-f2e1211b416d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:23.768592 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cc6f6c5f-964b-4ed3-80ec-f2e1211b416d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:23.899336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cc6f6c5f-964b-4ed3-80ec-f2e1211b416d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:23.907637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cc6f6c5f-964b-4ed3-80ec-f2e1211b416d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152008 Aug 01 16:02:23.908212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1513/3356] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:23 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:24.302060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-64eaca2a-3946-4831-8904-0fd85388daf0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:24.302662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-64eaca2a-3946-4831-8904-0fd85388daf0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:24.309259 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64eaca2a-3946-4831-8904-0fd85388daf0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:24.309658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64eaca2a-3946-4831-8904-0fd85388daf0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:24.310456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64eaca2a-3946-4831-8904-0fd85388daf0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:24.310898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-64eaca2a-3946-4831-8904-0fd85388daf0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:24.372948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-64eaca2a-3946-4831-8904-0fd85388daf0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:24.380950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-64eaca2a-3946-4831-8904-0fd85388daf0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082810 Aug 01 16:02:24.381517 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1844/3357] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:24 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:24.929872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-772baa2f-d3d2-4ec6-908d-33939a660de9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:24.930480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-772baa2f-d3d2-4ec6-908d-33939a660de9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:24.937595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-772baa2f-d3d2-4ec6-908d-33939a660de9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:24.938083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-772baa2f-d3d2-4ec6-908d-33939a660de9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:24.938829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-772baa2f-d3d2-4ec6-908d-33939a660de9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:24.939259 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-772baa2f-d3d2-4ec6-908d-33939a660de9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:25.072498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-772baa2f-d3d2-4ec6-908d-33939a660de9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:25.083009 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-772baa2f-d3d2-4ec6-908d-33939a660de9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156708 Aug 01 16:02:25.083772 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1514/3358] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:24 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:25.401943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-de8a86b8-d915-4bb3-8ddc-1b03b5089b37 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:25.402547 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-de8a86b8-d915-4bb3-8ddc-1b03b5089b37 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:25.409046 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-de8a86b8-d915-4bb3-8ddc-1b03b5089b37 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:25.409490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-de8a86b8-d915-4bb3-8ddc-1b03b5089b37 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:25.410271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-de8a86b8-d915-4bb3-8ddc-1b03b5089b37 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:25.410696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-de8a86b8-d915-4bb3-8ddc-1b03b5089b37 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:25.471878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-de8a86b8-d915-4bb3-8ddc-1b03b5089b37 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:25.479818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-de8a86b8-d915-4bb3-8ddc-1b03b5089b37 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.081820 Aug 01 16:02:25.480989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1845/3359] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:25 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:26.104705 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-55619aff-4588-46b8-811e-b5ceedac71e8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:26.105635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-55619aff-4588-46b8-811e-b5ceedac71e8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:26.112249 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-55619aff-4588-46b8-811e-b5ceedac71e8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:26.112709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-55619aff-4588-46b8-811e-b5ceedac71e8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:26.113470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-55619aff-4588-46b8-811e-b5ceedac71e8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:26.113931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-55619aff-4588-46b8-811e-b5ceedac71e8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:26.131840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:26.249417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-55619aff-4588-46b8-811e-b5ceedac71e8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:26.257427 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-55619aff-4588-46b8-811e-b5ceedac71e8 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156685 Aug 01 16:02:26.258015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1515/3360] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:26 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:26.501668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-25c624a9-ce04-4f97-b140-339cd64dd1c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:26.502429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-25c624a9-ce04-4f97-b140-339cd64dd1c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:26.509322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-25c624a9-ce04-4f97-b140-339cd64dd1c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:26.509775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-25c624a9-ce04-4f97-b140-339cd64dd1c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:26.510609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-25c624a9-ce04-4f97-b140-339cd64dd1c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:26.511078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-25c624a9-ce04-4f97-b140-339cd64dd1c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:26.582816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-25c624a9-ce04-4f97-b140-339cd64dd1c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:26.590833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-25c624a9-ce04-4f97-b140-339cd64dd1c5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.093469 Aug 01 16:02:26.591394 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1846/3361] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:26 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:27.279982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-533fd6af-05fa-4136-91ca-57163231c61d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:27.280644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-533fd6af-05fa-4136-91ca-57163231c61d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:27.287381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-533fd6af-05fa-4136-91ca-57163231c61d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:27.287809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-533fd6af-05fa-4136-91ca-57163231c61d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:27.288542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-533fd6af-05fa-4136-91ca-57163231c61d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:27.288973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-533fd6af-05fa-4136-91ca-57163231c61d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:27.424197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-533fd6af-05fa-4136-91ca-57163231c61d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:27.432598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-533fd6af-05fa-4136-91ca-57163231c61d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156909 Aug 01 16:02:27.433169 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1516/3362] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:27 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:27.611894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2228dad8-6abd-4b08-8de5-dd14a0c63cf8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:27.612489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2228dad8-6abd-4b08-8de5-dd14a0c63cf8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:27.619382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2228dad8-6abd-4b08-8de5-dd14a0c63cf8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:27.619780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2228dad8-6abd-4b08-8de5-dd14a0c63cf8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:27.620552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2228dad8-6abd-4b08-8de5-dd14a0c63cf8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:27.620994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2228dad8-6abd-4b08-8de5-dd14a0c63cf8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:27.683953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2228dad8-6abd-4b08-8de5-dd14a0c63cf8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:27.691987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2228dad8-6abd-4b08-8de5-dd14a0c63cf8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083900 Aug 01 16:02:27.692582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1847/3363] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:27 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:28.453350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2f6558f8-f49f-4886-a4b1-e8543bb9f08b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:28.454058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2f6558f8-f49f-4886-a4b1-e8543bb9f08b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:28.460838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f6558f8-f49f-4886-a4b1-e8543bb9f08b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:28.461299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f6558f8-f49f-4886-a4b1-e8543bb9f08b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:28.462105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f6558f8-f49f-4886-a4b1-e8543bb9f08b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:28.462546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f6558f8-f49f-4886-a4b1-e8543bb9f08b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:28.596710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2f6558f8-f49f-4886-a4b1-e8543bb9f08b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:28.604841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2f6558f8-f49f-4886-a4b1-e8543bb9f08b tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155392 Aug 01 16:02:28.606075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1517/3364] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:28 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:28.715784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bd8b0e02-3dc8-49bd-af7e-5ec0e688b07c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:28.716395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bd8b0e02-3dc8-49bd-af7e-5ec0e688b07c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:28.722997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd8b0e02-3dc8-49bd-af7e-5ec0e688b07c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:28.723444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd8b0e02-3dc8-49bd-af7e-5ec0e688b07c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:28.724201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd8b0e02-3dc8-49bd-af7e-5ec0e688b07c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:28.724645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bd8b0e02-3dc8-49bd-af7e-5ec0e688b07c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:28.785027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bd8b0e02-3dc8-49bd-af7e-5ec0e688b07c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:28.793477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bd8b0e02-3dc8-49bd-af7e-5ec0e688b07c tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082074 Aug 01 16:02:28.794126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1848/3365] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:28 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:29.627121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a593f6c8-2457-4874-a04f-76ef8b936c3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:29.627726 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a593f6c8-2457-4874-a04f-76ef8b936c3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:29.634402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a593f6c8-2457-4874-a04f-76ef8b936c3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:29.634855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a593f6c8-2457-4874-a04f-76ef8b936c3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:29.635617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a593f6c8-2457-4874-a04f-76ef8b936c3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:29.636057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a593f6c8-2457-4874-a04f-76ef8b936c3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:29.769635 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a593f6c8-2457-4874-a04f-76ef8b936c3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:29.777683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a593f6c8-2457-4874-a04f-76ef8b936c3d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154682 Aug 01 16:02:29.778268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1518/3366] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:29 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:29.814298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ae6169a1-d47f-4885-97c3-6045baa17655 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:29.814869 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ae6169a1-d47f-4885-97c3-6045baa17655 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:29.821917 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae6169a1-d47f-4885-97c3-6045baa17655 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:29.822408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae6169a1-d47f-4885-97c3-6045baa17655 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:29.823338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae6169a1-d47f-4885-97c3-6045baa17655 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:29.823884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ae6169a1-d47f-4885-97c3-6045baa17655 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:29.889871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ae6169a1-d47f-4885-97c3-6045baa17655 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:29.897981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ae6169a1-d47f-4885-97c3-6045baa17655 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087536 Aug 01 16:02:29.898566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1849/3367] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:29 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:30.798739 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-49188a66-c306-4b23-98aa-fa26ec36cded tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:30.799355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-49188a66-c306-4b23-98aa-fa26ec36cded tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:30.805927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49188a66-c306-4b23-98aa-fa26ec36cded tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:30.806386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49188a66-c306-4b23-98aa-fa26ec36cded tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:30.807147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49188a66-c306-4b23-98aa-fa26ec36cded tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:30.807587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-49188a66-c306-4b23-98aa-fa26ec36cded tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:30.919039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f163c9c4-7619-4e7e-9da9-6da41018d4d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:30.919744 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f163c9c4-7619-4e7e-9da9-6da41018d4d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:30.926514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f163c9c4-7619-4e7e-9da9-6da41018d4d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:30.927057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f163c9c4-7619-4e7e-9da9-6da41018d4d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:30.927899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f163c9c4-7619-4e7e-9da9-6da41018d4d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:30.928420 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f163c9c4-7619-4e7e-9da9-6da41018d4d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:30.941186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-49188a66-c306-4b23-98aa-fa26ec36cded tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:30.950147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-49188a66-c306-4b23-98aa-fa26ec36cded tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155061 Aug 01 16:02:30.957721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1519/3368] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:30 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:30.991290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f163c9c4-7619-4e7e-9da9-6da41018d4d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:30.999975 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f163c9c4-7619-4e7e-9da9-6da41018d4d1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085012 Aug 01 16:02:31.000545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1850/3369] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:30 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:31.971877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8b316f5b-147e-4d2d-bb2c-c9f20bd3af1d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:31.972435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8b316f5b-147e-4d2d-bb2c-c9f20bd3af1d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:31.978932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b316f5b-147e-4d2d-bb2c-c9f20bd3af1d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:31.979402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b316f5b-147e-4d2d-bb2c-c9f20bd3af1d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:31.980583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b316f5b-147e-4d2d-bb2c-c9f20bd3af1d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:31.981036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b316f5b-147e-4d2d-bb2c-c9f20bd3af1d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:32.021137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-80b2c8a0-0dd9-48d9-b2f0-c543fe186bdf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:32.021863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-80b2c8a0-0dd9-48d9-b2f0-c543fe186bdf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:32.029508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-80b2c8a0-0dd9-48d9-b2f0-c543fe186bdf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:32.030127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-80b2c8a0-0dd9-48d9-b2f0-c543fe186bdf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:32.031055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-80b2c8a0-0dd9-48d9-b2f0-c543fe186bdf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:32.031615 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-80b2c8a0-0dd9-48d9-b2f0-c543fe186bdf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:32.105432 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-80b2c8a0-0dd9-48d9-b2f0-c543fe186bdf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:32.113915 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-80b2c8a0-0dd9-48d9-b2f0-c543fe186bdf tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.096564 Aug 01 16:02:32.114380 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1851/3370] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:32 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:32.137023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8b316f5b-147e-4d2d-bb2c-c9f20bd3af1d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:32.145034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8b316f5b-147e-4d2d-bb2c-c9f20bd3af1d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.177097 Aug 01 16:02:32.145591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1520/3371] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:31 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:33.135022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7776e098-0ee1-4933-ae47-6e940a311abe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:33.135630 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7776e098-0ee1-4933-ae47-6e940a311abe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:33.142146 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7776e098-0ee1-4933-ae47-6e940a311abe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:33.142601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7776e098-0ee1-4933-ae47-6e940a311abe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:33.143361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7776e098-0ee1-4933-ae47-6e940a311abe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:33.143796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7776e098-0ee1-4933-ae47-6e940a311abe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:33.166952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-56792170-3313-4ec3-9b70-b18321ee8af5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:33.168376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-56792170-3313-4ec3-9b70-b18321ee8af5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:33.174905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56792170-3313-4ec3-9b70-b18321ee8af5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:33.176881 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56792170-3313-4ec3-9b70-b18321ee8af5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:33.177704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56792170-3313-4ec3-9b70-b18321ee8af5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:33.178192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-56792170-3313-4ec3-9b70-b18321ee8af5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:33.206448 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7776e098-0ee1-4933-ae47-6e940a311abe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:33.215358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7776e098-0ee1-4933-ae47-6e940a311abe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084278 Aug 01 16:02:33.215938 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1852/3372] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:33 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:33.314912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-56792170-3313-4ec3-9b70-b18321ee8af5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:33.322961 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-56792170-3313-4ec3-9b70-b18321ee8af5 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159764 Aug 01 16:02:33.323732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1521/3373] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:33 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:34.237062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5fb3ef76-6bb5-4752-9556-93a30afd8b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:34.237671 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5fb3ef76-6bb5-4752-9556-93a30afd8b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:34.244413 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5fb3ef76-6bb5-4752-9556-93a30afd8b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:34.244871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5fb3ef76-6bb5-4752-9556-93a30afd8b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:34.246293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5fb3ef76-6bb5-4752-9556-93a30afd8b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:34.246736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5fb3ef76-6bb5-4752-9556-93a30afd8b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:34.307428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5fb3ef76-6bb5-4752-9556-93a30afd8b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:34.316211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5fb3ef76-6bb5-4752-9556-93a30afd8b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083102 Aug 01 16:02:34.316785 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1853/3374] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:34 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:34.344406 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-102af5b1-5e32-4969-8d0b-35194980e655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:34.345018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-102af5b1-5e32-4969-8d0b-35194980e655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:34.351554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-102af5b1-5e32-4969-8d0b-35194980e655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:34.352000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-102af5b1-5e32-4969-8d0b-35194980e655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:34.352757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-102af5b1-5e32-4969-8d0b-35194980e655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:34.353200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-102af5b1-5e32-4969-8d0b-35194980e655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:34.482918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-102af5b1-5e32-4969-8d0b-35194980e655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:34.491001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-102af5b1-5e32-4969-8d0b-35194980e655 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150396 Aug 01 16:02:34.491561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1522/3375] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:34 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:35.337439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-10bed094-92ec-49c7-bb5a-dc899ca58c78 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:35.338026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-10bed094-92ec-49c7-bb5a-dc899ca58c78 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:35.344740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10bed094-92ec-49c7-bb5a-dc899ca58c78 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:35.345190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10bed094-92ec-49c7-bb5a-dc899ca58c78 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:35.345986 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10bed094-92ec-49c7-bb5a-dc899ca58c78 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:35.346424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-10bed094-92ec-49c7-bb5a-dc899ca58c78 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:35.410539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-10bed094-92ec-49c7-bb5a-dc899ca58c78 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:35.418797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-10bed094-92ec-49c7-bb5a-dc899ca58c78 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085295 Aug 01 16:02:35.419377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1854/3376] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:35 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:35.514094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-818c4a51-e54b-4d90-b717-5a4f3ad0b271 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:35.514711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-818c4a51-e54b-4d90-b717-5a4f3ad0b271 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:35.521267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-818c4a51-e54b-4d90-b717-5a4f3ad0b271 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:35.521713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-818c4a51-e54b-4d90-b717-5a4f3ad0b271 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:35.522504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-818c4a51-e54b-4d90-b717-5a4f3ad0b271 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:35.522933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-818c4a51-e54b-4d90-b717-5a4f3ad0b271 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:35.652440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-818c4a51-e54b-4d90-b717-5a4f3ad0b271 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:35.660382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-818c4a51-e54b-4d90-b717-5a4f3ad0b271 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150906 Aug 01 16:02:35.660949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1523/3377] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:35 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:36.439680 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-caf6c9af-c366-4407-bd6c-844ac6971448 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:36.440277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-caf6c9af-c366-4407-bd6c-844ac6971448 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:36.446818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-caf6c9af-c366-4407-bd6c-844ac6971448 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:36.447264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-caf6c9af-c366-4407-bd6c-844ac6971448 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:36.448017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-caf6c9af-c366-4407-bd6c-844ac6971448 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:36.449004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-caf6c9af-c366-4407-bd6c-844ac6971448 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:36.452939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:36.511498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-caf6c9af-c366-4407-bd6c-844ac6971448 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:36.519480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-caf6c9af-c366-4407-bd6c-844ac6971448 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083706 Aug 01 16:02:36.520044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1855/3378] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:36 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:36.681513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8c87527e-67e3-4016-974d-968e6795b410 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:36.682162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8c87527e-67e3-4016-974d-968e6795b410 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:36.688784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8c87527e-67e3-4016-974d-968e6795b410 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:36.689226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8c87527e-67e3-4016-974d-968e6795b410 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:36.690085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8c87527e-67e3-4016-974d-968e6795b410 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:36.690980 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8c87527e-67e3-4016-974d-968e6795b410 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:36.825415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8c87527e-67e3-4016-974d-968e6795b410 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:36.833319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8c87527e-67e3-4016-974d-968e6795b410 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155668 Aug 01 16:02:36.833872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1524/3379] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:36 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:37.541014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-98037bfe-220e-4b1d-9284-431b05425460 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:37.541623 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-98037bfe-220e-4b1d-9284-431b05425460 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:37.548727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98037bfe-220e-4b1d-9284-431b05425460 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:37.549189 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98037bfe-220e-4b1d-9284-431b05425460 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:37.549978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98037bfe-220e-4b1d-9284-431b05425460 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:37.550424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98037bfe-220e-4b1d-9284-431b05425460 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:37.614901 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-98037bfe-220e-4b1d-9284-431b05425460 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:37.622906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-98037bfe-220e-4b1d-9284-431b05425460 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085756 Aug 01 16:02:37.623473 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1856/3380] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:37 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:37.853663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f67dd36e-9c86-499a-9b12-3a5ce197dc1f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:37.854254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f67dd36e-9c86-499a-9b12-3a5ce197dc1f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:37.861903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f67dd36e-9c86-499a-9b12-3a5ce197dc1f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:37.862370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f67dd36e-9c86-499a-9b12-3a5ce197dc1f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:37.863142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f67dd36e-9c86-499a-9b12-3a5ce197dc1f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:37.863580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f67dd36e-9c86-499a-9b12-3a5ce197dc1f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:37.996442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f67dd36e-9c86-499a-9b12-3a5ce197dc1f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:38.004539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f67dd36e-9c86-499a-9b12-3a5ce197dc1f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154818 Aug 01 16:02:38.005711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1525/3381] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:37 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:38.643727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-19307e10-8033-4f92-96f1-2082ec8a2b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:38.644362 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-19307e10-8033-4f92-96f1-2082ec8a2b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:38.650878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19307e10-8033-4f92-96f1-2082ec8a2b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:38.651323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19307e10-8033-4f92-96f1-2082ec8a2b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:38.652074 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19307e10-8033-4f92-96f1-2082ec8a2b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:38.652509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-19307e10-8033-4f92-96f1-2082ec8a2b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:38.717244 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-19307e10-8033-4f92-96f1-2082ec8a2b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:38.725411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-19307e10-8033-4f92-96f1-2082ec8a2b10 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085527 Aug 01 16:02:38.726005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1857/3382] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:38 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:39.027109 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c7aefa15-6ec5-4adb-b8a1-5309ddfee3d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:39.027761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c7aefa15-6ec5-4adb-b8a1-5309ddfee3d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:39.034394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c7aefa15-6ec5-4adb-b8a1-5309ddfee3d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:39.034836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c7aefa15-6ec5-4adb-b8a1-5309ddfee3d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:39.035590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c7aefa15-6ec5-4adb-b8a1-5309ddfee3d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:39.036015 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c7aefa15-6ec5-4adb-b8a1-5309ddfee3d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:39.166986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c7aefa15-6ec5-4adb-b8a1-5309ddfee3d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:39.175708 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c7aefa15-6ec5-4adb-b8a1-5309ddfee3d4 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152587 Aug 01 16:02:39.176281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1526/3383] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:39 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:39.747361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d62ee086-3f10-46f6-8deb-2ae0b08af956 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:39.748092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d62ee086-3f10-46f6-8deb-2ae0b08af956 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:39.754913 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d62ee086-3f10-46f6-8deb-2ae0b08af956 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:39.755349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d62ee086-3f10-46f6-8deb-2ae0b08af956 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:39.756109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d62ee086-3f10-46f6-8deb-2ae0b08af956 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:39.756546 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d62ee086-3f10-46f6-8deb-2ae0b08af956 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:39.818674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d62ee086-3f10-46f6-8deb-2ae0b08af956 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:39.827261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d62ee086-3f10-46f6-8deb-2ae0b08af956 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083887 Aug 01 16:02:39.828013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1858/3384] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:39 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:40.196998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9f0bcc9b-fac5-4ae7-8c02-954bb5f71229 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:40.197586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9f0bcc9b-fac5-4ae7-8c02-954bb5f71229 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:40.204632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9f0bcc9b-fac5-4ae7-8c02-954bb5f71229 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:40.205069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9f0bcc9b-fac5-4ae7-8c02-954bb5f71229 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:40.205819 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9f0bcc9b-fac5-4ae7-8c02-954bb5f71229 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:40.206272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9f0bcc9b-fac5-4ae7-8c02-954bb5f71229 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:40.338745 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9f0bcc9b-fac5-4ae7-8c02-954bb5f71229 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:40.346654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9f0bcc9b-fac5-4ae7-8c02-954bb5f71229 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153510 Aug 01 16:02:40.347217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1527/3385] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:40 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:40.848316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-171e44a8-141e-4e61-b056-7b97e6ce6b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:40.848943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-171e44a8-141e-4e61-b056-7b97e6ce6b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:40.851316 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=56 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:40.857832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-171e44a8-141e-4e61-b056-7b97e6ce6b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:40.858309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-171e44a8-141e-4e61-b056-7b97e6ce6b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:40.859086 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-171e44a8-141e-4e61-b056-7b97e6ce6b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:40.859524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-171e44a8-141e-4e61-b056-7b97e6ce6b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:40.920936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-171e44a8-141e-4e61-b056-7b97e6ce6b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:40.929137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-171e44a8-141e-4e61-b056-7b97e6ce6b83 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084711 Aug 01 16:02:40.929699 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1859/3386] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:40 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:41.369733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1d7903da-d6e3-4235-ad6e-b84c7ece649d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:41.370908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1d7903da-d6e3-4235-ad6e-b84c7ece649d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:41.377354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d7903da-d6e3-4235-ad6e-b84c7ece649d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:41.377803 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d7903da-d6e3-4235-ad6e-b84c7ece649d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:41.378594 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d7903da-d6e3-4235-ad6e-b84c7ece649d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:41.379052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1d7903da-d6e3-4235-ad6e-b84c7ece649d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:41.517440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1d7903da-d6e3-4235-ad6e-b84c7ece649d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:41.525441 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1d7903da-d6e3-4235-ad6e-b84c7ece649d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.159930 Aug 01 16:02:41.526034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1528/3387] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:41 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:41.950161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cc49605e-14a5-47cc-90da-1190ba8cd40f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:41.950953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cc49605e-14a5-47cc-90da-1190ba8cd40f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:41.958544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc49605e-14a5-47cc-90da-1190ba8cd40f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:41.959058 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc49605e-14a5-47cc-90da-1190ba8cd40f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:41.960113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc49605e-14a5-47cc-90da-1190ba8cd40f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:41.960553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cc49605e-14a5-47cc-90da-1190ba8cd40f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:42.026481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cc49605e-14a5-47cc-90da-1190ba8cd40f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:42.035584 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cc49605e-14a5-47cc-90da-1190ba8cd40f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.089390 Aug 01 16:02:42.036207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1860/3388] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:41 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:42.546684 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-95602e70-74d9-4bc6-a2be-2468eea058ae tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:42.547290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-95602e70-74d9-4bc6-a2be-2468eea058ae tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:42.553754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95602e70-74d9-4bc6-a2be-2468eea058ae tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:42.554250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95602e70-74d9-4bc6-a2be-2468eea058ae tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:42.554996 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95602e70-74d9-4bc6-a2be-2468eea058ae tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:42.555423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-95602e70-74d9-4bc6-a2be-2468eea058ae tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:42.685416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-95602e70-74d9-4bc6-a2be-2468eea058ae tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:42.693432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-95602e70-74d9-4bc6-a2be-2468eea058ae tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150590 Aug 01 16:02:42.694017 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1529/3389] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:42 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:43.061581 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5205e054-6e04-4a8a-8301-e88c9ddc876b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:43.062230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5205e054-6e04-4a8a-8301-e88c9ddc876b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:43.068343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5205e054-6e04-4a8a-8301-e88c9ddc876b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:43.068799 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5205e054-6e04-4a8a-8301-e88c9ddc876b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:43.069583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5205e054-6e04-4a8a-8301-e88c9ddc876b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:43.070049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5205e054-6e04-4a8a-8301-e88c9ddc876b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:43.134946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5205e054-6e04-4a8a-8301-e88c9ddc876b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:43.144644 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5205e054-6e04-4a8a-8301-e88c9ddc876b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087902 Aug 01 16:02:43.145703 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1861/3390] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:43 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:43.716029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2364f31f-f360-455d-9b76-857e1f196245 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:43.716671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2364f31f-f360-455d-9b76-857e1f196245 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:43.723210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2364f31f-f360-455d-9b76-857e1f196245 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:43.723671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2364f31f-f360-455d-9b76-857e1f196245 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:43.724431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2364f31f-f360-455d-9b76-857e1f196245 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:43.724873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2364f31f-f360-455d-9b76-857e1f196245 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:43.856587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2364f31f-f360-455d-9b76-857e1f196245 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:43.864549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2364f31f-f360-455d-9b76-857e1f196245 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152911 Aug 01 16:02:43.865103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1530/3391] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:43 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:44.170535 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-db2201fd-fdaf-4e01-8675-c7cd2b2c75fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:44.171145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-db2201fd-fdaf-4e01-8675-c7cd2b2c75fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:44.177655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db2201fd-fdaf-4e01-8675-c7cd2b2c75fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:44.178139 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db2201fd-fdaf-4e01-8675-c7cd2b2c75fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:44.178894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db2201fd-fdaf-4e01-8675-c7cd2b2c75fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:44.179323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-db2201fd-fdaf-4e01-8675-c7cd2b2c75fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:44.242984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-db2201fd-fdaf-4e01-8675-c7cd2b2c75fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:44.250865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-db2201fd-fdaf-4e01-8675-c7cd2b2c75fa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084215 Aug 01 16:02:44.251424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1862/3392] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:44 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:44.885936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d6abe0b9-e638-4cba-95a0-2616b98900af tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:44.886553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d6abe0b9-e638-4cba-95a0-2616b98900af tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:44.893036 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6abe0b9-e638-4cba-95a0-2616b98900af tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:44.893491 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6abe0b9-e638-4cba-95a0-2616b98900af tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:44.894314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6abe0b9-e638-4cba-95a0-2616b98900af tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:44.894755 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d6abe0b9-e638-4cba-95a0-2616b98900af tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:45.026145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d6abe0b9-e638-4cba-95a0-2616b98900af tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:45.034399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d6abe0b9-e638-4cba-95a0-2616b98900af tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152334 Aug 01 16:02:45.034968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1531/3393] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:44 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:45.272708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9c3c4f3b-e157-457b-8ec0-6493c966708d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:45.273245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9c3c4f3b-e157-457b-8ec0-6493c966708d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:45.280387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c3c4f3b-e157-457b-8ec0-6493c966708d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:45.280839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c3c4f3b-e157-457b-8ec0-6493c966708d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:45.281616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c3c4f3b-e157-457b-8ec0-6493c966708d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:45.282084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c3c4f3b-e157-457b-8ec0-6493c966708d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:45.346359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9c3c4f3b-e157-457b-8ec0-6493c966708d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:45.354340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9c3c4f3b-e157-457b-8ec0-6493c966708d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085537 Aug 01 16:02:45.355777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1863/3394] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:45 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:46.056712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c769b3ff-cd54-4415-a923-8e0f049e7d06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:46.057323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c769b3ff-cd54-4415-a923-8e0f049e7d06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:46.064075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c769b3ff-cd54-4415-a923-8e0f049e7d06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:46.064535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c769b3ff-cd54-4415-a923-8e0f049e7d06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:46.065314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c769b3ff-cd54-4415-a923-8e0f049e7d06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:46.065752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c769b3ff-cd54-4415-a923-8e0f049e7d06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:46.070035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:46.199990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c769b3ff-cd54-4415-a923-8e0f049e7d06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:46.207872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c769b3ff-cd54-4415-a923-8e0f049e7d06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155011 Aug 01 16:02:46.208425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1532/3395] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:46 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:46.376873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d15da89b-5125-4812-8b4a-78d77928bbc5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:46.377601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d15da89b-5125-4812-8b4a-78d77928bbc5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:46.384101 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d15da89b-5125-4812-8b4a-78d77928bbc5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:46.384534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d15da89b-5125-4812-8b4a-78d77928bbc5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:46.385295 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d15da89b-5125-4812-8b4a-78d77928bbc5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:46.385920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d15da89b-5125-4812-8b4a-78d77928bbc5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:46.447878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d15da89b-5125-4812-8b4a-78d77928bbc5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:46.456865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d15da89b-5125-4812-8b4a-78d77928bbc5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083775 Aug 01 16:02:46.457676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1864/3396] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:46 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:47.231512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9415523b-777b-4856-bb92-7d55c3d25ce6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:47.232140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9415523b-777b-4856-bb92-7d55c3d25ce6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:47.234067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=52 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:47.239490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9415523b-777b-4856-bb92-7d55c3d25ce6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:47.239941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9415523b-777b-4856-bb92-7d55c3d25ce6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:47.240706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9415523b-777b-4856-bb92-7d55c3d25ce6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:47.241143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9415523b-777b-4856-bb92-7d55c3d25ce6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:47.373794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9415523b-777b-4856-bb92-7d55c3d25ce6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:47.382142 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9415523b-777b-4856-bb92-7d55c3d25ce6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156249 Aug 01 16:02:47.382711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1533/3397] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:47 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:47.478847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aaf600f8-c240-4845-ac4c-e6573f2d8e5b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:47.479502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aaf600f8-c240-4845-ac4c-e6573f2d8e5b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:47.487069 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aaf600f8-c240-4845-ac4c-e6573f2d8e5b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:47.487946 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aaf600f8-c240-4845-ac4c-e6573f2d8e5b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:47.488726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aaf600f8-c240-4845-ac4c-e6573f2d8e5b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:47.489169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aaf600f8-c240-4845-ac4c-e6573f2d8e5b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:47.552705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aaf600f8-c240-4845-ac4c-e6573f2d8e5b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:47.560816 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aaf600f8-c240-4845-ac4c-e6573f2d8e5b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085810 Aug 01 16:02:47.561375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1865/3398] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:47 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:48.403869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-93721fa8-2c04-438a-9ae3-2f56d2980617 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:48.404474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-93721fa8-2c04-438a-9ae3-2f56d2980617 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:48.411035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93721fa8-2c04-438a-9ae3-2f56d2980617 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:48.411472 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93721fa8-2c04-438a-9ae3-2f56d2980617 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:48.412223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93721fa8-2c04-438a-9ae3-2f56d2980617 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:48.412651 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-93721fa8-2c04-438a-9ae3-2f56d2980617 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:48.545058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-93721fa8-2c04-438a-9ae3-2f56d2980617 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:48.553484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-93721fa8-2c04-438a-9ae3-2f56d2980617 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153870 Aug 01 16:02:48.554085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1534/3399] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:48 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:48.581411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0bebf42c-da33-43b8-b350-3e9066b019e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:48.582099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0bebf42c-da33-43b8-b350-3e9066b019e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:48.588689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0bebf42c-da33-43b8-b350-3e9066b019e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:48.589205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0bebf42c-da33-43b8-b350-3e9066b019e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:48.590091 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0bebf42c-da33-43b8-b350-3e9066b019e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:48.590562 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0bebf42c-da33-43b8-b350-3e9066b019e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:48.658024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0bebf42c-da33-43b8-b350-3e9066b019e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:48.668691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0bebf42c-da33-43b8-b350-3e9066b019e0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.090542 Aug 01 16:02:48.669704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1866/3400] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:48 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:49.576235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-52df0ee6-e73e-460c-9daa-0188e8b8be90 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:49.576839 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-52df0ee6-e73e-460c-9daa-0188e8b8be90 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:49.583575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52df0ee6-e73e-460c-9daa-0188e8b8be90 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:49.584020 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52df0ee6-e73e-460c-9daa-0188e8b8be90 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:49.584773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52df0ee6-e73e-460c-9daa-0188e8b8be90 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:49.585206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52df0ee6-e73e-460c-9daa-0188e8b8be90 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:49.690599 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-61b72fb6-0c92-4883-bb68-7c0b7dd4aebe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:49.691283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-61b72fb6-0c92-4883-bb68-7c0b7dd4aebe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:49.697491 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-61b72fb6-0c92-4883-bb68-7c0b7dd4aebe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:49.698122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-61b72fb6-0c92-4883-bb68-7c0b7dd4aebe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:49.699708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-61b72fb6-0c92-4883-bb68-7c0b7dd4aebe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:49.700205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-61b72fb6-0c92-4883-bb68-7c0b7dd4aebe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:49.717500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-52df0ee6-e73e-460c-9daa-0188e8b8be90 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:49.725379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-52df0ee6-e73e-460c-9daa-0188e8b8be90 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153560 Aug 01 16:02:49.725968 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1535/3401] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:49 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:49.762474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-61b72fb6-0c92-4883-bb68-7c0b7dd4aebe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:49.770412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-61b72fb6-0c92-4883-bb68-7c0b7dd4aebe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083787 Aug 01 16:02:49.770983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1867/3402] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:49 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:50.747550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-323c405a-a3eb-4d8a-a636-faf678e54a58 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:50.748309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-323c405a-a3eb-4d8a-a636-faf678e54a58 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:50.754852 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-323c405a-a3eb-4d8a-a636-faf678e54a58 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:50.755310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-323c405a-a3eb-4d8a-a636-faf678e54a58 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:50.756074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-323c405a-a3eb-4d8a-a636-faf678e54a58 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:50.756517 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-323c405a-a3eb-4d8a-a636-faf678e54a58 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:50.791361 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-236b0396-1c8c-427a-897e-8411f1f2d6d8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:50.791979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-236b0396-1c8c-427a-897e-8411f1f2d6d8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:50.798782 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-236b0396-1c8c-427a-897e-8411f1f2d6d8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:50.799236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-236b0396-1c8c-427a-897e-8411f1f2d6d8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:50.800013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-236b0396-1c8c-427a-897e-8411f1f2d6d8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:50.800451 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-236b0396-1c8c-427a-897e-8411f1f2d6d8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:50.879673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-236b0396-1c8c-427a-897e-8411f1f2d6d8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:50.888397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-236b0396-1c8c-427a-897e-8411f1f2d6d8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.100778 Aug 01 16:02:50.889119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1868/3403] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:50 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:50.910820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-323c405a-a3eb-4d8a-a636-faf678e54a58 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:50.919105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-323c405a-a3eb-4d8a-a636-faf678e54a58 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.175456 Aug 01 16:02:50.919675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1536/3404] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:50 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:51.909226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4cdef716-ce61-4b97-9d53-546c487ba9f7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:51.909828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4cdef716-ce61-4b97-9d53-546c487ba9f7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:51.916371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4cdef716-ce61-4b97-9d53-546c487ba9f7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:51.916825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4cdef716-ce61-4b97-9d53-546c487ba9f7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:51.917593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4cdef716-ce61-4b97-9d53-546c487ba9f7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:51.918780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4cdef716-ce61-4b97-9d53-546c487ba9f7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:51.940573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e842b86c-41e9-4d97-9d3e-f562e64be6ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:51.941181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e842b86c-41e9-4d97-9d3e-f562e64be6ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:51.947964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e842b86c-41e9-4d97-9d3e-f562e64be6ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:51.948420 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e842b86c-41e9-4d97-9d3e-f562e64be6ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:51.949257 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e842b86c-41e9-4d97-9d3e-f562e64be6ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:51.949723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e842b86c-41e9-4d97-9d3e-f562e64be6ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:51.986325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4cdef716-ce61-4b97-9d53-546c487ba9f7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:51.994839 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4cdef716-ce61-4b97-9d53-546c487ba9f7 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.089448 Aug 01 16:02:51.995415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1869/3405] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:51 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:52.083896 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e842b86c-41e9-4d97-9d3e-f562e64be6ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:52.092605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e842b86c-41e9-4d97-9d3e-f562e64be6ca tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155884 Aug 01 16:02:52.093176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1537/3406] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:51 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:53.015931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c45933ef-de79-43cc-b02d-38352d438e27 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:53.016492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c45933ef-de79-43cc-b02d-38352d438e27 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:53.022951 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c45933ef-de79-43cc-b02d-38352d438e27 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:53.023400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c45933ef-de79-43cc-b02d-38352d438e27 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:53.024169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c45933ef-de79-43cc-b02d-38352d438e27 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:53.024609 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c45933ef-de79-43cc-b02d-38352d438e27 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:53.089293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c45933ef-de79-43cc-b02d-38352d438e27 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:53.097575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c45933ef-de79-43cc-b02d-38352d438e27 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085651 Aug 01 16:02:53.098183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1870/3407] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:53 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:53.114459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-547ae94f-b0f5-4e8c-b3c2-335ba203d7ba tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:53.115075 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-547ae94f-b0f5-4e8c-b3c2-335ba203d7ba tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:53.122382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-547ae94f-b0f5-4e8c-b3c2-335ba203d7ba tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:53.122826 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-547ae94f-b0f5-4e8c-b3c2-335ba203d7ba tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:53.123583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-547ae94f-b0f5-4e8c-b3c2-335ba203d7ba tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:53.124019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-547ae94f-b0f5-4e8c-b3c2-335ba203d7ba tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:53.253554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-547ae94f-b0f5-4e8c-b3c2-335ba203d7ba tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:53.261688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-547ae94f-b0f5-4e8c-b3c2-335ba203d7ba tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150973 Aug 01 16:02:53.262279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1538/3408] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:53 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:54.119808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b9971d7a-24c7-41b7-8d63-3d3b8e6add44 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:54.120457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b9971d7a-24c7-41b7-8d63-3d3b8e6add44 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:54.127107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b9971d7a-24c7-41b7-8d63-3d3b8e6add44 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:54.127561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b9971d7a-24c7-41b7-8d63-3d3b8e6add44 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:54.128327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b9971d7a-24c7-41b7-8d63-3d3b8e6add44 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:54.128768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b9971d7a-24c7-41b7-8d63-3d3b8e6add44 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:54.189952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b9971d7a-24c7-41b7-8d63-3d3b8e6add44 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:54.193379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:02:54.198853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b9971d7a-24c7-41b7-8d63-3d3b8e6add44 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082978 Aug 01 16:02:54.199427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1871/3409] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:54 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:54.283474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-57c998c7-a8f7-43b0-beeb-2a915462c96f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:54.284105 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-57c998c7-a8f7-43b0-beeb-2a915462c96f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:54.290621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-57c998c7-a8f7-43b0-beeb-2a915462c96f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:54.291069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-57c998c7-a8f7-43b0-beeb-2a915462c96f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:54.291836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-57c998c7-a8f7-43b0-beeb-2a915462c96f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:54.292319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-57c998c7-a8f7-43b0-beeb-2a915462c96f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:54.423919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-57c998c7-a8f7-43b0-beeb-2a915462c96f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:54.431842 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-57c998c7-a8f7-43b0-beeb-2a915462c96f tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152229 Aug 01 16:02:54.432411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1539/3410] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:54 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:55.219513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-66c7e550-0d74-4c59-b802-05219b7290ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:55.220126 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-66c7e550-0d74-4c59-b802-05219b7290ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:55.226907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-66c7e550-0d74-4c59-b802-05219b7290ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:55.227353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-66c7e550-0d74-4c59-b802-05219b7290ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:55.228120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-66c7e550-0d74-4c59-b802-05219b7290ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:55.228557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-66c7e550-0d74-4c59-b802-05219b7290ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:55.291808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-66c7e550-0d74-4c59-b802-05219b7290ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:55.300474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-66c7e550-0d74-4c59-b802-05219b7290ab tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084895 Aug 01 16:02:55.301049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1872/3411] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:55 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:02:55.453502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2b85c3a8-f9e4-4b63-83c2-8ad7a3548db9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:55.454157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2b85c3a8-f9e4-4b63-83c2-8ad7a3548db9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:55.460936 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b85c3a8-f9e4-4b63-83c2-8ad7a3548db9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:55.461389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b85c3a8-f9e4-4b63-83c2-8ad7a3548db9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:55.462189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b85c3a8-f9e4-4b63-83c2-8ad7a3548db9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:55.462632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b85c3a8-f9e4-4b63-83c2-8ad7a3548db9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:55.595173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2b85c3a8-f9e4-4b63-83c2-8ad7a3548db9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:55.603155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2b85c3a8-f9e4-4b63-83c2-8ad7a3548db9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154057 Aug 01 16:02:55.603720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1540/3412] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:55 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:56.322252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bb4132e7-5ee7-4ac6-aef3-d402c8eb1510 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:56.322812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bb4132e7-5ee7-4ac6-aef3-d402c8eb1510 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:56.329670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb4132e7-5ee7-4ac6-aef3-d402c8eb1510 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:56.330178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb4132e7-5ee7-4ac6-aef3-d402c8eb1510 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:56.330950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb4132e7-5ee7-4ac6-aef3-d402c8eb1510 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:56.331393 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bb4132e7-5ee7-4ac6-aef3-d402c8eb1510 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:56.395279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bb4132e7-5ee7-4ac6-aef3-d402c8eb1510 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:56.403725 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bb4132e7-5ee7-4ac6-aef3-d402c8eb1510 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085457 Aug 01 16:02:56.404299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1873/3413] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:56 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:56.625095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-995c9d07-e24d-4188-9bf7-c4352383a009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:56.625717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-995c9d07-e24d-4188-9bf7-c4352383a009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:56.632417 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-995c9d07-e24d-4188-9bf7-c4352383a009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:56.632868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-995c9d07-e24d-4188-9bf7-c4352383a009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:56.633636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-995c9d07-e24d-4188-9bf7-c4352383a009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:56.634107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-995c9d07-e24d-4188-9bf7-c4352383a009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:56.763801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-995c9d07-e24d-4188-9bf7-c4352383a009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:56.771717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-995c9d07-e24d-4188-9bf7-c4352383a009 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150531 Aug 01 16:02:56.772279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1541/3414] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:56 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:57.425033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aef953aa-29b7-4b33-ba3c-a20106eb9b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:57.425678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aef953aa-29b7-4b33-ba3c-a20106eb9b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:57.432222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aef953aa-29b7-4b33-ba3c-a20106eb9b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:57.432676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aef953aa-29b7-4b33-ba3c-a20106eb9b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:57.434183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aef953aa-29b7-4b33-ba3c-a20106eb9b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:57.434685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aef953aa-29b7-4b33-ba3c-a20106eb9b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:57.495340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aef953aa-29b7-4b33-ba3c-a20106eb9b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:57.503966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aef953aa-29b7-4b33-ba3c-a20106eb9b76 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082832 Aug 01 16:02:57.504693 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1874/3415] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:57 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:57.793237 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f1f18d28-3a87-405b-b0a9-4ab7acbdaeb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:57.793791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f1f18d28-3a87-405b-b0a9-4ab7acbdaeb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:57.800348 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f1f18d28-3a87-405b-b0a9-4ab7acbdaeb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:57.800798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f1f18d28-3a87-405b-b0a9-4ab7acbdaeb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:57.801552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f1f18d28-3a87-405b-b0a9-4ab7acbdaeb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:57.802030 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f1f18d28-3a87-405b-b0a9-4ab7acbdaeb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:57.937430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f1f18d28-3a87-405b-b0a9-4ab7acbdaeb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:57.945413 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f1f18d28-3a87-405b-b0a9-4ab7acbdaeb6 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156664 Aug 01 16:02:57.945997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1542/3416] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:57 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:58.524641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-86c3db01-6eaa-4763-b902-ff95596a7cc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:58.525907 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-86c3db01-6eaa-4763-b902-ff95596a7cc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:58.533331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-86c3db01-6eaa-4763-b902-ff95596a7cc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:58.533778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-86c3db01-6eaa-4763-b902-ff95596a7cc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:58.534570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-86c3db01-6eaa-4763-b902-ff95596a7cc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:58.535007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-86c3db01-6eaa-4763-b902-ff95596a7cc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:58.599632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-86c3db01-6eaa-4763-b902-ff95596a7cc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:58.608073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-86c3db01-6eaa-4763-b902-ff95596a7cc8 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087286 Aug 01 16:02:58.608641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1875/3417] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:58 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:58.967236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3d125ce3-0475-4382-a237-00ab0db19d11 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:58.967919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3d125ce3-0475-4382-a237-00ab0db19d11 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:58.974434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d125ce3-0475-4382-a237-00ab0db19d11 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:58.974879 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d125ce3-0475-4382-a237-00ab0db19d11 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:58.975631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d125ce3-0475-4382-a237-00ab0db19d11 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:58.976062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3d125ce3-0475-4382-a237-00ab0db19d11 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:59.115100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3d125ce3-0475-4382-a237-00ab0db19d11 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:59.123752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3d125ce3-0475-4382-a237-00ab0db19d11 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.160377 Aug 01 16:02:59.124314 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1543/3418] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:58 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:02:59.630093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0f465c23-2607-4897-8310-848fb5f24d3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:02:59.630970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-0f465c23-2607-4897-8310-848fb5f24d3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:02:59.637727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0f465c23-2607-4897-8310-848fb5f24d3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:59.638272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0f465c23-2607-4897-8310-848fb5f24d3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:59.639395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0f465c23-2607-4897-8310-848fb5f24d3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:02:59.640165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-0f465c23-2607-4897-8310-848fb5f24d3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:02:59.707078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-0f465c23-2607-4897-8310-848fb5f24d3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:02:59.715877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0f465c23-2607-4897-8310-848fb5f24d3b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.089727 Aug 01 16:02:59.716455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1876/3419] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:02:59 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:00.144210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-50ed7356-2e82-495e-a87b-60db299435cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:00.144827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-50ed7356-2e82-495e-a87b-60db299435cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:00.151476 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-50ed7356-2e82-495e-a87b-60db299435cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:00.151927 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-50ed7356-2e82-495e-a87b-60db299435cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:00.152693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-50ed7356-2e82-495e-a87b-60db299435cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:00.153131 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-50ed7356-2e82-495e-a87b-60db299435cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:00.283597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-50ed7356-2e82-495e-a87b-60db299435cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:00.291533 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-50ed7356-2e82-495e-a87b-60db299435cc tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151251 Aug 01 16:03:00.292247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1544/3420] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:00 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:00.737387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ee80d187-abc6-4c15-bb2a-617112677fc1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:00.738024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ee80d187-abc6-4c15-bb2a-617112677fc1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:00.744538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee80d187-abc6-4c15-bb2a-617112677fc1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:00.744988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee80d187-abc6-4c15-bb2a-617112677fc1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:00.746586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee80d187-abc6-4c15-bb2a-617112677fc1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:00.747026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee80d187-abc6-4c15-bb2a-617112677fc1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:00.807688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ee80d187-abc6-4c15-bb2a-617112677fc1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:00.816748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ee80d187-abc6-4c15-bb2a-617112677fc1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083269 Aug 01 16:03:00.817321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1877/3421] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:00 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:01.315402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ac5e4829-c2ef-4037-9177-7c6328f06b07 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:01.315947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ac5e4829-c2ef-4037-9177-7c6328f06b07 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:01.323046 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac5e4829-c2ef-4037-9177-7c6328f06b07 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:01.324085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac5e4829-c2ef-4037-9177-7c6328f06b07 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:01.324976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac5e4829-c2ef-4037-9177-7c6328f06b07 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:01.325429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ac5e4829-c2ef-4037-9177-7c6328f06b07 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:01.459136 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ac5e4829-c2ef-4037-9177-7c6328f06b07 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:01.467791 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ac5e4829-c2ef-4037-9177-7c6328f06b07 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.156381 Aug 01 16:03:01.468348 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1545/3422] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:01 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:01.837554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8b29af11-e85e-4ffb-9c6f-f48d510348a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:01.838185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8b29af11-e85e-4ffb-9c6f-f48d510348a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:01.844786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b29af11-e85e-4ffb-9c6f-f48d510348a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:01.845242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b29af11-e85e-4ffb-9c6f-f48d510348a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:01.846045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b29af11-e85e-4ffb-9c6f-f48d510348a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:01.846490 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b29af11-e85e-4ffb-9c6f-f48d510348a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:01.907847 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8b29af11-e85e-4ffb-9c6f-f48d510348a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:01.915952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8b29af11-e85e-4ffb-9c6f-f48d510348a4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082359 Aug 01 16:03:01.916524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1878/3423] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:01 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:02.490035 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6afd4a8b-4fc0-447b-9b98-26699da66f64 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:02.490726 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6afd4a8b-4fc0-447b-9b98-26699da66f64 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:02.497907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6afd4a8b-4fc0-447b-9b98-26699da66f64 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:02.498363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6afd4a8b-4fc0-447b-9b98-26699da66f64 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:02.499124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6afd4a8b-4fc0-447b-9b98-26699da66f64 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:02.499565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6afd4a8b-4fc0-447b-9b98-26699da66f64 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:02.628740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6afd4a8b-4fc0-447b-9b98-26699da66f64 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:02.638033 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6afd4a8b-4fc0-447b-9b98-26699da66f64 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151290 Aug 01 16:03:02.638171 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1546/3424] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:02 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:02.937940 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-529557fe-cc3d-4e06-8ec5-82988edc4b7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:02.938565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-529557fe-cc3d-4e06-8ec5-82988edc4b7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:02.945115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-529557fe-cc3d-4e06-8ec5-82988edc4b7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:02.945577 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-529557fe-cc3d-4e06-8ec5-82988edc4b7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:02.946374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-529557fe-cc3d-4e06-8ec5-82988edc4b7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:02.946814 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-529557fe-cc3d-4e06-8ec5-82988edc4b7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:03.013670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-529557fe-cc3d-4e06-8ec5-82988edc4b7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:03.021667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-529557fe-cc3d-4e06-8ec5-82988edc4b7a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.088358 Aug 01 16:03:03.022272 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1879/3425] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:02 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:03.659693 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d1d355f7-3d33-43dd-a6c4-31b55b3b6a7d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:03.660250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d1d355f7-3d33-43dd-a6c4-31b55b3b6a7d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:03.666734 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1d355f7-3d33-43dd-a6c4-31b55b3b6a7d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:03.667185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1d355f7-3d33-43dd-a6c4-31b55b3b6a7d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:03.667937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1d355f7-3d33-43dd-a6c4-31b55b3b6a7d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:03.668375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d1d355f7-3d33-43dd-a6c4-31b55b3b6a7d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:03.796159 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d1d355f7-3d33-43dd-a6c4-31b55b3b6a7d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:03.804153 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d1d355f7-3d33-43dd-a6c4-31b55b3b6a7d tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.148872 Aug 01 16:03:03.804717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1547/3426] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:03 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:04.043353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-01c06103-1aef-4897-8a3f-a614e3762e70 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:04.043981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-01c06103-1aef-4897-8a3f-a614e3762e70 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:04.050589 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-01c06103-1aef-4897-8a3f-a614e3762e70 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:04.051044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-01c06103-1aef-4897-8a3f-a614e3762e70 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:04.051820 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-01c06103-1aef-4897-8a3f-a614e3762e70 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:04.052306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-01c06103-1aef-4897-8a3f-a614e3762e70 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:04.115556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-01c06103-1aef-4897-8a3f-a614e3762e70 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:04.122886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-01c06103-1aef-4897-8a3f-a614e3762e70 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084375 Aug 01 16:03:04.123452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1880/3427] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:04 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:04.827074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c2de419b-0f78-436f-8fa1-4fad7d4baff1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:04.827689 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c2de419b-0f78-436f-8fa1-4fad7d4baff1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:04.834319 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2de419b-0f78-436f-8fa1-4fad7d4baff1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:04.834759 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2de419b-0f78-436f-8fa1-4fad7d4baff1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:04.835508 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2de419b-0f78-436f-8fa1-4fad7d4baff1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:04.835939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c2de419b-0f78-436f-8fa1-4fad7d4baff1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:04.965804 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c2de419b-0f78-436f-8fa1-4fad7d4baff1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:04.969216 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:04.974602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c2de419b-0f78-436f-8fa1-4fad7d4baff1 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152620 Aug 01 16:03:04.975159 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1548/3428] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:04 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:05.144226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d2ea7f86-4d77-459c-ab88-7cd715dbc4eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:05.144841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d2ea7f86-4d77-459c-ab88-7cd715dbc4eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:05.151373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2ea7f86-4d77-459c-ab88-7cd715dbc4eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:05.151894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2ea7f86-4d77-459c-ab88-7cd715dbc4eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:05.152706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2ea7f86-4d77-459c-ab88-7cd715dbc4eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:05.153171 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d2ea7f86-4d77-459c-ab88-7cd715dbc4eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:05.214603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d2ea7f86-4d77-459c-ab88-7cd715dbc4eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:05.222567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d2ea7f86-4d77-459c-ab88-7cd715dbc4eb tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082422 Aug 01 16:03:05.223136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1881/3429] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:05 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:05.997553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-feb5b1e4-45bc-4556-8008-6a2bc665eb14 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:05.998210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-feb5b1e4-45bc-4556-8008-6a2bc665eb14 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:06.004946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-feb5b1e4-45bc-4556-8008-6a2bc665eb14 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:06.005398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-feb5b1e4-45bc-4556-8008-6a2bc665eb14 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:06.006200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-feb5b1e4-45bc-4556-8008-6a2bc665eb14 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:06.006642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-feb5b1e4-45bc-4556-8008-6a2bc665eb14 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:06.134820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-feb5b1e4-45bc-4556-8008-6a2bc665eb14 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:06.143564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-feb5b1e4-45bc-4556-8008-6a2bc665eb14 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150767 Aug 01 16:03:06.144168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1549/3430] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:05 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:06.244551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-364bd78c-a527-4027-bcf4-7c3f4403c946 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:06.245262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-364bd78c-a527-4027-bcf4-7c3f4403c946 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:06.253061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-364bd78c-a527-4027-bcf4-7c3f4403c946 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:06.253808 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-364bd78c-a527-4027-bcf4-7c3f4403c946 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:06.254838 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-364bd78c-a527-4027-bcf4-7c3f4403c946 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:06.255503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-364bd78c-a527-4027-bcf4-7c3f4403c946 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:06.324689 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-364bd78c-a527-4027-bcf4-7c3f4403c946 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:06.333305 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-364bd78c-a527-4027-bcf4-7c3f4403c946 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.092801 Aug 01 16:03:06.333878 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1882/3431] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:06 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:07.165715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-811cd1dc-a83e-4fb6-912f-c3b5245458aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:07.166366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-811cd1dc-a83e-4fb6-912f-c3b5245458aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:07.173851 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-811cd1dc-a83e-4fb6-912f-c3b5245458aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:07.174342 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-811cd1dc-a83e-4fb6-912f-c3b5245458aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:07.175107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-811cd1dc-a83e-4fb6-912f-c3b5245458aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:07.175596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-811cd1dc-a83e-4fb6-912f-c3b5245458aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:07.304156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-811cd1dc-a83e-4fb6-912f-c3b5245458aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:07.312011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-811cd1dc-a83e-4fb6-912f-c3b5245458aa tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150044 Aug 01 16:03:07.312504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1550/3432] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:07 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:07.356504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-abb1c5b5-fbe2-49bd-90e5-bd9d5bc08ae0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:07.357110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-abb1c5b5-fbe2-49bd-90e5-bd9d5bc08ae0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:07.363736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abb1c5b5-fbe2-49bd-90e5-bd9d5bc08ae0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:07.364186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abb1c5b5-fbe2-49bd-90e5-bd9d5bc08ae0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:07.364953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abb1c5b5-fbe2-49bd-90e5-bd9d5bc08ae0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:07.365390 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-abb1c5b5-fbe2-49bd-90e5-bd9d5bc08ae0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:07.427317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-abb1c5b5-fbe2-49bd-90e5-bd9d5bc08ae0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:07.435298 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-abb1c5b5-fbe2-49bd-90e5-bd9d5bc08ae0 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083056 Aug 01 16:03:07.435874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1883/3433] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:07 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:08.334002 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1ff4898c-2f17-41ed-aa51-30b1ab34e78c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:08.334680 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1ff4898c-2f17-41ed-aa51-30b1ab34e78c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:08.342396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ff4898c-2f17-41ed-aa51-30b1ab34e78c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:08.342849 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ff4898c-2f17-41ed-aa51-30b1ab34e78c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:08.343619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ff4898c-2f17-41ed-aa51-30b1ab34e78c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:08.344057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1ff4898c-2f17-41ed-aa51-30b1ab34e78c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:08.456156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-82214e7a-b444-4d61-b467-9878ea736bff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:08.456751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-82214e7a-b444-4d61-b467-9878ea736bff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:08.463331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82214e7a-b444-4d61-b467-9878ea736bff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:08.463786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82214e7a-b444-4d61-b467-9878ea736bff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:08.465254 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82214e7a-b444-4d61-b467-9878ea736bff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:08.465697 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82214e7a-b444-4d61-b467-9878ea736bff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:08.475466 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1ff4898c-2f17-41ed-aa51-30b1ab34e78c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:08.484535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1ff4898c-2f17-41ed-aa51-30b1ab34e78c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.154516 Aug 01 16:03:08.485103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1551/3434] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:08 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:08.527619 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-82214e7a-b444-4d61-b467-9878ea736bff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:08.535772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-82214e7a-b444-4d61-b467-9878ea736bff tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083515 Aug 01 16:03:08.536501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1884/3435] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:08 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:03:09.506788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-79b850b6-6bf1-430f-9e53-07ccdcd1bf06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:09.507400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-79b850b6-6bf1-430f-9e53-07ccdcd1bf06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:09.514465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79b850b6-6bf1-430f-9e53-07ccdcd1bf06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:09.514919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79b850b6-6bf1-430f-9e53-07ccdcd1bf06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:09.515683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79b850b6-6bf1-430f-9e53-07ccdcd1bf06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:09.516123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-79b850b6-6bf1-430f-9e53-07ccdcd1bf06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:09.556486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-989bf898-4bc7-43cf-b4b4-48bcf3d64eb5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:09.557106 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-989bf898-4bc7-43cf-b4b4-48bcf3d64eb5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:09.563756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-989bf898-4bc7-43cf-b4b4-48bcf3d64eb5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:09.564211 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-989bf898-4bc7-43cf-b4b4-48bcf3d64eb5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:09.565049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-989bf898-4bc7-43cf-b4b4-48bcf3d64eb5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:09.565494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-989bf898-4bc7-43cf-b4b4-48bcf3d64eb5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:09.641309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-989bf898-4bc7-43cf-b4b4-48bcf3d64eb5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:09.649519 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-989bf898-4bc7-43cf-b4b4-48bcf3d64eb5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.096789 Aug 01 16:03:09.650128 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1885/3436] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:09 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:03:09.674170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-79b850b6-6bf1-430f-9e53-07ccdcd1bf06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:09.682604 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-79b850b6-6bf1-430f-9e53-07ccdcd1bf06 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.179685 Aug 01 16:03:09.683182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1552/3437] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:09 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:10.671674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ecf25bb7-0d62-4e6f-9942-f7e87568b9d3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:10.672324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ecf25bb7-0d62-4e6f-9942-f7e87568b9d3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:10.678879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecf25bb7-0d62-4e6f-9942-f7e87568b9d3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:10.679335 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecf25bb7-0d62-4e6f-9942-f7e87568b9d3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:10.680098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecf25bb7-0d62-4e6f-9942-f7e87568b9d3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:10.680538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ecf25bb7-0d62-4e6f-9942-f7e87568b9d3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:10.704294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-624c761e-2741-4fcb-a4dd-8628f7a79507 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:10.704905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-624c761e-2741-4fcb-a4dd-8628f7a79507 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:10.711496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-624c761e-2741-4fcb-a4dd-8628f7a79507 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:10.711943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-624c761e-2741-4fcb-a4dd-8628f7a79507 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:10.712704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-624c761e-2741-4fcb-a4dd-8628f7a79507 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:10.713140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-624c761e-2741-4fcb-a4dd-8628f7a79507 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:10.746066 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ecf25bb7-0d62-4e6f-9942-f7e87568b9d3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:10.754283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ecf25bb7-0d62-4e6f-9942-f7e87568b9d3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.087024 Aug 01 16:03:10.754862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1886/3438] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:10 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:10.843874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-624c761e-2741-4fcb-a4dd-8628f7a79507 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:10.851928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-624c761e-2741-4fcb-a4dd-8628f7a79507 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151453 Aug 01 16:03:10.852497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1553/3439] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:10 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:03:11.775199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-14c35053-6754-4bb9-9e57-99ba43279ca1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:11.775795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-14c35053-6754-4bb9-9e57-99ba43279ca1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:11.778462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=56 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:11.784113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14c35053-6754-4bb9-9e57-99ba43279ca1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:11.784554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14c35053-6754-4bb9-9e57-99ba43279ca1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:11.785359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14c35053-6754-4bb9-9e57-99ba43279ca1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:11.785789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-14c35053-6754-4bb9-9e57-99ba43279ca1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:11.847329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-14c35053-6754-4bb9-9e57-99ba43279ca1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:11.856084 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-14c35053-6754-4bb9-9e57-99ba43279ca1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.084550 Aug 01 16:03:11.856655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1887/3440] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:11 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:11.874733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2b6b9b82-fc5e-40b0-a8b9-3c00a6e308e7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:11.875380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2b6b9b82-fc5e-40b0-a8b9-3c00a6e308e7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:11.881880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b6b9b82-fc5e-40b0-a8b9-3c00a6e308e7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:11.882352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b6b9b82-fc5e-40b0-a8b9-3c00a6e308e7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:11.883108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b6b9b82-fc5e-40b0-a8b9-3c00a6e308e7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:11.883540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2b6b9b82-fc5e-40b0-a8b9-3c00a6e308e7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:12.016898 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2b6b9b82-fc5e-40b0-a8b9-3c00a6e308e7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:12.025251 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2b6b9b82-fc5e-40b0-a8b9-3c00a6e308e7 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155015 Aug 01 16:03:12.026138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1554/3441] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:11 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:12.877185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d95964cc-f7c9-4d35-970d-d3643dda2896 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:12.877805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d95964cc-f7c9-4d35-970d-d3643dda2896 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:12.884459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d95964cc-f7c9-4d35-970d-d3643dda2896 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:12.884909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d95964cc-f7c9-4d35-970d-d3643dda2896 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:12.885674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d95964cc-f7c9-4d35-970d-d3643dda2896 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:12.886144 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d95964cc-f7c9-4d35-970d-d3643dda2896 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:12.913682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=100 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:12.957841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d95964cc-f7c9-4d35-970d-d3643dda2896 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:12.966022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d95964cc-f7c9-4d35-970d-d3643dda2896 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.092777 Aug 01 16:03:12.966588 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1888/3442] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:12 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:13.046909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e5305140-8555-4f20-840e-d6478d97a5ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:13.047524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e5305140-8555-4f20-840e-d6478d97a5ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:13.055144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e5305140-8555-4f20-840e-d6478d97a5ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:13.055144 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e5305140-8555-4f20-840e-d6478d97a5ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:13.056010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e5305140-8555-4f20-840e-d6478d97a5ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:13.056538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e5305140-8555-4f20-840e-d6478d97a5ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:13.186361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e5305140-8555-4f20-840e-d6478d97a5ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:13.194477 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e5305140-8555-4f20-840e-d6478d97a5ec tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151471 Aug 01 16:03:13.195052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1555/3443] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:13 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:13.987494 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6595bef9-086c-4c2b-a35a-548a63e35f1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:13.988109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6595bef9-086c-4c2b-a35a-548a63e35f1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:13.994774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6595bef9-086c-4c2b-a35a-548a63e35f1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:13.995227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6595bef9-086c-4c2b-a35a-548a63e35f1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:13.995994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6595bef9-086c-4c2b-a35a-548a63e35f1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:13.996433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6595bef9-086c-4c2b-a35a-548a63e35f1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:14.063931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6595bef9-086c-4c2b-a35a-548a63e35f1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:14.069909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6595bef9-086c-4c2b-a35a-548a63e35f1d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.086382 Aug 01 16:03:14.070485 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1889/3444] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:13 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:14.216402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2c776d37-3eb6-4a06-ac64-d0e74e2d5803 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:14.217050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2c776d37-3eb6-4a06-ac64-d0e74e2d5803 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:14.223606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2c776d37-3eb6-4a06-ac64-d0e74e2d5803 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:14.224055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2c776d37-3eb6-4a06-ac64-d0e74e2d5803 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:14.224817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2c776d37-3eb6-4a06-ac64-d0e74e2d5803 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:14.225258 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2c776d37-3eb6-4a06-ac64-d0e74e2d5803 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:14.352166 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2c776d37-3eb6-4a06-ac64-d0e74e2d5803 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:14.360413 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2c776d37-3eb6-4a06-ac64-d0e74e2d5803 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.148498 Aug 01 16:03:14.360978 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1556/3445] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:14 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:15.092186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c99058cc-3639-4bb6-9d48-9cb8d9585b43 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:15.092829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c99058cc-3639-4bb6-9d48-9cb8d9585b43 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:15.099388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c99058cc-3639-4bb6-9d48-9cb8d9585b43 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:15.099845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c99058cc-3639-4bb6-9d48-9cb8d9585b43 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:15.100612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c99058cc-3639-4bb6-9d48-9cb8d9585b43 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:15.101050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c99058cc-3639-4bb6-9d48-9cb8d9585b43 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:15.162325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c99058cc-3639-4bb6-9d48-9cb8d9585b43 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:15.171009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c99058cc-3639-4bb6-9d48-9cb8d9585b43 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083305 Aug 01 16:03:15.171575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1890/3446] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:15 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:15.382003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-474403e4-5dea-47cc-9f37-16312da18fc0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:15.382613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-474403e4-5dea-47cc-9f37-16312da18fc0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:15.389329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-474403e4-5dea-47cc-9f37-16312da18fc0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:15.389797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-474403e4-5dea-47cc-9f37-16312da18fc0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:15.390569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-474403e4-5dea-47cc-9f37-16312da18fc0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:15.390998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-474403e4-5dea-47cc-9f37-16312da18fc0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:15.522825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-474403e4-5dea-47cc-9f37-16312da18fc0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:15.531353 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-474403e4-5dea-47cc-9f37-16312da18fc0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153169 Aug 01 16:03:15.531917 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1557/3447] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:15 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:16.192212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-742c49f0-2375-4f98-ad90-c15e3a7f24e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:16.192820 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-742c49f0-2375-4f98-ad90-c15e3a7f24e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:16.199426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-742c49f0-2375-4f98-ad90-c15e3a7f24e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:16.199983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-742c49f0-2375-4f98-ad90-c15e3a7f24e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:16.200753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-742c49f0-2375-4f98-ad90-c15e3a7f24e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:16.201188 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-742c49f0-2375-4f98-ad90-c15e3a7f24e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:16.263252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-742c49f0-2375-4f98-ad90-c15e3a7f24e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:16.271127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-742c49f0-2375-4f98-ad90-c15e3a7f24e9 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082765 Aug 01 16:03:16.271700 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1891/3448] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:16 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:16.552674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-871f89af-b80f-4edf-87f8-d28ca93bad23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:16.553285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-871f89af-b80f-4edf-87f8-d28ca93bad23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:16.559916 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-871f89af-b80f-4edf-87f8-d28ca93bad23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:16.560376 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-871f89af-b80f-4edf-87f8-d28ca93bad23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:16.561156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-871f89af-b80f-4edf-87f8-d28ca93bad23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:16.561596 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-871f89af-b80f-4edf-87f8-d28ca93bad23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:16.692233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-871f89af-b80f-4edf-87f8-d28ca93bad23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:16.700504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-871f89af-b80f-4edf-87f8-d28ca93bad23 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.151648 Aug 01 16:03:16.701213 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1558/3449] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:16 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:17.292108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-82fe5a88-08e1-46fe-bebf-5170828ea41e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:17.292732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-82fe5a88-08e1-46fe-bebf-5170828ea41e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:17.299514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82fe5a88-08e1-46fe-bebf-5170828ea41e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:17.299966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82fe5a88-08e1-46fe-bebf-5170828ea41e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:17.300724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82fe5a88-08e1-46fe-bebf-5170828ea41e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:17.301167 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-82fe5a88-08e1-46fe-bebf-5170828ea41e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:17.365353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-82fe5a88-08e1-46fe-bebf-5170828ea41e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:17.373972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-82fe5a88-08e1-46fe-bebf-5170828ea41e tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.085805 Aug 01 16:03:17.374551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1892/3450] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:17 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:17.722301 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b7f1d95a-3554-49e8-b7b0-6b02e3b21d53 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:17.722951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b7f1d95a-3554-49e8-b7b0-6b02e3b21d53 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:17.725386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=52 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:17.731865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7f1d95a-3554-49e8-b7b0-6b02e3b21d53 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:17.732311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7f1d95a-3554-49e8-b7b0-6b02e3b21d53 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:17.733079 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7f1d95a-3554-49e8-b7b0-6b02e3b21d53 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:17.733522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b7f1d95a-3554-49e8-b7b0-6b02e3b21d53 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:17.865366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b7f1d95a-3554-49e8-b7b0-6b02e3b21d53 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:17.874229 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b7f1d95a-3554-49e8-b7b0-6b02e3b21d53 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.155721 Aug 01 16:03:17.874798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1559/3451] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:17 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:18.394553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2ec5cc42-d6ba-4a53-8031-2dcca47f42d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:18.395173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2ec5cc42-d6ba-4a53-8031-2dcca47f42d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:18.401662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ec5cc42-d6ba-4a53-8031-2dcca47f42d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:18.402192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ec5cc42-d6ba-4a53-8031-2dcca47f42d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:18.403551 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ec5cc42-d6ba-4a53-8031-2dcca47f42d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:18.403999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ec5cc42-d6ba-4a53-8031-2dcca47f42d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:18.464299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2ec5cc42-d6ba-4a53-8031-2dcca47f42d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:18.474115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2ec5cc42-d6ba-4a53-8031-2dcca47f42d5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.083440 Aug 01 16:03:18.474690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1893/3452] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:18 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:18.895665 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d341a064-78bf-4c73-89e6-dd22e984b9d9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:18.896238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d341a064-78bf-4c73-89e6-dd22e984b9d9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:18.902946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d341a064-78bf-4c73-89e6-dd22e984b9d9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:18.903410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d341a064-78bf-4c73-89e6-dd22e984b9d9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:18.904189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d341a064-78bf-4c73-89e6-dd22e984b9d9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:18.904625 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d341a064-78bf-4c73-89e6-dd22e984b9d9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:19.035712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d341a064-78bf-4c73-89e6-dd22e984b9d9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:19.043774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d341a064-78bf-4c73-89e6-dd22e984b9d9 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152098 Aug 01 16:03:19.044328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1560/3453] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:18 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:19.495232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6db839f1-d53a-4af2-b299-79d0f49aefbe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:19.495843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6db839f1-d53a-4af2-b299-79d0f49aefbe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:19.502840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6db839f1-d53a-4af2-b299-79d0f49aefbe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:19.503287 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6db839f1-d53a-4af2-b299-79d0f49aefbe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:19.504063 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6db839f1-d53a-4af2-b299-79d0f49aefbe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:19.504481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6db839f1-d53a-4af2-b299-79d0f49aefbe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:19.565343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6db839f1-d53a-4af2-b299-79d0f49aefbe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:19.573303 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6db839f1-d53a-4af2-b299-79d0f49aefbe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082016 Aug 01 16:03:19.573866 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1894/3454] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:19 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:20.065165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-87ec5816-fbac-42d7-92bf-90569226a452 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:20.065783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-87ec5816-fbac-42d7-92bf-90569226a452 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:20.072403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87ec5816-fbac-42d7-92bf-90569226a452 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:20.072854 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87ec5816-fbac-42d7-92bf-90569226a452 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:20.073619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87ec5816-fbac-42d7-92bf-90569226a452 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:20.074098 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-87ec5816-fbac-42d7-92bf-90569226a452 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:20.204068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-87ec5816-fbac-42d7-92bf-90569226a452 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:20.212246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-87ec5816-fbac-42d7-92bf-90569226a452 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.150916 Aug 01 16:03:20.212810 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1561/3455] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:20 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:20.594523 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5927d80d-8639-4223-9f67-576c1dd89da5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:20.595137 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5927d80d-8639-4223-9f67-576c1dd89da5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:20.601716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5927d80d-8639-4223-9f67-576c1dd89da5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:20.602201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5927d80d-8639-4223-9f67-576c1dd89da5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:20.602969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5927d80d-8639-4223-9f67-576c1dd89da5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:20.603407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5927d80d-8639-4223-9f67-576c1dd89da5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:20.672309 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5927d80d-8639-4223-9f67-576c1dd89da5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:20.680284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5927d80d-8639-4223-9f67-576c1dd89da5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.089797 Aug 01 16:03:20.680845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1895/3456] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:20 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:21.234651 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5505d80a-1c15-40e2-82d7-1678ab4ceb2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:21.235246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5505d80a-1c15-40e2-82d7-1678ab4ceb2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:21.241922 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5505d80a-1c15-40e2-82d7-1678ab4ceb2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:21.242381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5505d80a-1c15-40e2-82d7-1678ab4ceb2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:21.243138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5505d80a-1c15-40e2-82d7-1678ab4ceb2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:21.243576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5505d80a-1c15-40e2-82d7-1678ab4ceb2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:21.374790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5505d80a-1c15-40e2-82d7-1678ab4ceb2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:21.382727 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5505d80a-1c15-40e2-82d7-1678ab4ceb2c tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.152160 Aug 01 16:03:21.383418 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1562/3457] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:21 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:21.701851 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-26a879f8-9547-4b47-862a-c1fc7c954c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:21.702480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-26a879f8-9547-4b47-862a-c1fc7c954c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:21.709061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26a879f8-9547-4b47-862a-c1fc7c954c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:21.709525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26a879f8-9547-4b47-862a-c1fc7c954c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:21.710317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26a879f8-9547-4b47-862a-c1fc7c954c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:21.710765 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-26a879f8-9547-4b47-862a-c1fc7c954c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:21.771905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-26a879f8-9547-4b47-862a-c1fc7c954c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:21.780463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-26a879f8-9547-4b47-862a-c1fc7c954c8f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.082464 Aug 01 16:03:21.781035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1896/3458] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:21 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:22.405267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-42014040-35ee-496d-b63e-70d76d7048d0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:22.405906 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-42014040-35ee-496d-b63e-70d76d7048d0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] [instance: 93144385-4cac-4970-9814-564a351af373] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:22.412433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42014040-35ee-496d-b63e-70d76d7048d0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:22.412880 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42014040-35ee-496d-b63e-70d76d7048d0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:22.413633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42014040-35ee-496d-b63e-70d76d7048d0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:22.414111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-42014040-35ee-496d-b63e-70d76d7048d0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:22.545861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-42014040-35ee-496d-b63e-70d76d7048d0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77cb30fae1184064a8c4f822d4d31096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f80d210cce4a41af527ac134deba93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:22.553858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-42014040-35ee-496d-b63e-70d76d7048d0 tempest-VolumesSnapshotTestJSON-1339515971 tempest-VolumesSnapshotTestJSON-1339515971-project] 10.222.0.83 "GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373" status: 200 len: 1559 microversion: 2.1 time: 0.153085 Aug 01 16:03:22.554438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1563/3459] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:22 2022] GET /compute/v2.1/servers/93144385-4cac-4970-9814-564a351af373 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:22.801756 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b68d3fe9-733d-41ce-afdf-c01b37faa6df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:22.802358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b68d3fe9-733d-41ce-afdf-c01b37faa6df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:22.809565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b68d3fe9-733d-41ce-afdf-c01b37faa6df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:22.810060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b68d3fe9-733d-41ce-afdf-c01b37faa6df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:22.810833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b68d3fe9-733d-41ce-afdf-c01b37faa6df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:22.811276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b68d3fe9-733d-41ce-afdf-c01b37faa6df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:22.887102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b68d3fe9-733d-41ce-afdf-c01b37faa6df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:22.895790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b68d3fe9-733d-41ce-afdf-c01b37faa6df tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 200 len: 1369 microversion: 2.1 time: 0.098032 Aug 01 16:03:22.896358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1897/3460] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:22 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:22.916749 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3511ad81-ba53-40b0-939b-d53740b83824 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '.version_select at 0x7feb1609f0d0>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:22.938265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3511ad81-ba53-40b0-939b-d53740b83824 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1801485675" status: 202 len: 0 microversion: 2.1 time: 0.025248 Aug 01 16:03:22.938876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1564/3461] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 1 16:03:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1801485675 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:03:23.724633 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2927c54c-f561-4e47-a037-e4a47ab88772 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Action: 'create', calling method: .version_select at 0x7feb16b2a310>, body: {"keypair": {"name": "tempest-keypair-1411324224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILWD3rEd8viLYnTowlSrlhKxbzMQMP4UooRhHjwMSpvyCHttqjSZrAt1F+UkNpIiLUVDeRJHstl95GUH7bZiUfV0L5d4iCMb87+HXytTUc2R+c42JpmKLoevnkj3wksmA=="}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:03:23.741243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-2927c54c-f561-4e47-a037-e4a47ab88772 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Getting quotas for project 85354737a87146729a06bf22ddb3fefc. Resources: {'key_pairs'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:03:23.745140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-2927c54c-f561-4e47-a037-e4a47ab88772 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Getting quotas for user ba149d1623e849328e399d6dbdca3e0c and project 85354737a87146729a06bf22ddb3fefc. Resources: {'key_pairs'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:03:23.770119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2927c54c-f561-4e47-a037-e4a47ab88772 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049324 Aug 01 16:03:23.770727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1898/3462] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 1 16:03:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:03:25.280001 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-848202281", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72e7acde-0e4d-40e2-93ad-82a4bd465289"}], "security_groups": [{"name": "tempest-securitygroup--334593482"}], "key_name": "tempest-keypair-1411324224", "user_data": "}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:03:25.380845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.network.neutron [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] validate_networks() for [('72e7acde-0e4d-40e2-93ad-82a4bd465289', None, None, None, None, None)] {{(pid=124527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:03:25.748147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Flavor limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:03:25.748587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Image limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:03:25.749089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Flavor pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:03:25.749496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Image pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:03:25.749920 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:03:25.758800 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:25.759244 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:25.760029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:25.760485 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:25.778243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Getting quotas for project 85354737a87146729a06bf22ddb3fefc. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:03:25.782176 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Getting quotas for user ba149d1623e849328e399d6dbdca3e0c and project 85354737a87146729a06bf22ddb3fefc. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:03:25.793014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Going to run 1 instances... {{(pid=124527) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:03:25.795270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:03:25.838225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [328dc140-bea4-4b62-ba29-c225a0e78a34] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 16:03:26.101379 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1771ed08-4645-45ac-b67e-ed742532ba9c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:26.102022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1771ed08-4645-45ac-b67e-ed742532ba9c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:26.108480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1771ed08-4645-45ac-b67e-ed742532ba9c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:26.108967 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1771ed08-4645-45ac-b67e-ed742532ba9c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:26.109751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1771ed08-4645-45ac-b67e-ed742532ba9c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:26.110230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1771ed08-4645-45ac-b67e-ed742532ba9c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:26.142507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1771ed08-4645-45ac-b67e-ed742532ba9c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:03:26.222661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1771ed08-4645-45ac-b67e-ed742532ba9c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "DELETE /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 204 len: 0 microversion: 2.1 time: 0.125335 Aug 01 16:03:26.223269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1899/3463] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:03:26 2022] DELETE /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 16:03:26.232277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-46751e66-6f0d-4156-be74-229720c9c367 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:26.232977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-46751e66-6f0d-4156-be74-229720c9c367 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:26.238929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-46751e66-6f0d-4156-be74-229720c9c367 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:26.239382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-46751e66-6f0d-4156-be74-229720c9c367 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:26.240150 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-46751e66-6f0d-4156-be74-229720c9c367 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:26.240587 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-46751e66-6f0d-4156-be74-229720c9c367 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:26.371988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-46751e66-6f0d-4156-be74-229720c9c367 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:26.379688 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-46751e66-6f0d-4156-be74-229720c9c367 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1508 microversion: 2.1 time: 0.151753 Aug 01 16:03:26.380258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1900/3464] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:26 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:03:26.847346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [328dc140-bea4-4b62-ba29-c225a0e78a34] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 35406. Aug 01 16:03:26.851462 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d5af4227-edcb-4ddd-9d6c-9950e20bd9c1 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.577300 Aug 01 16:03:26.852621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1565/3465] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 16:03:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:03:26.863624 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-79e5f78d-26c9-4a75-94b5-add213f5c997 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:26.864250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-79e5f78d-26c9-4a75-94b5-add213f5c997 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:26.923345 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-79e5f78d-26c9-4a75-94b5-add213f5c997 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:26.930836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-79e5f78d-26c9-4a75-94b5-add213f5c997 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1237 microversion: 2.1 time: 0.070987 Aug 01 16:03:26.931718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1901/3466] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:26 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:27.392213 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-5c52039f-2fcd-451e-813d-c1ea8762e46a req-537c4604-de6e-4b5d-a677-a217a345d134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df81c1c8-0ae0-44a5-8f89-b32d2396e056", "name": "network-vif-deleted", "tag": "d51054b4-9bd5-4685-8e01-589ee8693546"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:03:27.400990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2d5df8c0-862f-4e3c-b13c-5d864f332a86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:27.401716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2d5df8c0-862f-4e3c-b13c-5d864f332a86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:27.404837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-5c52039f-2fcd-451e-813d-c1ea8762e46a req-537c4604-de6e-4b5d-a677-a217a345d134 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:27.405504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-5c52039f-2fcd-451e-813d-c1ea8762e46a req-537c4604-de6e-4b5d-a677-a217a345d134 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:27.413327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d5df8c0-862f-4e3c-b13c-5d864f332a86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:27.417466 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d5df8c0-862f-4e3c-b13c-5d864f332a86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:27.419212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d5df8c0-862f-4e3c-b13c-5d864f332a86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:27.419587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-5c52039f-2fcd-451e-813d-c1ea8762e46a req-537c4604-de6e-4b5d-a677-a217a345d134 service nova] Creating event network-vif-deleted:d51054b4-9bd5-4685-8e01-589ee8693546 for instance df81c1c8-0ae0-44a5-8f89-b32d2396e056 on hv-cinder-84753 Aug 01 16:03:27.419766 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d5df8c0-862f-4e3c-b13c-5d864f332a86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:27.430063 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-5c52039f-2fcd-451e-813d-c1ea8762e46a req-537c4604-de6e-4b5d-a677-a217a345d134 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111291 Aug 01 16:03:27.430986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1566/3467] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:03:27.454640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d5df8c0-862f-4e3c-b13c-5d864f332a86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:27.455186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2d5df8c0-862f-4e3c-b13c-5d864f332a86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:27.455747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.objects.instance [None req-2d5df8c0-862f-4e3c-b13c-5d864f332a86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lazy-loading 'fault' on Instance uuid df81c1c8-0ae0-44a5-8f89-b32d2396e056 {{(pid=124526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:03:27.502067 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2d5df8c0-862f-4e3c-b13c-5d864f332a86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:27.509596 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2d5df8c0-862f-4e3c-b13c-5d864f332a86 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 200 len: 1311 microversion: 2.1 time: 0.112608 Aug 01 16:03:27.510344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1902/3468] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:27 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:27.955633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0c9f53f5-e2d5-4f0d-9c78-53ed23455b4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:27.956397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0c9f53f5-e2d5-4f0d-9c78-53ed23455b4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:27.964591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c9f53f5-e2d5-4f0d-9c78-53ed23455b4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:27.965122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c9f53f5-e2d5-4f0d-9c78-53ed23455b4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:27.966064 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c9f53f5-e2d5-4f0d-9c78-53ed23455b4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:27.966576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c9f53f5-e2d5-4f0d-9c78-53ed23455b4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:28.040937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c9f53f5-e2d5-4f0d-9c78-53ed23455b4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:28.044620 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=100 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:28.049325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0c9f53f5-e2d5-4f0d-9c78-53ed23455b4f tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1289 microversion: 2.1 time: 0.100408 Aug 01 16:03:28.055222 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1567/3469] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:27 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1289 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:28.532654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e3549609-8d8f-4b4d-b747-6ffb5cd43ce8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:28.533205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e3549609-8d8f-4b4d-b747-6ffb5cd43ce8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: df81c1c8-0ae0-44a5-8f89-b32d2396e056] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:28.539939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3549609-8d8f-4b4d-b747-6ffb5cd43ce8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:28.540395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3549609-8d8f-4b4d-b747-6ffb5cd43ce8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:28.541169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3549609-8d8f-4b4d-b747-6ffb5cd43ce8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:28.541612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3549609-8d8f-4b4d-b747-6ffb5cd43ce8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:28.555749 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-e3549609-8d8f-4b4d-b747-6ffb5cd43ce8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] HTTP exception thrown: Instance df81c1c8-0ae0-44a5-8f89-b32d2396e056 could not be found. Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e3549609-8d8f-4b4d-b747-6ffb5cd43ce8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Request method failure captured: Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 HTTP/1.1 Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_J2ZHRqxCwFvaKrEkSd8ORzK2PwsmTx60DF_ba7S6dAUTJUvKWYA4hRugEhtyhv0hZHV6Uf_HgHb3vG86PQEcDc4NnXYlJGwlBGATM-_7LlCX46G0SLfNms7SRDrYtedFO_ChgOei2pLR71F5jaEKNvk5jZYGYGTAsANlrWOTt8u8E Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 2d49f0b3378c42ada96c61586a38136e Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-262587399 Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:03:28.557603 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:03:28.559444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d49f0b3378c42ada96c61586a38136e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d49f0b3378c42ada96c61586a38136e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d49f0b3378c42ada96c61586a38136e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d49f0b3378c42ada96c61586a38136e"}]}] Aug 01 16:03:28.559444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-ServerRescueNegativeTestJSON-262587399 Aug 01 16:03:28.559444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 2d49f0b3378c42ada96c61586a38136e Aug 01 16:03:28.559444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-262587399 Aug 01 16:03:28.559444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-ServerRescueNegativeTestJSON-262587399-project Aug 01 16:03:28.559444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:03:28.559444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:03:28.559444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: 5f0b12ba782244d7b44783c3f3532bfa Aug 01 16:03:28.559444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-ServerRescueNegativeTestJSON-262587399-project Aug 01 16:03:28.559444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 16:03:28.559444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance df81c1c8-0ae0-44a5-8f89-b32d2396e056 could not be found. Aug 01 16:03:28.559444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': 'df81c1c8-0ae0-44a5-8f89-b32d2396e056'} Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df81c1c8-0ae0-44a5-8f89-b32d2396e056 could not be found. Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:03:28.560841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df81c1c8-0ae0-44a5-8f89-b32d2396e056 could not be found. Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df81c1c8-0ae0-44a5-8f89-b32d2396e056 could not be found. Aug 01 16:03:28.563156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:03:28.565832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e3549609-8d8f-4b4d-b747-6ffb5cd43ce8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Returning 404 to user: Instance df81c1c8-0ae0-44a5-8f89-b32d2396e056 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:03:28.565832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e3549609-8d8f-4b4d-b747-6ffb5cd43ce8 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056" status: 404 len: 111 microversion: 2.1 time: 0.031071 Aug 01 16:03:28.565832 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1903/3470] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:28 2022] GET /compute/v2.1/servers/df81c1c8-0ae0-44a5-8f89-b32d2396e056 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:03:28.568199 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4bd32123-4d90-4881-8339-707d8ea544b5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:28.568774 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4bd32123-4d90-4881-8339-707d8ea544b5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:28.575584 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4bd32123-4d90-4881-8339-707d8ea544b5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:28.576262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4bd32123-4d90-4881-8339-707d8ea544b5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:28.577250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4bd32123-4d90-4881-8339-707d8ea544b5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:28.577792 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4bd32123-4d90-4881-8339-707d8ea544b5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:28.604778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4bd32123-4d90-4881-8339-707d8ea544b5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Going to try to terminate instance {{(pid=124527) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:03:28.690795 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4bd32123-4d90-4881-8339-707d8ea544b5 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "DELETE /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 204 len: 0 microversion: 2.1 time: 0.126179 Aug 01 16:03:28.691991 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1568/3471] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:03:28 2022] DELETE /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:03:28.700567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7d010107-1926-4414-9c77-ec6cdab562e9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:28.701205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7d010107-1926-4414-9c77-ec6cdab562e9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:28.707834 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d010107-1926-4414-9c77-ec6cdab562e9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:28.708408 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d010107-1926-4414-9c77-ec6cdab562e9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:28.709397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d010107-1926-4414-9c77-ec6cdab562e9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:28.709944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d010107-1926-4414-9c77-ec6cdab562e9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:28.849092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7d010107-1926-4414-9c77-ec6cdab562e9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:28.858643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7d010107-1926-4414-9c77-ec6cdab562e9 tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1522 microversion: 2.1 time: 0.162117 Aug 01 16:03:28.859718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1904/3472] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:28 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:29.073204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2aa3e9c8-2035-4932-8341-889d1b0c0d91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:29.073934 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2aa3e9c8-2035-4932-8341-889d1b0c0d91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:29.086919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2aa3e9c8-2035-4932-8341-889d1b0c0d91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:29.087380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2aa3e9c8-2035-4932-8341-889d1b0c0d91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:29.088164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2aa3e9c8-2035-4932-8341-889d1b0c0d91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:29.088607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2aa3e9c8-2035-4932-8341-889d1b0c0d91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:29.229188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2aa3e9c8-2035-4932-8341-889d1b0c0d91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:29.237056 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2aa3e9c8-2035-4932-8341-889d1b0c0d91 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1362 microversion: 2.1 time: 0.168257 Aug 01 16:03:29.237638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1569/3473] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:29 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:29.521709 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-7d393f23-f318-40b4-93e1-843aabd28208 req-6e79efc8-6d22-42c3-af93-46c2373dd9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df9a73b-9aa3-4938-bb4a-062ef29f6700", "tag": "7af2d1cd-66d0-487e-87cf-d287f7f52721"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:03:29.535258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-7d393f23-f318-40b4-93e1-843aabd28208 req-6e79efc8-6d22-42c3-af93-46c2373dd9f1 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:29.536622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-7d393f23-f318-40b4-93e1-843aabd28208 req-6e79efc8-6d22-42c3-af93-46c2373dd9f1 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:29.551554 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-7d393f23-f318-40b4-93e1-843aabd28208 req-6e79efc8-6d22-42c3-af93-46c2373dd9f1 service nova] Creating event network-changed:7af2d1cd-66d0-487e-87cf-d287f7f52721 for instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 on hv-cinder-84753 Aug 01 16:03:29.557329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-7d393f23-f318-40b4-93e1-843aabd28208 req-6e79efc8-6d22-42c3-af93-46c2373dd9f1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039592 Aug 01 16:03:29.558277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1905/3474] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:03:29.881810 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-48e08ca8-7e1d-43df-a053-9e12a5b75307 req-263a3a92-27f1-453c-93c4-dacb030b1b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98608629-6a0a-496b-9d09-cdb8a2e5118e", "name": "network-vif-deleted", "tag": "dbd0f21d-36cc-4868-9cff-11f0389cbba7"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:03:29.882988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3db70219-9ade-4630-aac3-f855795d9e3c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:29.883696 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3db70219-9ade-4630-aac3-f855795d9e3c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:29.893568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3db70219-9ade-4630-aac3-f855795d9e3c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:29.894730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3db70219-9ade-4630-aac3-f855795d9e3c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:29.895994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3db70219-9ade-4630-aac3-f855795d9e3c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:29.897258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3db70219-9ade-4630-aac3-f855795d9e3c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:29.897845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-48e08ca8-7e1d-43df-a053-9e12a5b75307 req-263a3a92-27f1-453c-93c4-dacb030b1b72 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:29.898565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-48e08ca8-7e1d-43df-a053-9e12a5b75307 req-263a3a92-27f1-453c-93c4-dacb030b1b72 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:29.914055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-48e08ca8-7e1d-43df-a053-9e12a5b75307 req-263a3a92-27f1-453c-93c4-dacb030b1b72 service nova] Creating event network-vif-deleted:dbd0f21d-36cc-4868-9cff-11f0389cbba7 for instance 98608629-6a0a-496b-9d09-cdb8a2e5118e on hv-cinder-84753 Aug 01 16:03:29.921706 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-48e08ca8-7e1d-43df-a053-9e12a5b75307 req-263a3a92-27f1-453c-93c4-dacb030b1b72 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160416 Aug 01 16:03:29.922352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1570/3475] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:03:29.930155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:29.948273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3db70219-9ade-4630-aac3-f855795d9e3c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:29.948717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3db70219-9ade-4630-aac3-f855795d9e3c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:29.949242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.objects.instance [None req-3db70219-9ade-4630-aac3-f855795d9e3c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lazy-loading 'fault' on Instance uuid 98608629-6a0a-496b-9d09-cdb8a2e5118e {{(pid=124526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:03:29.996944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3db70219-9ade-4630-aac3-f855795d9e3c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b12ba782244d7b44783c3f3532bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49f0b3378c42ada96c61586a38136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:30.005640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3db70219-9ade-4630-aac3-f855795d9e3c tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 200 len: 1311 microversion: 2.1 time: 0.127802 Aug 01 16:03:30.006480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1906/3476] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:29 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:03:30.259656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f8382115-d187-4e0b-827a-0c5e2b036cfe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:30.260999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f8382115-d187-4e0b-827a-0c5e2b036cfe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:30.270535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8382115-d187-4e0b-827a-0c5e2b036cfe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:30.271083 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8382115-d187-4e0b-827a-0c5e2b036cfe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:30.272093 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8382115-d187-4e0b-827a-0c5e2b036cfe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:30.272535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f8382115-d187-4e0b-827a-0c5e2b036cfe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:30.414488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f8382115-d187-4e0b-827a-0c5e2b036cfe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:30.422400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f8382115-d187-4e0b-827a-0c5e2b036cfe tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1362 microversion: 2.1 time: 0.167491 Aug 01 16:03:30.422966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1571/3477] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:30 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:31.028567 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-52c3b67a-4469-4086-bac0-423cdd5c948b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:31.029149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-52c3b67a-4469-4086-bac0-423cdd5c948b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] [instance: 98608629-6a0a-496b-9d09-cdb8a2e5118e] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:31.035871 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52c3b67a-4469-4086-bac0-423cdd5c948b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:31.036322 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52c3b67a-4469-4086-bac0-423cdd5c948b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:31.037097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52c3b67a-4469-4086-bac0-423cdd5c948b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:31.037537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-52c3b67a-4469-4086-bac0-423cdd5c948b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:31.051822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-52c3b67a-4469-4086-bac0-423cdd5c948b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] HTTP exception thrown: Instance 98608629-6a0a-496b-9d09-cdb8a2e5118e could not be found. Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-52c3b67a-4469-4086-bac0-423cdd5c948b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Request method failure captured: Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e HTTP/1.1 Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_J2ZHRqxCwFvaKrEkSd8ORzK2PwsmTx60DF_ba7S6dAUTJUvKWYA4hRugEhtyhv0hZHV6Uf_HgHb3vG86PQEcDc4NnXYlJGwlBGATM-_7LlCX46G0SLfNms7SRDrYtedFO_ChgOei2pLR71F5jaEKNvk5jZYGYGTAsANlrWOTt8u8E Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 2d49f0b3378c42ada96c61586a38136e Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-262587399 Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:03:31.053642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:03:31.055367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d49f0b3378c42ada96c61586a38136e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d49f0b3378c42ada96c61586a38136e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d49f0b3378c42ada96c61586a38136e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d49f0b3378c42ada96c61586a38136e"}]}] Aug 01 16:03:31.055367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-ServerRescueNegativeTestJSON-262587399 Aug 01 16:03:31.055367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 2d49f0b3378c42ada96c61586a38136e Aug 01 16:03:31.055367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-262587399 Aug 01 16:03:31.055367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-ServerRescueNegativeTestJSON-262587399-project Aug 01 16:03:31.055367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:03:31.055367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:03:31.055367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: 5f0b12ba782244d7b44783c3f3532bfa Aug 01 16:03:31.055367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-ServerRescueNegativeTestJSON-262587399-project Aug 01 16:03:31.055367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 16:03:31.055367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance 98608629-6a0a-496b-9d09-cdb8a2e5118e could not be found. Aug 01 16:03:31.055367 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': '98608629-6a0a-496b-9d09-cdb8a2e5118e'} Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98608629-6a0a-496b-9d09-cdb8a2e5118e could not be found. Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:03:31.057071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98608629-6a0a-496b-9d09-cdb8a2e5118e could not be found. Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98608629-6a0a-496b-9d09-cdb8a2e5118e could not be found. Aug 01 16:03:31.058578 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:03:31.060538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-52c3b67a-4469-4086-bac0-423cdd5c948b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] Returning 404 to user: Instance 98608629-6a0a-496b-9d09-cdb8a2e5118e could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:03:31.060538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-52c3b67a-4469-4086-bac0-423cdd5c948b tempest-ServerRescueNegativeTestJSON-262587399 tempest-ServerRescueNegativeTestJSON-262587399-project] 10.222.0.83 "GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e" status: 404 len: 111 microversion: 2.1 time: 0.031162 Aug 01 16:03:31.060538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1907/3478] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:31 2022] GET /compute/v2.1/servers/98608629-6a0a-496b-9d09-cdb8a2e5118e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:03:31.443540 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a11302ff-2fe1-4c1a-8ffb-9e30fe8a6cc4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:31.444268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a11302ff-2fe1-4c1a-8ffb-9e30fe8a6cc4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:31.450957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a11302ff-2fe1-4c1a-8ffb-9e30fe8a6cc4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:31.451410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a11302ff-2fe1-4c1a-8ffb-9e30fe8a6cc4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:31.452212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a11302ff-2fe1-4c1a-8ffb-9e30fe8a6cc4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:31.452654 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a11302ff-2fe1-4c1a-8ffb-9e30fe8a6cc4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:31.586909 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a11302ff-2fe1-4c1a-8ffb-9e30fe8a6cc4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:31.594969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a11302ff-2fe1-4c1a-8ffb-9e30fe8a6cc4 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1362 microversion: 2.1 time: 0.155310 Aug 01 16:03:31.595538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1572/3479] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:31 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:32.616784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dba5d651-bbd3-4baa-a646-21952ee39151 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:32.617569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dba5d651-bbd3-4baa-a646-21952ee39151 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:32.626518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dba5d651-bbd3-4baa-a646-21952ee39151 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:32.627061 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dba5d651-bbd3-4baa-a646-21952ee39151 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:32.628006 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dba5d651-bbd3-4baa-a646-21952ee39151 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:32.628386 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dba5d651-bbd3-4baa-a646-21952ee39151 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:32.778870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dba5d651-bbd3-4baa-a646-21952ee39151 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:32.786818 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dba5d651-bbd3-4baa-a646-21952ee39151 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1362 microversion: 2.1 time: 0.173839 Aug 01 16:03:32.787402 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1908/3480] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:32 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:33.812232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-34db1c98-e657-4881-9828-5e5f5f8616f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:33.813615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-34db1c98-e657-4881-9828-5e5f5f8616f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:33.824289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-34db1c98-e657-4881-9828-5e5f5f8616f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:33.825203 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-34db1c98-e657-4881-9828-5e5f5f8616f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:33.826533 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-34db1c98-e657-4881-9828-5e5f5f8616f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:33.827265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-34db1c98-e657-4881-9828-5e5f5f8616f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:34.000162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-34db1c98-e657-4881-9828-5e5f5f8616f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:34.007719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-34db1c98-e657-4881-9828-5e5f5f8616f3 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1362 microversion: 2.1 time: 0.202805 Aug 01 16:03:34.008364 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1573/3481] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:33 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:35.028354 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1b1fea93-8dd8-4267-a7cd-0d713f5b1aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:35.029260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1b1fea93-8dd8-4267-a7cd-0d713f5b1aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:35.036475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b1fea93-8dd8-4267-a7cd-0d713f5b1aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:35.036968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b1fea93-8dd8-4267-a7cd-0d713f5b1aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:35.037735 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b1fea93-8dd8-4267-a7cd-0d713f5b1aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:35.038196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1b1fea93-8dd8-4267-a7cd-0d713f5b1aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:35.212812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1b1fea93-8dd8-4267-a7cd-0d713f5b1aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:35.221093 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1b1fea93-8dd8-4267-a7cd-0d713f5b1aa5 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1362 microversion: 2.1 time: 0.196680 Aug 01 16:03:35.221770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1909/3482] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:35 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:35.441829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-53d8653d-6e86-4dbd-9a41-83485e0b4f13 req-f4568dcf-85f3-4cf7-9de4-d139661c5c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df9a73b-9aa3-4938-bb4a-062ef29f6700", "name": "network-vif-plugged", "status": "completed", "tag": "7af2d1cd-66d0-487e-87cf-d287f7f52721"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:03:35.451586 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-53d8653d-6e86-4dbd-9a41-83485e0b4f13 req-f4568dcf-85f3-4cf7-9de4-d139661c5c6c service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:35.452034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-53d8653d-6e86-4dbd-9a41-83485e0b4f13 req-f4568dcf-85f3-4cf7-9de4-d139661c5c6c service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:35.463200 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-53d8653d-6e86-4dbd-9a41-83485e0b4f13 req-f4568dcf-85f3-4cf7-9de4-d139661c5c6c service nova] Creating event network-vif-plugged:7af2d1cd-66d0-487e-87cf-d287f7f52721 for instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 on hv-cinder-84753 Aug 01 16:03:35.468240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-53d8653d-6e86-4dbd-9a41-83485e0b4f13 req-f4568dcf-85f3-4cf7-9de4-d139661c5c6c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227959 Aug 01 16:03:35.468834 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1574/3483] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:03:36.243621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8a616535-f858-474f-ae6a-b2a28fe89c45 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:36.244421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8a616535-f858-474f-ae6a-b2a28fe89c45 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:36.251400 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a616535-f858-474f-ae6a-b2a28fe89c45 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:36.251849 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a616535-f858-474f-ae6a-b2a28fe89c45 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:36.252616 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a616535-f858-474f-ae6a-b2a28fe89c45 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:36.253047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8a616535-f858-474f-ae6a-b2a28fe89c45 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:36.392539 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8a616535-f858-474f-ae6a-b2a28fe89c45 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:36.400060 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8a616535-f858-474f-ae6a-b2a28fe89c45 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1362 microversion: 2.1 time: 0.160389 Aug 01 16:03:36.400705 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1910/3484] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:36 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:37.418530 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=2 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:37.419310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=6 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:37.424140 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f6650e39-5b47-4a8f-a6c0-cddf53ddcafa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:37.424842 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f6650e39-5b47-4a8f-a6c0-cddf53ddcafa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:37.431987 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f6650e39-5b47-4a8f-a6c0-cddf53ddcafa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:37.432507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f6650e39-5b47-4a8f-a6c0-cddf53ddcafa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:37.433240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f6650e39-5b47-4a8f-a6c0-cddf53ddcafa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:37.433677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f6650e39-5b47-4a8f-a6c0-cddf53ddcafa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:37.564583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-f6650e39-5b47-4a8f-a6c0-cddf53ddcafa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:03:37.575617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f6650e39-5b47-4a8f-a6c0-cddf53ddcafa tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1548 microversion: 2.1 time: 0.158098 Aug 01 16:03:37.576180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1575/3485] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:03:37 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:03:37.596430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-832b62a9-7eec-462a-9fce-4c9437254522 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:03:37.597016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-832b62a9-7eec-462a-9fce-4c9437254522 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:03:37.598830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=6 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:03:37.604684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-832b62a9-7eec-462a-9fce-4c9437254522 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:37.605138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-832b62a9-7eec-462a-9fce-4c9437254522 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:37.606706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-832b62a9-7eec-462a-9fce-4c9437254522 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:37.607148 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-832b62a9-7eec-462a-9fce-4c9437254522 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:37.689740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-832b62a9-7eec-462a-9fce-4c9437254522 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097187 Aug 01 16:03:37.690375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1911/3486] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 1 16:03:37 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:03:38.887704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-6636cec9-a875-4679-a67e-a51c87611c5f req-55a31960-5e35-45c2-b482-b98fc7f11307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df9a73b-9aa3-4938-bb4a-062ef29f6700", "tag": "7af2d1cd-66d0-487e-87cf-d287f7f52721"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:03:38.897715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-6636cec9-a875-4679-a67e-a51c87611c5f req-55a31960-5e35-45c2-b482-b98fc7f11307 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:03:38.898261 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-6636cec9-a875-4679-a67e-a51c87611c5f req-55a31960-5e35-45c2-b482-b98fc7f11307 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:03:38.911346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-6636cec9-a875-4679-a67e-a51c87611c5f req-55a31960-5e35-45c2-b482-b98fc7f11307 service nova] Creating event network-changed:7af2d1cd-66d0-487e-87cf-d287f7f52721 for instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 on hv-cinder-84753 Aug 01 16:03:38.916216 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-6636cec9-a875-4679-a67e-a51c87611c5f req-55a31960-5e35-45c2-b482-b98fc7f11307 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032174 Aug 01 16:03:38.916889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1576/3487] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:04:06.246498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:04:06.247626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 16:04:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:04:22.685141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:22.685964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=28 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:04:22.691294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-24ad8d85-5737-47b6-bb4c-cce1e0ed047d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:04:22.691794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-24ad8d85-5737-47b6-bb4c-cce1e0ed047d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:04:22.700971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24ad8d85-5737-47b6-bb4c-cce1e0ed047d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:04:22.701426 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24ad8d85-5737-47b6-bb4c-cce1e0ed047d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:04:22.702289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24ad8d85-5737-47b6-bb4c-cce1e0ed047d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:04:22.702740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-24ad8d85-5737-47b6-bb4c-cce1e0ed047d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:04:22.729600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-24ad8d85-5737-47b6-bb4c-cce1e0ed047d tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700/ips" status: 200 len: 146 microversion: 2.1 time: 0.046321 Aug 01 16:04:22.730349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1912/3488] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 1 16:04:22 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:05:22.809266 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1146a60e-e656-4d28-8afa-befaae322a02] AMQP server on 10.222.0.83:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 01 16:05:22.810269 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:22.811397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:23.078946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-02de0317-187f-43aa-a10f-ea53c5117570 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:23.079549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-02de0317-187f-43aa-a10f-ea53c5117570 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:23.086168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-02de0317-187f-43aa-a10f-ea53c5117570 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:23.086595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-02de0317-187f-43aa-a10f-ea53c5117570 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:23.087361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-02de0317-187f-43aa-a10f-ea53c5117570 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:23.087794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-02de0317-187f-43aa-a10f-ea53c5117570 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:23.114638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-02de0317-187f-43aa-a10f-ea53c5117570 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Going to try to terminate instance {{(pid=124527) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:05:23.202185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-02de0317-187f-43aa-a10f-ea53c5117570 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 204 len: 0 microversion: 2.1 time: 0.395751 Aug 01 16:05:23.202677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1577/3489] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:05:22 2022] DELETE /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:05:23.210185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=2 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:23.210944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=4 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:23.215391 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-61ea64ac-9e29-475f-8c55-955725e43a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:23.216050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-61ea64ac-9e29-475f-8c55-955725e43a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:23.223840 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-61ea64ac-9e29-475f-8c55-955725e43a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:23.224324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-61ea64ac-9e29-475f-8c55-955725e43a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:23.225107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-61ea64ac-9e29-475f-8c55-955725e43a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:23.225549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-61ea64ac-9e29-475f-8c55-955725e43a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:23.495661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-61ea64ac-9e29-475f-8c55-955725e43a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:23.503224 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-61ea64ac-9e29-475f-8c55-955725e43a33 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1673 microversion: 2.1 time: 0.294776 Aug 01 16:05:23.503794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1913/3490] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:23 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1673 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:24.525641 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-140c1332-45a3-4774-81c6-4751418be981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:24.526354 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-140c1332-45a3-4774-81c6-4751418be981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:24.533663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-140c1332-45a3-4774-81c6-4751418be981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:24.534139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-140c1332-45a3-4774-81c6-4751418be981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:24.535571 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-140c1332-45a3-4774-81c6-4751418be981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:24.536011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-140c1332-45a3-4774-81c6-4751418be981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:24.543241 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] [1146a60e-e656-4d28-8afa-befaae322a02] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 35598. Aug 01 16:05:24.741106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-140c1332-45a3-4774-81c6-4751418be981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:24.746291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-140c1332-45a3-4774-81c6-4751418be981 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1673 microversion: 2.1 time: 0.224764 Aug 01 16:05:24.746989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1578/3491] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:24 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1673 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:25.635928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-3d67b9aa-018d-47e6-a32d-bda64ff48da5 req-869c0360-2682-4107-99cc-7d2dc3f9a441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df9a73b-9aa3-4938-bb4a-062ef29f6700", "name": "network-vif-deleted", "tag": "7af2d1cd-66d0-487e-87cf-d287f7f52721"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:05:25.649595 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-3d67b9aa-018d-47e6-a32d-bda64ff48da5 req-869c0360-2682-4107-99cc-7d2dc3f9a441 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:25.650212 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-3d67b9aa-018d-47e6-a32d-bda64ff48da5 req-869c0360-2682-4107-99cc-7d2dc3f9a441 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:25.678196 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-3d67b9aa-018d-47e6-a32d-bda64ff48da5 req-869c0360-2682-4107-99cc-7d2dc3f9a441 service nova] Creating event network-vif-deleted:7af2d1cd-66d0-487e-87cf-d287f7f52721 for instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 on hv-cinder-84753 Aug 01 16:05:25.684210 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-3d67b9aa-018d-47e6-a32d-bda64ff48da5 req-869c0360-2682-4107-99cc-7d2dc3f9a441 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051687 Aug 01 16:05:25.685438 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1914/3492] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:05:25.769910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ad8b3748-e5e4-45d4-a50e-078c523f4d0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:25.770619 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ad8b3748-e5e4-45d4-a50e-078c523f4d0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:25.787449 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad8b3748-e5e4-45d4-a50e-078c523f4d0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:25.788310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad8b3748-e5e4-45d4-a50e-078c523f4d0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:25.789145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad8b3748-e5e4-45d4-a50e-078c523f4d0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:25.789594 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad8b3748-e5e4-45d4-a50e-078c523f4d0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:25.831609 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad8b3748-e5e4-45d4-a50e-078c523f4d0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:25.832768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ad8b3748-e5e4-45d4-a50e-078c523f4d0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:25.833827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-ad8b3748-e5e4-45d4-a50e-078c523f4d0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lazy-loading 'fault' on Instance uuid 6df9a73b-9aa3-4938-bb4a-062ef29f6700 {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:05:25.884077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ad8b3748-e5e4-45d4-a50e-078c523f4d0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba149d1623e849328e399d6dbdca3e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85354737a87146729a06bf22ddb3fefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:25.891816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ad8b3748-e5e4-45d4-a50e-078c523f4d0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 200 len: 1327 microversion: 2.1 time: 0.126943 Aug 01 16:05:25.892344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1579/3493] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:25 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:26.925755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-86d5da09-0ffc-487b-94ac-52b7f1762e4a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:26.925755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-86d5da09-0ffc-487b-94ac-52b7f1762e4a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:26.926529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-86d5da09-0ffc-487b-94ac-52b7f1762e4a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:26.926970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-86d5da09-0ffc-487b-94ac-52b7f1762e4a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:26.927968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-86d5da09-0ffc-487b-94ac-52b7f1762e4a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:26.928640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-86d5da09-0ffc-487b-94ac-52b7f1762e4a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:26.944053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-86d5da09-0ffc-487b-94ac-52b7f1762e4a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] HTTP exception thrown: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-86d5da09-0ffc-487b-94ac-52b7f1762e4a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Request method failure captured: Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 HTTP/1.1 Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_Jmlx2vnbnk0lKcbsy2AYy6I3lUTNvEhfM6QYvHnZh-_L4BGrhaLr2tVolhdM-UX8a6JlIclFzId09LJO9KJpeB2EOmZa72L55dENxljRav7mPMz0SFwre86rMW5QruOjTZB_gqp0d2PT15Byz-h9VgrDrBvw_ypL7uzZPgi6BxoQc Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 85354737a87146729a06bf22ddb3fefc Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:05:26.945830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:05:26.948803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/85354737a87146729a06bf22ddb3fefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/85354737a87146729a06bf22ddb3fefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_85354737a87146729a06bf22ddb3fefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/85354737a87146729a06bf22ddb3fefc"}]}] Aug 01 16:05:26.948803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:05:26.948803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 85354737a87146729a06bf22ddb3fefc Aug 01 16:05:26.948803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:05:26.948803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-AttachVolumeTestJSON-2001489868-project Aug 01 16:05:26.948803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:05:26.948803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:05:26.948803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: ba149d1623e849328e399d6dbdca3e0c Aug 01 16:05:26.948803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-AttachVolumeTestJSON-2001489868-project Aug 01 16:05:26.948803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 16:05:26.948803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:26.948803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': '6df9a73b-9aa3-4938-bb4a-062ef29f6700'} Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:05:26.950585 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:26.953165 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:26.955883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-86d5da09-0ffc-487b-94ac-52b7f1762e4a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Returning 404 to user: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:05:26.955883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-86d5da09-0ffc-487b-94ac-52b7f1762e4a tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 404 len: 111 microversion: 2.1 time: 0.037069 Aug 01 16:05:26.955883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1915/3494] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:26 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:05:26.959235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e9c983bf-1943-4378-a459-268639516b0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '.version_select at 0x7feb15f50dc0>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:26.981815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e9c983bf-1943-4378-a459-268639516b0b tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411324224" status: 202 len: 0 microversion: 2.1 time: 0.028525 Aug 01 16:05:26.982396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1580/3495] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 1 16:05:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411324224 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:05:27.165801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9c307128-a7af-4f34-b4c9-b09ab5e110e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:27.166848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9c307128-a7af-4f34-b4c9-b09ab5e110e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:27.197279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c307128-a7af-4f34-b4c9-b09ab5e110e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:27.197768 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c307128-a7af-4f34-b4c9-b09ab5e110e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:27.198600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c307128-a7af-4f34-b4c9-b09ab5e110e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:27.199053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9c307128-a7af-4f34-b4c9-b09ab5e110e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:27.241508 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9c307128-a7af-4f34-b4c9-b09ab5e110e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:05:27.368863 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9c307128-a7af-4f34-b4c9-b09ab5e110e6 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 204 len: 0 microversion: 2.1 time: 0.222371 Aug 01 16:05:27.369545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1916/3496] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:05:27 2022] DELETE /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:05:27.379192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a873384d-9796-4866-a084-9022998954f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:27.380111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a873384d-9796-4866-a084-9022998954f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:27.387867 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a873384d-9796-4866-a084-9022998954f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:27.388308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a873384d-9796-4866-a084-9022998954f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:27.389467 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a873384d-9796-4866-a084-9022998954f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:27.390386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a873384d-9796-4866-a084-9022998954f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:27.553988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a873384d-9796-4866-a084-9022998954f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:27.562724 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a873384d-9796-4866-a084-9022998954f1 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 200 len: 1683 microversion: 2.1 time: 0.187775 Aug 01 16:05:27.563317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1581/3497] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:27 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:28.255758 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f9ab565b-41c1-4f0d-bd48-c1b5e6508c23 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:28.256371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f9ab565b-41c1-4f0d-bd48-c1b5e6508c23 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:28.263626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9ab565b-41c1-4f0d-bd48-c1b5e6508c23 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:28.264071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9ab565b-41c1-4f0d-bd48-c1b5e6508c23 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:28.264857 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9ab565b-41c1-4f0d-bd48-c1b5e6508c23 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:28.265293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f9ab565b-41c1-4f0d-bd48-c1b5e6508c23 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:28.281325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-f9ab565b-41c1-4f0d-bd48-c1b5e6508c23 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] HTTP exception thrown: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f9ab565b-41c1-4f0d-bd48-c1b5e6508c23 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Request method failure captured: Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: DELETE /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 HTTP/1.1 Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_Jmlx2vnbnk0lKcbsy2AYy6I3lUTNvEhfM6QYvHnZh-_L4BGrhaLr2tVolhdM-UX8a6JlIclFzId09LJO9KJpeB2EOmZa72L55dENxljRav7mPMz0SFwre86rMW5QruOjTZB_gqp0d2PT15Byz-h9VgrDrBvw_ypL7uzZPgi6BxoQc Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 85354737a87146729a06bf22ddb3fefc Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:05:28.284347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:05:28.286124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/85354737a87146729a06bf22ddb3fefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/85354737a87146729a06bf22ddb3fefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_85354737a87146729a06bf22ddb3fefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/85354737a87146729a06bf22ddb3fefc"}]}] Aug 01 16:05:28.286124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:05:28.286124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 85354737a87146729a06bf22ddb3fefc Aug 01 16:05:28.286124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:05:28.286124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-AttachVolumeTestJSON-2001489868-project Aug 01 16:05:28.286124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:05:28.286124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:05:28.286124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: ba149d1623e849328e399d6dbdca3e0c Aug 01 16:05:28.286124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-AttachVolumeTestJSON-2001489868-project Aug 01 16:05:28.286124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 16:05:28.286124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:28.286124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': '6df9a73b-9aa3-4938-bb4a-062ef29f6700'} Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:05:28.286969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:28.288474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:28.290865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f9ab565b-41c1-4f0d-bd48-c1b5e6508c23 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Returning 404 to user: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:05:28.290865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f9ab565b-41c1-4f0d-bd48-c1b5e6508c23 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 404 len: 111 microversion: 2.1 time: 0.033491 Aug 01 16:05:28.290865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1917/3498] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:05:28 2022] DELETE /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:05:28.301587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b0ac0a33-9ad9-42fe-832c-18f045908223 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:28.303180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b0ac0a33-9ad9-42fe-832c-18f045908223 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: 6df9a73b-9aa3-4938-bb4a-062ef29f6700] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:28.310506 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0ac0a33-9ad9-42fe-832c-18f045908223 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:28.310954 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0ac0a33-9ad9-42fe-832c-18f045908223 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:28.311810 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0ac0a33-9ad9-42fe-832c-18f045908223 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:28.312174 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b0ac0a33-9ad9-42fe-832c-18f045908223 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:28.327958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-b0ac0a33-9ad9-42fe-832c-18f045908223 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] HTTP exception thrown: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b0ac0a33-9ad9-42fe-832c-18f045908223 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Request method failure captured: Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 HTTP/1.1 Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_Jmlx2vnbnk0lKcbsy2AYy6I3lUTNvEhfM6QYvHnZh-_L4BGrhaLr2tVolhdM-UX8a6JlIclFzId09LJO9KJpeB2EOmZa72L55dENxljRav7mPMz0SFwre86rMW5QruOjTZB_gqp0d2PT15Byz-h9VgrDrBvw_ypL7uzZPgi6BxoQc Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 85354737a87146729a06bf22ddb3fefc Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:05:28.329668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:05:28.331603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/85354737a87146729a06bf22ddb3fefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/85354737a87146729a06bf22ddb3fefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_85354737a87146729a06bf22ddb3fefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/85354737a87146729a06bf22ddb3fefc"}]}] Aug 01 16:05:28.331603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:05:28.331603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 85354737a87146729a06bf22ddb3fefc Aug 01 16:05:28.331603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:05:28.331603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeTestJSON-2001489868-project Aug 01 16:05:28.331603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:05:28.331603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:05:28.331603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: ba149d1623e849328e399d6dbdca3e0c Aug 01 16:05:28.331603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeTestJSON-2001489868-project Aug 01 16:05:28.331603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:05:28.331603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:28.331603 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '6df9a73b-9aa3-4938-bb4a-062ef29f6700'} Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:05:28.332746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. Aug 01 16:05:28.334468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:05:28.336157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b0ac0a33-9ad9-42fe-832c-18f045908223 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Returning 404 to user: Instance 6df9a73b-9aa3-4938-bb4a-062ef29f6700 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:05:28.336157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b0ac0a33-9ad9-42fe-832c-18f045908223 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700" status: 404 len: 111 microversion: 2.1 time: 0.038683 Aug 01 16:05:28.336157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1582/3499] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:28 2022] GET /compute/v2.1/servers/6df9a73b-9aa3-4938-bb4a-062ef29f6700 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:05:28.584943 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-70d2925d-ba66-47b5-8015-5d2e73d87d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:28.585617 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-70d2925d-ba66-47b5-8015-5d2e73d87d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:28.592125 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70d2925d-ba66-47b5-8015-5d2e73d87d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:28.592574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70d2925d-ba66-47b5-8015-5d2e73d87d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:28.593374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70d2925d-ba66-47b5-8015-5d2e73d87d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:28.593806 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-70d2925d-ba66-47b5-8015-5d2e73d87d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:28.664238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-70d2925d-ba66-47b5-8015-5d2e73d87d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:28.672428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-70d2925d-ba66-47b5-8015-5d2e73d87d4f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 200 len: 1616 microversion: 2.1 time: 0.091516 Aug 01 16:05:28.673010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1918/3500] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:28 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 1616 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:28.853712 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-79519b8a-d890-4b4c-840a-23cdede787b7 req-6cb82eb2-b81a-46e6-be56-253ca83a69b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e9f2d5-3104-4eec-aa3b-2fc8e8956479", "name": "network-vif-deleted", "tag": "f4b3e301-08cd-454d-92ff-e609d0607ab8"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:05:28.868607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-79519b8a-d890-4b4c-840a-23cdede787b7 req-6cb82eb2-b81a-46e6-be56-253ca83a69b6 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:28.869360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-79519b8a-d890-4b4c-840a-23cdede787b7 req-6cb82eb2-b81a-46e6-be56-253ca83a69b6 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:28.884801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-79519b8a-d890-4b4c-840a-23cdede787b7 req-6cb82eb2-b81a-46e6-be56-253ca83a69b6 service nova] Creating event network-vif-deleted:f4b3e301-08cd-454d-92ff-e609d0607ab8 for instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 on hv-cinder-84753 Aug 01 16:05:28.905207 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-79519b8a-d890-4b4c-840a-23cdede787b7 req-6cb82eb2-b81a-46e6-be56-253ca83a69b6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055363 Aug 01 16:05:28.909546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1583/3501] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:05:29.697822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ed6b7f0b-2ab7-4d5a-8165-ff53e8bfac7c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:29.698651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ed6b7f0b-2ab7-4d5a-8165-ff53e8bfac7c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:29.705514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed6b7f0b-2ab7-4d5a-8165-ff53e8bfac7c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:29.706475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed6b7f0b-2ab7-4d5a-8165-ff53e8bfac7c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:29.707250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed6b7f0b-2ab7-4d5a-8165-ff53e8bfac7c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:29.707682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ed6b7f0b-2ab7-4d5a-8165-ff53e8bfac7c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:29.727520 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-ed6b7f0b-2ab7-4d5a-8165-ff53e8bfac7c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] HTTP exception thrown: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ed6b7f0b-2ab7-4d5a-8165-ff53e8bfac7c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Request method failure captured: Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 HTTP/1.1 Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_Jxd-2ufNMN6bINeUmVCl_C9neMK8VdVzqFhqxrGaNIW-B6K_BKgRY4QYs-OcVvyfk27GiPKwGgK9Vq2wAaDj7GUJJEXHP3a9XGW-l3GNaaACveTa98UrKY44ovMddLQPKJR39OU0WJEqLcH2PIF975xCsK1INaNMVRtS4ciRy7eWQ Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:05:29.729247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:05:29.730909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}] Aug 01 16:05:29.730909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:05:29.730909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:05:29.730909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:05:29.730909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:05:29.730909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:05:29.730909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:05:29.730909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: 4001e8ec57b34f57aae1654fad9217f8 Aug 01 16:05:29.730909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:05:29.730909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 16:05:29.730909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:05:29.730909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': 'c6e9f2d5-3104-4eec-aa3b-2fc8e8956479'} Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:05:29.731902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:05:29.733805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:05:29.735513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ed6b7f0b-2ab7-4d5a-8165-ff53e8bfac7c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Returning 404 to user: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:05:29.735513 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ed6b7f0b-2ab7-4d5a-8165-ff53e8bfac7c tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 404 len: 111 microversion: 2.1 time: 0.039298 Aug 01 16:05:29.735687 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1919/3502] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:29 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:05:29.740971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9d7952a2-0d6c-443f-9402-77a210cd19ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '.version_select at 0x7feb15f8f430>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:29.763488 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9d7952a2-0d6c-443f-9402-77a210cd19ff tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145842920" status: 202 len: 0 microversion: 2.1 time: 0.026387 Aug 01 16:05:29.763997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1584/3503] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 1 16:05:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145842920 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:05:30.449190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fd2e4e4f-3ad1-491e-b45d-af44097ff197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Action: 'create', calling method: .version_select at 0x7feb1699c9d0>, body: {"keypair": {"name": "tempest-keypair-1078147460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpW4nFePAr5QPH4+dVipAn3o2Dpj9Hjzk/Y5q3ESN4nf7INCvmmr0TmgeVykWqyEXDkLB8ZI//WCScfgZqoGg3psFsYdZjrp8olZVMFWw96YNV4FW8S0g60rK0ic/jyEA=="}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:05:30.464856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-fd2e4e4f-3ad1-491e-b45d-af44097ff197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'key_pairs'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:05:30.468856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-fd2e4e4f-3ad1-491e-b45d-af44097ff197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for user 4001e8ec57b34f57aae1654fad9217f8 and project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'key_pairs'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:05:30.493414 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fd2e4e4f-3ad1-491e-b45d-af44097ff197 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048115 Aug 01 16:05:30.494032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1920/3504] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 1 16:05:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:05:31.849292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-170218400", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f1bed6a-c264-454e-855c-f998e359854d"}], "security_groups": [{"name": "tempest-securitygroup--249015969"}], "key_name": "tempest-keypair-1078147460", "user_data": "}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:05:31.960077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.network.neutron [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] validate_networks() for [('2f1bed6a-c264-454e-855c-f998e359854d', None, None, None, None, None)] {{(pid=124527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:05:32.427872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Flavor limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:05:32.428324 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Image limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:05:32.428807 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Flavor pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:05:32.429217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Image pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:05:32.429630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:05:32.439193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:32.439630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:32.440456 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:32.440887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:32.459719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:05:32.464122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Getting quotas for user 4001e8ec57b34f57aae1654fad9217f8 and project 7ded351d7a1b4a9c8bd4901f8becfe5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:05:32.476528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Going to run 1 instances... {{(pid=124527) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:05:32.479127 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:05:32.529878 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-00c25607-2e47-4b5b-91f9-c7a1e5b9609b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.685645 Aug 01 16:05:32.530672 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1585/3505] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 16:05:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:05:32.546477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b8defbb3-a112-42fe-a3da-430797d0ae61 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:32.547571 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b8defbb3-a112-42fe-a3da-430797d0ae61 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:32.615065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b8defbb3-a112-42fe-a3da-430797d0ae61 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:32.622142 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b8defbb3-a112-42fe-a3da-430797d0ae61 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1241 microversion: 2.1 time: 0.083255 Aug 01 16:05:32.622925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1921/3506] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:32 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:33.644222 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1404e896-ac50-42f9-a8c7-db4850f63ebe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:33.644860 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1404e896-ac50-42f9-a8c7-db4850f63ebe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:33.698997 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1404e896-ac50-42f9-a8c7-db4850f63ebe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:33.708553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1404e896-ac50-42f9-a8c7-db4850f63ebe tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1241 microversion: 2.1 time: 0.066499 Aug 01 16:05:33.708553 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1586/3507] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:33 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:34.727883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b1240ba3-ad05-4b7d-86ff-ff18c2f73ccb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:34.728499 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b1240ba3-ad05-4b7d-86ff-ff18c2f73ccb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:34.790184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b1240ba3-ad05-4b7d-86ff-ff18c2f73ccb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:34.797557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b1240ba3-ad05-4b7d-86ff-ff18c2f73ccb tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1241 microversion: 2.1 time: 0.073587 Aug 01 16:05:34.798175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1922/3508] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:34 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:35.819152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b92c7ce9-ae3a-4250-951e-0845c6b8ab8a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:35.819765 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b92c7ce9-ae3a-4250-951e-0845c6b8ab8a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:35.828062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b92c7ce9-ae3a-4250-951e-0845c6b8ab8a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:35.828513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b92c7ce9-ae3a-4250-951e-0845c6b8ab8a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:35.829298 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b92c7ce9-ae3a-4250-951e-0845c6b8ab8a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:35.829741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b92c7ce9-ae3a-4250-951e-0845c6b8ab8a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:35.899470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b92c7ce9-ae3a-4250-951e-0845c6b8ab8a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:35.905293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b92c7ce9-ae3a-4250-951e-0845c6b8ab8a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1299 microversion: 2.1 time: 0.089902 Aug 01 16:05:35.906173 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1587/3509] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:35 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:36.927778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d9a04f18-943a-4e3f-9dc5-7db56639c263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:36.928402 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d9a04f18-943a-4e3f-9dc5-7db56639c263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:36.936823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9a04f18-943a-4e3f-9dc5-7db56639c263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:36.937282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9a04f18-943a-4e3f-9dc5-7db56639c263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:36.938105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9a04f18-943a-4e3f-9dc5-7db56639c263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:36.938549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d9a04f18-943a-4e3f-9dc5-7db56639c263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:37.086889 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-6f71f8b8-3f8e-44e7-b6e4-750c83f806ba req-3fb34349-9e8d-425d-b49a-b68bdefbf63d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f59913-97bf-4550-8a49-796d9a381302", "tag": "d1c45a68-562e-46f5-8277-05f900acb7ef"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:05:37.100501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d9a04f18-943a-4e3f-9dc5-7db56639c263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:37.105838 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-6f71f8b8-3f8e-44e7-b6e4-750c83f806ba req-3fb34349-9e8d-425d-b49a-b68bdefbf63d service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:37.106336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-6f71f8b8-3f8e-44e7-b6e4-750c83f806ba req-3fb34349-9e8d-425d-b49a-b68bdefbf63d service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:37.118655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d9a04f18-943a-4e3f-9dc5-7db56639c263 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1366 microversion: 2.1 time: 0.194632 Aug 01 16:05:37.119939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1923/3510] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:36 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:37.121179 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-6f71f8b8-3f8e-44e7-b6e4-750c83f806ba req-3fb34349-9e8d-425d-b49a-b68bdefbf63d service nova] Creating event network-changed:d1c45a68-562e-46f5-8277-05f900acb7ef for instance 44f59913-97bf-4550-8a49-796d9a381302 on hv-cinder-84753 Aug 01 16:05:37.126536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-6f71f8b8-3f8e-44e7-b6e4-750c83f806ba req-3fb34349-9e8d-425d-b49a-b68bdefbf63d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050481 Aug 01 16:05:37.128971 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1588/3511] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:05:38.148715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-030a3756-af67-4dcc-a854-74102411499b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:38.149317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-030a3756-af67-4dcc-a854-74102411499b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:38.156105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-030a3756-af67-4dcc-a854-74102411499b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:38.156850 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-030a3756-af67-4dcc-a854-74102411499b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:38.157262 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-030a3756-af67-4dcc-a854-74102411499b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:38.157722 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-030a3756-af67-4dcc-a854-74102411499b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:38.300730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-030a3756-af67-4dcc-a854-74102411499b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:38.309242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-030a3756-af67-4dcc-a854-74102411499b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1366 microversion: 2.1 time: 0.165612 Aug 01 16:05:38.309738 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1924/3512] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:38 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:39.332847 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7fc5a8c5-49d0-41b2-8416-404aa605cba9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:39.333711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7fc5a8c5-49d0-41b2-8416-404aa605cba9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:39.340532 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7fc5a8c5-49d0-41b2-8416-404aa605cba9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:39.340973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7fc5a8c5-49d0-41b2-8416-404aa605cba9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:39.341773 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7fc5a8c5-49d0-41b2-8416-404aa605cba9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:39.342238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7fc5a8c5-49d0-41b2-8416-404aa605cba9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:39.498402 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7fc5a8c5-49d0-41b2-8416-404aa605cba9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:39.506752 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7fc5a8c5-49d0-41b2-8416-404aa605cba9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1366 microversion: 2.1 time: 0.179142 Aug 01 16:05:39.507358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1589/3513] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:39 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:40.540666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1d45fcde-b567-4e7d-b901-63747dcfa87b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:40.541275 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1d45fcde-b567-4e7d-b901-63747dcfa87b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:40.547923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1d45fcde-b567-4e7d-b901-63747dcfa87b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:40.548381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1d45fcde-b567-4e7d-b901-63747dcfa87b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:40.549187 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1d45fcde-b567-4e7d-b901-63747dcfa87b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:40.550340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1d45fcde-b567-4e7d-b901-63747dcfa87b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:40.682922 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1d45fcde-b567-4e7d-b901-63747dcfa87b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:40.690371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1d45fcde-b567-4e7d-b901-63747dcfa87b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1366 microversion: 2.1 time: 0.153507 Aug 01 16:05:40.691080 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1925/3514] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:40 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:41.716355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-536a33e3-5f14-4296-9f4d-e557fd923c5f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:41.717478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-536a33e3-5f14-4296-9f4d-e557fd923c5f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:41.728116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-536a33e3-5f14-4296-9f4d-e557fd923c5f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:41.728570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-536a33e3-5f14-4296-9f4d-e557fd923c5f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:41.729410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-536a33e3-5f14-4296-9f4d-e557fd923c5f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:41.729846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-536a33e3-5f14-4296-9f4d-e557fd923c5f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:41.909392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-536a33e3-5f14-4296-9f4d-e557fd923c5f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:41.918497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-536a33e3-5f14-4296-9f4d-e557fd923c5f tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1366 microversion: 2.1 time: 0.209346 Aug 01 16:05:41.919094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1590/3515] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:41 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:42.072260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-e0a0ba06-a946-425b-bf53-0265fc568770 req-cfd7d765-c918-4613-81ca-cb62a1e10df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f59913-97bf-4550-8a49-796d9a381302", "name": "network-vif-plugged", "status": "completed", "tag": "d1c45a68-562e-46f5-8277-05f900acb7ef"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:05:42.090990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-e0a0ba06-a946-425b-bf53-0265fc568770 req-cfd7d765-c918-4613-81ca-cb62a1e10df4 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:42.091896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-e0a0ba06-a946-425b-bf53-0265fc568770 req-cfd7d765-c918-4613-81ca-cb62a1e10df4 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:42.115750 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-e0a0ba06-a946-425b-bf53-0265fc568770 req-cfd7d765-c918-4613-81ca-cb62a1e10df4 service nova] Creating event network-vif-plugged:d1c45a68-562e-46f5-8277-05f900acb7ef for instance 44f59913-97bf-4550-8a49-796d9a381302 on hv-cinder-84753 Aug 01 16:05:42.121342 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-e0a0ba06-a946-425b-bf53-0265fc568770 req-cfd7d765-c918-4613-81ca-cb62a1e10df4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057133 Aug 01 16:05:42.122124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1926/3516] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:05:42.951349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-257f0b18-8429-47a8-8919-f6897722b2fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:42.951931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-257f0b18-8429-47a8-8919-f6897722b2fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:42.953869 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=2 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:42.960687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-257f0b18-8429-47a8-8919-f6897722b2fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:42.961154 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-257f0b18-8429-47a8-8919-f6897722b2fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:42.961952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-257f0b18-8429-47a8-8919-f6897722b2fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:42.962396 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-257f0b18-8429-47a8-8919-f6897722b2fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:43.107733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-257f0b18-8429-47a8-8919-f6897722b2fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:43.116361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-257f0b18-8429-47a8-8919-f6897722b2fa tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1366 microversion: 2.1 time: 0.168839 Aug 01 16:05:43.117134 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1591/3517] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:42 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:44.140397 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ab01b94a-4610-45f2-b537-a69ac29b2349 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:44.141098 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ab01b94a-4610-45f2-b537-a69ac29b2349 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:44.148027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab01b94a-4610-45f2-b537-a69ac29b2349 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:44.148474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab01b94a-4610-45f2-b537-a69ac29b2349 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:44.149240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab01b94a-4610-45f2-b537-a69ac29b2349 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:44.149673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ab01b94a-4610-45f2-b537-a69ac29b2349 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:44.292205 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ab01b94a-4610-45f2-b537-a69ac29b2349 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:05:44.302013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ab01b94a-4610-45f2-b537-a69ac29b2349 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1556 microversion: 2.1 time: 0.166250 Aug 01 16:05:44.302602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1927/3518] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:05:44 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:05:44.322928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ffd60287-310d-4023-ac55-4800fa26c193 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:05:44.323484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ffd60287-310d-4023-ac55-4800fa26c193 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:05:44.325289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=8 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:44.332246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ffd60287-310d-4023-ac55-4800fa26c193 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:44.332695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ffd60287-310d-4023-ac55-4800fa26c193 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:44.333634 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ffd60287-310d-4023-ac55-4800fa26c193 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:44.333937 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ffd60287-310d-4023-ac55-4800fa26c193 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:44.415197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ffd60287-310d-4023-ac55-4800fa26c193 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096498 Aug 01 16:05:44.415882 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1592/3519] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 1 16:05:44 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:05:45.382991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-13052f81-2b81-4c42-b9fc-0d6d941f860a req-70e7e174-0395-4b60-a2d2-f72e1cd7d759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f59913-97bf-4550-8a49-796d9a381302", "tag": "d1c45a68-562e-46f5-8277-05f900acb7ef"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:05:45.388031 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=8 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:05:45.394958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-13052f81-2b81-4c42-b9fc-0d6d941f860a req-70e7e174-0395-4b60-a2d2-f72e1cd7d759 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:05:45.395492 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-13052f81-2b81-4c42-b9fc-0d6d941f860a req-70e7e174-0395-4b60-a2d2-f72e1cd7d759 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:05:45.406862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-13052f81-2b81-4c42-b9fc-0d6d941f860a req-70e7e174-0395-4b60-a2d2-f72e1cd7d759 service nova] Creating event network-changed:d1c45a68-562e-46f5-8277-05f900acb7ef for instance 44f59913-97bf-4550-8a49-796d9a381302 on hv-cinder-84753 Aug 01 16:05:45.412514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-13052f81-2b81-4c42-b9fc-0d6d941f860a req-70e7e174-0395-4b60-a2d2-f72e1cd7d759 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033417 Aug 01 16:05:45.413208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1928/3520] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:06:21.412823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:21.414391 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:06:21.418988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-308335bb-ef88-4982-abd4-8969717950cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:06:21.419506 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-308335bb-ef88-4982-abd4-8969717950cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:06:21.428393 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-308335bb-ef88-4982-abd4-8969717950cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:06:21.428910 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-308335bb-ef88-4982-abd4-8969717950cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:06:21.429732 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-308335bb-ef88-4982-abd4-8969717950cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:06:21.430202 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-308335bb-ef88-4982-abd4-8969717950cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:06:21.473552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-308335bb-ef88-4982-abd4-8969717950cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302/ips" status: 200 len: 149 microversion: 2.1 time: 0.062500 Aug 01 16:06:21.474545 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1593/3521] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 1 16:06:21 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302/ips => generated 149 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:07:21.545475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR oslo.messaging._drivers.impl_rabbit [-] [893acd05-9420-4cd5-b518-8f2b33be6b98] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 16:07:21.546253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:21.546856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:21.551737 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-be1bc1e7-ee1a-482f-aece-bb5b7cede6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:21.552357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-be1bc1e7-ee1a-482f-aece-bb5b7cede6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:21.561289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be1bc1e7-ee1a-482f-aece-bb5b7cede6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:21.561733 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be1bc1e7-ee1a-482f-aece-bb5b7cede6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:21.562544 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be1bc1e7-ee1a-482f-aece-bb5b7cede6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:21.562974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-be1bc1e7-ee1a-482f-aece-bb5b7cede6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:21.594953 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-be1bc1e7-ee1a-482f-aece-bb5b7cede6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:07:21.678541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-be1bc1e7-ee1a-482f-aece-bb5b7cede6d5 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 204 len: 0 microversion: 2.1 time: 0.134623 Aug 01 16:07:21.679258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1929/3522] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:07:21 2022] DELETE /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:07:21.686232 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=4 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:21.687038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=2 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:21.693844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-abf7f2c5-6ef6-4b6f-837d-1dfc3f0ddb65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:21.694621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-abf7f2c5-6ef6-4b6f-837d-1dfc3f0ddb65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:21.701817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-abf7f2c5-6ef6-4b6f-837d-1dfc3f0ddb65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:21.702309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-abf7f2c5-6ef6-4b6f-837d-1dfc3f0ddb65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:21.703085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-abf7f2c5-6ef6-4b6f-837d-1dfc3f0ddb65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:21.703521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-abf7f2c5-6ef6-4b6f-837d-1dfc3f0ddb65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:21.874210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-abf7f2c5-6ef6-4b6f-837d-1dfc3f0ddb65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:21.882655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-abf7f2c5-6ef6-4b6f-837d-1dfc3f0ddb65 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1680 microversion: 2.1 time: 0.198742 Aug 01 16:07:21.883238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1594/3523] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:07:21 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:07:22.911552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-6c7cbc67-9936-47e5-8176-fe06f33c7ee8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:22.912164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-6c7cbc67-9936-47e5-8176-fe06f33c7ee8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:22.920601 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c7cbc67-9936-47e5-8176-fe06f33c7ee8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:22.921168 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c7cbc67-9936-47e5-8176-fe06f33c7ee8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:22.921837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c7cbc67-9936-47e5-8176-fe06f33c7ee8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:22.922864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-6c7cbc67-9936-47e5-8176-fe06f33c7ee8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:22.932135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] [893acd05-9420-4cd5-b518-8f2b33be6b98] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 35788. Aug 01 16:07:23.068741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-6c7cbc67-9936-47e5-8176-fe06f33c7ee8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:23.081868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-6c7cbc67-9936-47e5-8176-fe06f33c7ee8 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1680 microversion: 2.1 time: 0.178825 Aug 01 16:07:23.083120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1930/3524] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:07:22 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:07:24.057719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-6f438222-db4b-4afe-9d04-1c6177f2b019 req-d3cf2091-7203-49b6-85fd-6f3bbd56c9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f59913-97bf-4550-8a49-796d9a381302", "name": "network-vif-deleted", "tag": "d1c45a68-562e-46f5-8277-05f900acb7ef"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:07:24.070382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-6f438222-db4b-4afe-9d04-1c6177f2b019 req-d3cf2091-7203-49b6-85fd-6f3bbd56c9c7 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:24.070959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-6f438222-db4b-4afe-9d04-1c6177f2b019 req-d3cf2091-7203-49b6-85fd-6f3bbd56c9c7 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:24.084696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-6f438222-db4b-4afe-9d04-1c6177f2b019 req-d3cf2091-7203-49b6-85fd-6f3bbd56c9c7 service nova] Creating event network-vif-deleted:d1c45a68-562e-46f5-8277-05f900acb7ef for instance 44f59913-97bf-4550-8a49-796d9a381302 on hv-cinder-84753 Aug 01 16:07:24.091108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-6f438222-db4b-4afe-9d04-1c6177f2b019 req-d3cf2091-7203-49b6-85fd-6f3bbd56c9c7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039573 Aug 01 16:07:24.092698 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1595/3525] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:07:24.105097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e8db89f3-1bb6-4409-87b7-1e3a3da70ed9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:24.105757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e8db89f3-1bb6-4409-87b7-1e3a3da70ed9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:24.120088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8db89f3-1bb6-4409-87b7-1e3a3da70ed9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:24.125388 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8db89f3-1bb6-4409-87b7-1e3a3da70ed9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:24.128370 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8db89f3-1bb6-4409-87b7-1e3a3da70ed9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:24.129184 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e8db89f3-1bb6-4409-87b7-1e3a3da70ed9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:24.214192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e8db89f3-1bb6-4409-87b7-1e3a3da70ed9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4001e8ec57b34f57aae1654fad9217f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded351d7a1b4a9c8bd4901f8becfe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:24.227456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e8db89f3-1bb6-4409-87b7-1e3a3da70ed9 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 200 len: 1326 microversion: 2.1 time: 0.126815 Aug 01 16:07:24.230285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1931/3526] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:07:24 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 1326 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:07:25.251025 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a3e71099-81be-40f6-b4eb-fc397c49dda3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:25.252276 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a3e71099-81be-40f6-b4eb-fc397c49dda3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:25.258759 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a3e71099-81be-40f6-b4eb-fc397c49dda3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:25.259209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a3e71099-81be-40f6-b4eb-fc397c49dda3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:25.259994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a3e71099-81be-40f6-b4eb-fc397c49dda3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:25.260457 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a3e71099-81be-40f6-b4eb-fc397c49dda3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:25.275549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-a3e71099-81be-40f6-b4eb-fc397c49dda3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] HTTP exception thrown: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a3e71099-81be-40f6-b4eb-fc397c49dda3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Request method failure captured: Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 HTTP/1.1 Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_Jxd-2ufNMN6bINeUmVCl_C9neMK8VdVzqFhqxrGaNIW-B6K_BKgRY4QYs-OcVvyfk27GiPKwGgK9Vq2wAaDj7GUJJEXHP3a9XGW-l3GNaaACveTa98UrKY44ovMddLQPKJR39OU0WJEqLcH2PIF975xCsK1INaNMVRtS4ciRy7eWQ Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:07:25.277217 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:07:25.279230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}] Aug 01 16:07:25.279230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:07:25.279230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:07:25.279230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:07:25.279230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:07:25.279230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:07:25.279230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:07:25.279230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 4001e8ec57b34f57aae1654fad9217f8 Aug 01 16:07:25.279230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:07:25.279230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:07:25.279230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:25.279230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '44f59913-97bf-4550-8a49-796d9a381302'} Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:07:25.280315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:25.282100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:07:25.285186 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a3e71099-81be-40f6-b4eb-fc397c49dda3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Returning 404 to user: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:07:25.286099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a3e71099-81be-40f6-b4eb-fc397c49dda3 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 404 len: 111 microversion: 2.1 time: 0.041500 Aug 01 16:07:25.286664 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1596/3527] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:07:25 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:07:25.295173 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b0b92166-43bc-4400-9a70-4188721b510b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '.version_select at 0x7feb1a9179d0>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:25.319181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b0b92166-43bc-4400-9a70-4188721b510b tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078147460" status: 202 len: 0 microversion: 2.1 time: 0.027741 Aug 01 16:07:25.319877 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1932/3528] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 1 16:07:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078147460 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:07:26.224164 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c0b81c2c-098f-4893-8dec-e0b8e0a0eb23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:26.224709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c0b81c2c-098f-4893-8dec-e0b8e0a0eb23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:26.230963 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0b81c2c-098f-4893-8dec-e0b8e0a0eb23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:26.231411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0b81c2c-098f-4893-8dec-e0b8e0a0eb23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:26.232170 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0b81c2c-098f-4893-8dec-e0b8e0a0eb23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:26.232606 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c0b81c2c-098f-4893-8dec-e0b8e0a0eb23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:26.247202 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-c0b81c2c-098f-4893-8dec-e0b8e0a0eb23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] HTTP exception thrown: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c0b81c2c-098f-4893-8dec-e0b8e0a0eb23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Request method failure captured: Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: DELETE /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 HTTP/1.1 Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_Jxd-2ufNMN6bINeUmVCl_C9neMK8VdVzqFhqxrGaNIW-B6K_BKgRY4QYs-OcVvyfk27GiPKwGgK9Vq2wAaDj7GUJJEXHP3a9XGW-l3GNaaACveTa98UrKY44ovMddLQPKJR39OU0WJEqLcH2PIF975xCsK1INaNMVRtS4ciRy7eWQ Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:07:26.248783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:07:26.250590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}] Aug 01 16:07:26.250590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:07:26.250590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:07:26.250590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:07:26.250590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:07:26.250590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:07:26.250590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:07:26.250590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 4001e8ec57b34f57aae1654fad9217f8 Aug 01 16:07:26.250590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:07:26.250590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:07:26.250590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:26.250590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '44f59913-97bf-4550-8a49-796d9a381302'} Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:07:26.252675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:26.254369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:07:26.256050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c0b81c2c-098f-4893-8dec-e0b8e0a0eb23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Returning 404 to user: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:07:26.256050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c0b81c2c-098f-4893-8dec-e0b8e0a0eb23 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 404 len: 111 microversion: 2.1 time: 0.030011 Aug 01 16:07:26.256050 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1597/3529] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:07:26 2022] DELETE /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:07:26.256344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:07:26.256645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 16:07:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 (ip 10.222.0.83) !!! Aug 01 16:07:26.260852 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cd1f2d85-3572-42f6-9f9d-51de351352a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:26.262251 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cd1f2d85-3572-42f6-9f9d-51de351352a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 44f59913-97bf-4550-8a49-796d9a381302] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:26.272017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cd1f2d85-3572-42f6-9f9d-51de351352a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:26.272462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cd1f2d85-3572-42f6-9f9d-51de351352a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:26.273233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cd1f2d85-3572-42f6-9f9d-51de351352a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:26.273668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cd1f2d85-3572-42f6-9f9d-51de351352a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:26.286900 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-cd1f2d85-3572-42f6-9f9d-51de351352a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] HTTP exception thrown: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cd1f2d85-3572-42f6-9f9d-51de351352a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Request method failure captured: Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 HTTP/1.1 Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_Jxd-2ufNMN6bINeUmVCl_C9neMK8VdVzqFhqxrGaNIW-B6K_BKgRY4QYs-OcVvyfk27GiPKwGgK9Vq2wAaDj7GUJJEXHP3a9XGW-l3GNaaACveTa98UrKY44ovMddLQPKJR39OU0WJEqLcH2PIF975xCsK1INaNMVRtS4ciRy7eWQ Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:07:26.288579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:07:26.290467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}] Aug 01 16:07:26.290467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:07:26.290467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:07:26.290467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:07:26.290467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:07:26.290467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:07:26.290467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:07:26.290467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: 4001e8ec57b34f57aae1654fad9217f8 Aug 01 16:07:26.290467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:07:26.290467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 16:07:26.290467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:26.290467 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': '44f59913-97bf-4550-8a49-796d9a381302'} Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:07:26.291685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. Aug 01 16:07:26.293487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:07:26.295016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cd1f2d85-3572-42f6-9f9d-51de351352a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Returning 404 to user: Instance 44f59913-97bf-4550-8a49-796d9a381302 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:07:26.295016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cd1f2d85-3572-42f6-9f9d-51de351352a2 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302" status: 404 len: 111 microversion: 2.1 time: 0.033675 Aug 01 16:07:26.295016 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1933/3530] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:07:26 2022] GET /compute/v2.1/servers/44f59913-97bf-4550-8a49-796d9a381302 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:07:27.974549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-73d5c83c-6b38-469d-9253-466b6ae2312e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:27.975701 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-73d5c83c-6b38-469d-9253-466b6ae2312e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:27.983500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73d5c83c-6b38-469d-9253-466b6ae2312e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:27.984531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73d5c83c-6b38-469d-9253-466b6ae2312e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:27.985969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73d5c83c-6b38-469d-9253-466b6ae2312e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:27.987240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-73d5c83c-6b38-469d-9253-466b6ae2312e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:28.018312 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-73d5c83c-6b38-469d-9253-466b6ae2312e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Going to try to terminate instance {{(pid=124527) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:07:28.082219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.compute.api [None req-73d5c83c-6b38-469d-9253-466b6ae2312e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Instance is already in deleting state, ignoring this request Aug 01 16:07:28.083051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-73d5c83c-6b38-469d-9253-466b6ae2312e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 204 len: 0 microversion: 2.20 time: 0.112871 Aug 01 16:07:28.083623 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1598/3531] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 1 16:07:27 2022] DELETE /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 16:07:28.091895 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9a229f1a-0650-4301-9ac2-aadc738c7a19 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:28.092557 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-9a229f1a-0650-4301-9ac2-aadc738c7a19 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:28.099954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a229f1a-0650-4301-9ac2-aadc738c7a19 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:28.100410 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a229f1a-0650-4301-9ac2-aadc738c7a19 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:28.101190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a229f1a-0650-4301-9ac2-aadc738c7a19 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:28.101627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-9a229f1a-0650-4301-9ac2-aadc738c7a19 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:28.234649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9a229f1a-0650-4301-9ac2-aadc738c7a19 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:28.244276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9a229f1a-0650-4301-9ac2-aadc738c7a19 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:28.245780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-9a229f1a-0650-4301-9ac2-aadc738c7a19 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:28.246978 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9a229f1a-0650-4301-9ac2-aadc738c7a19 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.159035 Aug 01 16:07:28.247540 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1934/3532] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:29.269863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-cfc62d8d-0c4e-47ab-b4e6-6e1a8481863d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:29.270501 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-cfc62d8d-0c4e-47ab-b4e6-6e1a8481863d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:29.277513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cfc62d8d-0c4e-47ab-b4e6-6e1a8481863d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:29.277993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cfc62d8d-0c4e-47ab-b4e6-6e1a8481863d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:29.278761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cfc62d8d-0c4e-47ab-b4e6-6e1a8481863d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:29.279196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-cfc62d8d-0c4e-47ab-b4e6-6e1a8481863d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:29.418579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cfc62d8d-0c4e-47ab-b4e6-6e1a8481863d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:29.428238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cfc62d8d-0c4e-47ab-b4e6-6e1a8481863d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:29.429741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-cfc62d8d-0c4e-47ab-b4e6-6e1a8481863d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:29.430947 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-cfc62d8d-0c4e-47ab-b4e6-6e1a8481863d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.164999 Aug 01 16:07:29.431509 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1599/3533] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:29 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:30.454392 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-602f15d8-e49d-458b-b3f0-17971b973394 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:30.455691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-602f15d8-e49d-458b-b3f0-17971b973394 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:30.462252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-602f15d8-e49d-458b-b3f0-17971b973394 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:30.462698 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-602f15d8-e49d-458b-b3f0-17971b973394 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:30.463456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-602f15d8-e49d-458b-b3f0-17971b973394 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:30.463886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-602f15d8-e49d-458b-b3f0-17971b973394 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:30.599770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-602f15d8-e49d-458b-b3f0-17971b973394 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:30.608459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-602f15d8-e49d-458b-b3f0-17971b973394 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:30.610005 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-602f15d8-e49d-458b-b3f0-17971b973394 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:30.611472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-602f15d8-e49d-458b-b3f0-17971b973394 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.161031 Aug 01 16:07:30.612035 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1935/3534] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:31.635120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8bceb5f0-1f30-490a-8625-ae199e63ed0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:31.635746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8bceb5f0-1f30-490a-8625-ae199e63ed0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:31.642311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8bceb5f0-1f30-490a-8625-ae199e63ed0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:31.642754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8bceb5f0-1f30-490a-8625-ae199e63ed0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:31.643515 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8bceb5f0-1f30-490a-8625-ae199e63ed0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:31.643946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8bceb5f0-1f30-490a-8625-ae199e63ed0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:31.782679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8bceb5f0-1f30-490a-8625-ae199e63ed0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:31.793970 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8bceb5f0-1f30-490a-8625-ae199e63ed0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:31.795474 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8bceb5f0-1f30-490a-8625-ae199e63ed0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:31.796637 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8bceb5f0-1f30-490a-8625-ae199e63ed0c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.165776 Aug 01 16:07:31.797206 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1600/3535] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:07:32.823518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3d5befd9-9d20-44a4-804a-a3be1e282fd1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:32.824530 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3d5befd9-9d20-44a4-804a-a3be1e282fd1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:32.832775 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d5befd9-9d20-44a4-804a-a3be1e282fd1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:32.833217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d5befd9-9d20-44a4-804a-a3be1e282fd1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:32.834580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d5befd9-9d20-44a4-804a-a3be1e282fd1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:32.835552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d5befd9-9d20-44a4-804a-a3be1e282fd1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:32.967062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3d5befd9-9d20-44a4-804a-a3be1e282fd1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:32.975662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3d5befd9-9d20-44a4-804a-a3be1e282fd1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:32.977151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3d5befd9-9d20-44a4-804a-a3be1e282fd1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:32.978341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3d5befd9-9d20-44a4-804a-a3be1e282fd1 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.161920 Aug 01 16:07:32.978888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1936/3536] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:34.002092 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4c09d16b-16ca-427c-8f35-2ddd7c9ac39d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:34.002715 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4c09d16b-16ca-427c-8f35-2ddd7c9ac39d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:34.009480 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c09d16b-16ca-427c-8f35-2ddd7c9ac39d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:34.009969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c09d16b-16ca-427c-8f35-2ddd7c9ac39d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:34.010748 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c09d16b-16ca-427c-8f35-2ddd7c9ac39d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:34.011187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c09d16b-16ca-427c-8f35-2ddd7c9ac39d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:34.163418 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4c09d16b-16ca-427c-8f35-2ddd7c9ac39d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:34.174306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4c09d16b-16ca-427c-8f35-2ddd7c9ac39d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:34.176425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4c09d16b-16ca-427c-8f35-2ddd7c9ac39d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:34.177607 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4c09d16b-16ca-427c-8f35-2ddd7c9ac39d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.179995 Aug 01 16:07:34.178262 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1601/3537] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:35.200796 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ee1a9c48-d394-4832-b9ad-a5ea524d52b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:35.201399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ee1a9c48-d394-4832-b9ad-a5ea524d52b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:35.208662 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee1a9c48-d394-4832-b9ad-a5ea524d52b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:35.209107 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee1a9c48-d394-4832-b9ad-a5ea524d52b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:35.209939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee1a9c48-d394-4832-b9ad-a5ea524d52b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:35.210378 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ee1a9c48-d394-4832-b9ad-a5ea524d52b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:35.348145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ee1a9c48-d394-4832-b9ad-a5ea524d52b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:35.356936 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ee1a9c48-d394-4832-b9ad-a5ea524d52b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:35.358472 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ee1a9c48-d394-4832-b9ad-a5ea524d52b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:35.359649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ee1a9c48-d394-4832-b9ad-a5ea524d52b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.162827 Aug 01 16:07:35.360217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1937/3538] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:35 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:36.382770 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2d7b52f9-950e-4130-840b-0311f78a525e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:36.383440 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2d7b52f9-950e-4130-840b-0311f78a525e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:36.390238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2d7b52f9-950e-4130-840b-0311f78a525e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:36.390691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2d7b52f9-950e-4130-840b-0311f78a525e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:36.391481 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2d7b52f9-950e-4130-840b-0311f78a525e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:36.391904 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2d7b52f9-950e-4130-840b-0311f78a525e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:36.535782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2d7b52f9-950e-4130-840b-0311f78a525e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:36.545181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2d7b52f9-950e-4130-840b-0311f78a525e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:36.548031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2d7b52f9-950e-4130-840b-0311f78a525e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:36.551016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2d7b52f9-950e-4130-840b-0311f78a525e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.171744 Aug 01 16:07:36.552291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1602/3539] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:37.581147 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7d6d6a02-d416-4744-85dd-764f1883ca31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:37.581883 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7d6d6a02-d416-4744-85dd-764f1883ca31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:37.589007 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d6d6a02-d416-4744-85dd-764f1883ca31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:37.589464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d6d6a02-d416-4744-85dd-764f1883ca31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:37.590284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d6d6a02-d416-4744-85dd-764f1883ca31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:37.590724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7d6d6a02-d416-4744-85dd-764f1883ca31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:37.729842 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7d6d6a02-d416-4744-85dd-764f1883ca31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:37.739248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7d6d6a02-d416-4744-85dd-764f1883ca31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:37.740836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-7d6d6a02-d416-4744-85dd-764f1883ca31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:37.742045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7d6d6a02-d416-4744-85dd-764f1883ca31 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.165705 Aug 01 16:07:37.742608 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1938/3540] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:07:38.764958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-88544f0f-42ae-45ae-b541-fc524f9a5f89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:38.765685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-88544f0f-42ae-45ae-b541-fc524f9a5f89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:38.772647 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-88544f0f-42ae-45ae-b541-fc524f9a5f89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:38.773099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-88544f0f-42ae-45ae-b541-fc524f9a5f89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:38.773903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-88544f0f-42ae-45ae-b541-fc524f9a5f89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:38.774355 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-88544f0f-42ae-45ae-b541-fc524f9a5f89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:38.925704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-88544f0f-42ae-45ae-b541-fc524f9a5f89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:38.934781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-88544f0f-42ae-45ae-b541-fc524f9a5f89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:38.936296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-88544f0f-42ae-45ae-b541-fc524f9a5f89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:38.937451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-88544f0f-42ae-45ae-b541-fc524f9a5f89 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.176435 Aug 01 16:07:38.938034 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1603/3541] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:39.960740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4b02bf93-59cb-4b13-9397-cf6c23991c25 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:39.961481 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4b02bf93-59cb-4b13-9397-cf6c23991c25 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:39.968422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b02bf93-59cb-4b13-9397-cf6c23991c25 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:39.968897 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b02bf93-59cb-4b13-9397-cf6c23991c25 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:39.969657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b02bf93-59cb-4b13-9397-cf6c23991c25 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:39.970136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4b02bf93-59cb-4b13-9397-cf6c23991c25 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:40.117711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4b02bf93-59cb-4b13-9397-cf6c23991c25 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:40.127684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4b02bf93-59cb-4b13-9397-cf6c23991c25 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:40.129186 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4b02bf93-59cb-4b13-9397-cf6c23991c25 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:40.130421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4b02bf93-59cb-4b13-9397-cf6c23991c25 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.173665 Aug 01 16:07:40.130996 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1939/3542] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:07:41.153344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-550d29ff-6955-4fe9-a252-e6b317c409c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:41.153988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-550d29ff-6955-4fe9-a252-e6b317c409c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:41.161362 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-550d29ff-6955-4fe9-a252-e6b317c409c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:41.161810 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-550d29ff-6955-4fe9-a252-e6b317c409c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:41.162608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-550d29ff-6955-4fe9-a252-e6b317c409c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:41.163043 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-550d29ff-6955-4fe9-a252-e6b317c409c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:41.301267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-550d29ff-6955-4fe9-a252-e6b317c409c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:41.311103 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-550d29ff-6955-4fe9-a252-e6b317c409c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:41.312505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-550d29ff-6955-4fe9-a252-e6b317c409c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:41.313713 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-550d29ff-6955-4fe9-a252-e6b317c409c4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.164294 Aug 01 16:07:41.314317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1604/3543] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:42.337073 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f79e1a49-7a12-4a32-b938-ce7583dfc625 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:42.337815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f79e1a49-7a12-4a32-b938-ce7583dfc625 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:42.346861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f79e1a49-7a12-4a32-b938-ce7583dfc625 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:42.347454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f79e1a49-7a12-4a32-b938-ce7583dfc625 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:42.348487 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f79e1a49-7a12-4a32-b938-ce7583dfc625 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:42.349088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f79e1a49-7a12-4a32-b938-ce7583dfc625 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:42.496385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f79e1a49-7a12-4a32-b938-ce7583dfc625 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:42.504928 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f79e1a49-7a12-4a32-b938-ce7583dfc625 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:42.506480 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f79e1a49-7a12-4a32-b938-ce7583dfc625 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:42.507643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f79e1a49-7a12-4a32-b938-ce7583dfc625 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.175934 Aug 01 16:07:42.508206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1940/3544] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:42 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:07:43.534124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2c831629-885e-4101-9f80-fa5347d5d80d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:43.534739 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2c831629-885e-4101-9f80-fa5347d5d80d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:43.541527 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2c831629-885e-4101-9f80-fa5347d5d80d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:43.542008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2c831629-885e-4101-9f80-fa5347d5d80d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:43.542775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2c831629-885e-4101-9f80-fa5347d5d80d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:43.543216 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2c831629-885e-4101-9f80-fa5347d5d80d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:43.681445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2c831629-885e-4101-9f80-fa5347d5d80d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:43.690865 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2c831629-885e-4101-9f80-fa5347d5d80d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:43.692335 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2c831629-885e-4101-9f80-fa5347d5d80d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:43.693487 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2c831629-885e-4101-9f80-fa5347d5d80d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.163478 Aug 01 16:07:43.694061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1605/3545] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:44.717556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3f3776cf-2bcc-4fc9-9f63-571efd268d27 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:44.718246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3f3776cf-2bcc-4fc9-9f63-571efd268d27 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:44.725090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f3776cf-2bcc-4fc9-9f63-571efd268d27 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:44.725591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f3776cf-2bcc-4fc9-9f63-571efd268d27 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:44.726479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f3776cf-2bcc-4fc9-9f63-571efd268d27 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:44.726919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f3776cf-2bcc-4fc9-9f63-571efd268d27 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:44.862219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3f3776cf-2bcc-4fc9-9f63-571efd268d27 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:44.871923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3f3776cf-2bcc-4fc9-9f63-571efd268d27 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:44.873443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-3f3776cf-2bcc-4fc9-9f63-571efd268d27 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:44.874646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3f3776cf-2bcc-4fc9-9f63-571efd268d27 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.160995 Aug 01 16:07:44.875215 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1941/3546] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:45.899400 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5d5ef2b8-83f5-44ac-a20d-8cd9f25ab208 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:45.900222 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5d5ef2b8-83f5-44ac-a20d-8cd9f25ab208 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:45.907110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d5ef2b8-83f5-44ac-a20d-8cd9f25ab208 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:45.907561 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d5ef2b8-83f5-44ac-a20d-8cd9f25ab208 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:45.908933 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d5ef2b8-83f5-44ac-a20d-8cd9f25ab208 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:45.909371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5d5ef2b8-83f5-44ac-a20d-8cd9f25ab208 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:46.050074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d5ef2b8-83f5-44ac-a20d-8cd9f25ab208 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:46.059097 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d5ef2b8-83f5-44ac-a20d-8cd9f25ab208 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:46.060694 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5d5ef2b8-83f5-44ac-a20d-8cd9f25ab208 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:46.061874 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5d5ef2b8-83f5-44ac-a20d-8cd9f25ab208 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.167974 Aug 01 16:07:46.062461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1606/3547] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:47.085057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-174d3011-dd7c-4fdd-89d3-5c40e83e121c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:47.085670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-174d3011-dd7c-4fdd-89d3-5c40e83e121c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:47.092281 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-174d3011-dd7c-4fdd-89d3-5c40e83e121c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:47.092753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-174d3011-dd7c-4fdd-89d3-5c40e83e121c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:47.093512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-174d3011-dd7c-4fdd-89d3-5c40e83e121c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:47.093979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-174d3011-dd7c-4fdd-89d3-5c40e83e121c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:47.236446 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-174d3011-dd7c-4fdd-89d3-5c40e83e121c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:47.245222 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-174d3011-dd7c-4fdd-89d3-5c40e83e121c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:47.246751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-174d3011-dd7c-4fdd-89d3-5c40e83e121c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:47.247991 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-174d3011-dd7c-4fdd-89d3-5c40e83e121c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.167044 Aug 01 16:07:47.248678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1942/3548] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:48.272858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ffbb8332-12a5-47ff-a7e0-eaf1056039d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:48.273497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ffbb8332-12a5-47ff-a7e0-eaf1056039d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:48.280178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ffbb8332-12a5-47ff-a7e0-eaf1056039d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:48.280631 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ffbb8332-12a5-47ff-a7e0-eaf1056039d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:48.281403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ffbb8332-12a5-47ff-a7e0-eaf1056039d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:48.281845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ffbb8332-12a5-47ff-a7e0-eaf1056039d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:48.421720 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ffbb8332-12a5-47ff-a7e0-eaf1056039d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:48.431349 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ffbb8332-12a5-47ff-a7e0-eaf1056039d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:48.432848 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ffbb8332-12a5-47ff-a7e0-eaf1056039d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:48.434145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ffbb8332-12a5-47ff-a7e0-eaf1056039d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.165224 Aug 01 16:07:48.434655 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1607/3549] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:48 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:49.456643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a5031fc7-8e5b-4926-b111-06aa3175edcc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:49.457260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a5031fc7-8e5b-4926-b111-06aa3175edcc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:49.463930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a5031fc7-8e5b-4926-b111-06aa3175edcc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:49.464381 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a5031fc7-8e5b-4926-b111-06aa3175edcc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:49.465155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a5031fc7-8e5b-4926-b111-06aa3175edcc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:49.465593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a5031fc7-8e5b-4926-b111-06aa3175edcc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:49.595417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a5031fc7-8e5b-4926-b111-06aa3175edcc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:49.603958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a5031fc7-8e5b-4926-b111-06aa3175edcc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:49.605556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-a5031fc7-8e5b-4926-b111-06aa3175edcc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:49.606856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a5031fc7-8e5b-4926-b111-06aa3175edcc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.154087 Aug 01 16:07:49.607479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1943/3550] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:50.630489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-352f1f5f-1eb1-4c57-a9fd-9878ddf9e8fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:50.631107 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-352f1f5f-1eb1-4c57-a9fd-9878ddf9e8fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:50.638080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-352f1f5f-1eb1-4c57-a9fd-9878ddf9e8fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:50.638539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-352f1f5f-1eb1-4c57-a9fd-9878ddf9e8fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:50.639317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-352f1f5f-1eb1-4c57-a9fd-9878ddf9e8fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:50.639758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-352f1f5f-1eb1-4c57-a9fd-9878ddf9e8fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:50.774634 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-352f1f5f-1eb1-4c57-a9fd-9878ddf9e8fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:50.784285 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-352f1f5f-1eb1-4c57-a9fd-9878ddf9e8fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:50.785835 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-352f1f5f-1eb1-4c57-a9fd-9878ddf9e8fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:50.787059 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-352f1f5f-1eb1-4c57-a9fd-9878ddf9e8fe tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.160822 Aug 01 16:07:50.787628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1608/3551] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:51.810238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2dc7b904-98c6-49d1-a7e7-39464003e3f9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:51.810846 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2dc7b904-98c6-49d1-a7e7-39464003e3f9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:51.813164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:51.819286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2dc7b904-98c6-49d1-a7e7-39464003e3f9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:51.819726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2dc7b904-98c6-49d1-a7e7-39464003e3f9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:51.820495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2dc7b904-98c6-49d1-a7e7-39464003e3f9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:51.820931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2dc7b904-98c6-49d1-a7e7-39464003e3f9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:51.825534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:51.963078 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2dc7b904-98c6-49d1-a7e7-39464003e3f9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:51.972343 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2dc7b904-98c6-49d1-a7e7-39464003e3f9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:51.973829 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2dc7b904-98c6-49d1-a7e7-39464003e3f9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:51.975002 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2dc7b904-98c6-49d1-a7e7-39464003e3f9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.168807 Aug 01 16:07:51.975560 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1944/3552] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:52.997634 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-59add2ef-5c7e-4759-8dd6-759e15d5f6c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:52.998291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-59add2ef-5c7e-4759-8dd6-759e15d5f6c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:53.000778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=31 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:53.006071 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-59add2ef-5c7e-4759-8dd6-759e15d5f6c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:53.006522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-59add2ef-5c7e-4759-8dd6-759e15d5f6c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:53.007289 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-59add2ef-5c7e-4759-8dd6-759e15d5f6c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:53.007725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-59add2ef-5c7e-4759-8dd6-759e15d5f6c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:53.012060 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:07:53.141373 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-59add2ef-5c7e-4759-8dd6-759e15d5f6c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:53.150350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-59add2ef-5c7e-4759-8dd6-759e15d5f6c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:53.151836 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-59add2ef-5c7e-4759-8dd6-759e15d5f6c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:53.152976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-59add2ef-5c7e-4759-8dd6-759e15d5f6c9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.159441 Aug 01 16:07:53.153524 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1609/3553] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:54.178138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-73fdbd0d-83e2-48fc-938d-b34a0803c17e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:54.178780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-73fdbd0d-83e2-48fc-938d-b34a0803c17e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:54.185673 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73fdbd0d-83e2-48fc-938d-b34a0803c17e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:54.186230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73fdbd0d-83e2-48fc-938d-b34a0803c17e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:54.187010 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73fdbd0d-83e2-48fc-938d-b34a0803c17e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:54.187443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-73fdbd0d-83e2-48fc-938d-b34a0803c17e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:54.339669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-73fdbd0d-83e2-48fc-938d-b34a0803c17e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:54.348666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-73fdbd0d-83e2-48fc-938d-b34a0803c17e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:54.350190 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-73fdbd0d-83e2-48fc-938d-b34a0803c17e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:54.351360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-73fdbd0d-83e2-48fc-938d-b34a0803c17e tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.178591 Aug 01 16:07:54.351924 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1945/3554] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:55.374775 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-6544b907-7a04-469e-b90e-4dac9c54bbea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:55.375429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-6544b907-7a04-469e-b90e-4dac9c54bbea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:55.382195 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6544b907-7a04-469e-b90e-4dac9c54bbea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:55.382648 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6544b907-7a04-469e-b90e-4dac9c54bbea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:55.383407 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6544b907-7a04-469e-b90e-4dac9c54bbea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:55.383857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-6544b907-7a04-469e-b90e-4dac9c54bbea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:55.517076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6544b907-7a04-469e-b90e-4dac9c54bbea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:55.525605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6544b907-7a04-469e-b90e-4dac9c54bbea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:55.527125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-6544b907-7a04-469e-b90e-4dac9c54bbea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:55.528369 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-6544b907-7a04-469e-b90e-4dac9c54bbea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.157666 Aug 01 16:07:55.528931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1610/3555] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:55 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:07:56.551087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-89a0fdb5-0444-4a04-8d9b-d2c603bacfbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:56.551747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-89a0fdb5-0444-4a04-8d9b-d2c603bacfbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:56.558652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89a0fdb5-0444-4a04-8d9b-d2c603bacfbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:56.559109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89a0fdb5-0444-4a04-8d9b-d2c603bacfbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:56.559968 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89a0fdb5-0444-4a04-8d9b-d2c603bacfbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:56.560512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-89a0fdb5-0444-4a04-8d9b-d2c603bacfbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:56.693419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-89a0fdb5-0444-4a04-8d9b-d2c603bacfbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:56.701819 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-89a0fdb5-0444-4a04-8d9b-d2c603bacfbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:56.703325 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-89a0fdb5-0444-4a04-8d9b-d2c603bacfbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:56.704514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-89a0fdb5-0444-4a04-8d9b-d2c603bacfbc tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.157372 Aug 01 16:07:56.705576 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1946/3556] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:57.727507 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b214058f-70c8-431b-9e55-002fac4012be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:57.728123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b214058f-70c8-431b-9e55-002fac4012be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:57.734974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b214058f-70c8-431b-9e55-002fac4012be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:57.735429 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b214058f-70c8-431b-9e55-002fac4012be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:57.736640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b214058f-70c8-431b-9e55-002fac4012be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:57.737078 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b214058f-70c8-431b-9e55-002fac4012be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:57.875132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b214058f-70c8-431b-9e55-002fac4012be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:57.884776 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b214058f-70c8-431b-9e55-002fac4012be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:57.886333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b214058f-70c8-431b-9e55-002fac4012be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:57.887504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b214058f-70c8-431b-9e55-002fac4012be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.163934 Aug 01 16:07:57.888096 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1611/3557] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:07:58.914824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e873443f-4ccc-4d3b-9383-030f427a499f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:07:58.915417 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e873443f-4ccc-4d3b-9383-030f427a499f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:07:58.922178 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e873443f-4ccc-4d3b-9383-030f427a499f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:58.922626 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e873443f-4ccc-4d3b-9383-030f427a499f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:58.924044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e873443f-4ccc-4d3b-9383-030f427a499f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:07:58.924488 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e873443f-4ccc-4d3b-9383-030f427a499f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:07:59.058267 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e873443f-4ccc-4d3b-9383-030f427a499f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:59.067243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e873443f-4ccc-4d3b-9383-030f427a499f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:59.068779 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e873443f-4ccc-4d3b-9383-030f427a499f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:07:59.070102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e873443f-4ccc-4d3b-9383-030f427a499f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.159181 Aug 01 16:07:59.070714 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1947/3558] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:07:58 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:00.092135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-30607001-5f00-43ed-bbf0-c545b1482261 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:00.092785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-30607001-5f00-43ed-bbf0-c545b1482261 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:00.100085 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30607001-5f00-43ed-bbf0-c545b1482261 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:00.100529 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30607001-5f00-43ed-bbf0-c545b1482261 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:00.101299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30607001-5f00-43ed-bbf0-c545b1482261 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:00.101738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-30607001-5f00-43ed-bbf0-c545b1482261 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:00.242525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-30607001-5f00-43ed-bbf0-c545b1482261 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:00.252139 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-30607001-5f00-43ed-bbf0-c545b1482261 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:00.253611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-30607001-5f00-43ed-bbf0-c545b1482261 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:00.254805 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-30607001-5f00-43ed-bbf0-c545b1482261 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.166752 Aug 01 16:08:00.255363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1612/3559] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:00 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:01.280868 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-58eab737-42eb-41cf-a832-2b5731909aa0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:01.281465 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-58eab737-42eb-41cf-a832-2b5731909aa0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:01.288050 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58eab737-42eb-41cf-a832-2b5731909aa0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:01.288503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58eab737-42eb-41cf-a832-2b5731909aa0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:01.289279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58eab737-42eb-41cf-a832-2b5731909aa0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:01.289712 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-58eab737-42eb-41cf-a832-2b5731909aa0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:01.420627 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-58eab737-42eb-41cf-a832-2b5731909aa0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:01.429706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-58eab737-42eb-41cf-a832-2b5731909aa0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:01.431247 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-58eab737-42eb-41cf-a832-2b5731909aa0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:01.432421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-58eab737-42eb-41cf-a832-2b5731909aa0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.155759 Aug 01 16:08:01.432983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1948/3560] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:01 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:02.456073 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-48b92ca3-3c36-4495-b232-4f7b459712f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:02.456733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-48b92ca3-3c36-4495-b232-4f7b459712f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:02.463344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-48b92ca3-3c36-4495-b232-4f7b459712f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:02.464080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-48b92ca3-3c36-4495-b232-4f7b459712f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:02.465132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-48b92ca3-3c36-4495-b232-4f7b459712f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:02.465575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-48b92ca3-3c36-4495-b232-4f7b459712f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:02.749464 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-48b92ca3-3c36-4495-b232-4f7b459712f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:02.758877 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-48b92ca3-3c36-4495-b232-4f7b459712f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:02.760360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-48b92ca3-3c36-4495-b232-4f7b459712f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:02.761541 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-48b92ca3-3c36-4495-b232-4f7b459712f7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.309884 Aug 01 16:08:02.762155 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1613/3561] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:02 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:03.784645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-531c7206-faaf-4bc6-bb3d-5d73df0776b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:03.785288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-531c7206-faaf-4bc6-bb3d-5d73df0776b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:03.792329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-531c7206-faaf-4bc6-bb3d-5d73df0776b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:03.792873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-531c7206-faaf-4bc6-bb3d-5d73df0776b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:03.793770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-531c7206-faaf-4bc6-bb3d-5d73df0776b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:03.794292 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-531c7206-faaf-4bc6-bb3d-5d73df0776b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:03.931374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-531c7206-faaf-4bc6-bb3d-5d73df0776b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:03.940805 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-531c7206-faaf-4bc6-bb3d-5d73df0776b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:03.942358 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-531c7206-faaf-4bc6-bb3d-5d73df0776b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:03.943527 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-531c7206-faaf-4bc6-bb3d-5d73df0776b9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.162963 Aug 01 16:08:03.944092 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1949/3562] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:03 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:04.966048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-396607de-3d42-43dd-99e4-d9ead195ecf4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:04.966699 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-396607de-3d42-43dd-99e4-d9ead195ecf4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:04.973375 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-396607de-3d42-43dd-99e4-d9ead195ecf4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:04.973823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-396607de-3d42-43dd-99e4-d9ead195ecf4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:04.974617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-396607de-3d42-43dd-99e4-d9ead195ecf4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:04.975057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-396607de-3d42-43dd-99e4-d9ead195ecf4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:05.151711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-396607de-3d42-43dd-99e4-d9ead195ecf4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:05.160513 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-396607de-3d42-43dd-99e4-d9ead195ecf4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:05.162051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-396607de-3d42-43dd-99e4-d9ead195ecf4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:05.163347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-396607de-3d42-43dd-99e4-d9ead195ecf4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.201244 Aug 01 16:08:05.163907 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1614/3563] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:04 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:06.187952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-50285a5f-4f24-42dc-a2f5-cfc1a245b1d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:06.189447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-50285a5f-4f24-42dc-a2f5-cfc1a245b1d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:06.197591 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-50285a5f-4f24-42dc-a2f5-cfc1a245b1d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:06.198149 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-50285a5f-4f24-42dc-a2f5-cfc1a245b1d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:06.199001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-50285a5f-4f24-42dc-a2f5-cfc1a245b1d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:06.199593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-50285a5f-4f24-42dc-a2f5-cfc1a245b1d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:06.353429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-50285a5f-4f24-42dc-a2f5-cfc1a245b1d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:06.362801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-50285a5f-4f24-42dc-a2f5-cfc1a245b1d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:06.368929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-50285a5f-4f24-42dc-a2f5-cfc1a245b1d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:06.370902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-50285a5f-4f24-42dc-a2f5-cfc1a245b1d6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.187128 Aug 01 16:08:06.370902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1950/3564] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:06 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:07.397908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-657353f3-802e-49c0-944f-35c6d9c7bc67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:07.398857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-657353f3-802e-49c0-944f-35c6d9c7bc67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:07.409278 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-657353f3-802e-49c0-944f-35c6d9c7bc67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:07.410008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-657353f3-802e-49c0-944f-35c6d9c7bc67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:07.411141 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-657353f3-802e-49c0-944f-35c6d9c7bc67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:07.411892 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-657353f3-802e-49c0-944f-35c6d9c7bc67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:07.548687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-657353f3-802e-49c0-944f-35c6d9c7bc67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:07.560503 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-657353f3-802e-49c0-944f-35c6d9c7bc67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:07.560503 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-657353f3-802e-49c0-944f-35c6d9c7bc67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:07.564516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-657353f3-802e-49c0-944f-35c6d9c7bc67 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.170264 Aug 01 16:08:07.564516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1615/3565] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:07 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:08.586415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-32080b1f-6fc6-48e0-8402-dab7f0c2a41a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:08.587018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-32080b1f-6fc6-48e0-8402-dab7f0c2a41a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:08.593770 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32080b1f-6fc6-48e0-8402-dab7f0c2a41a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:08.594246 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32080b1f-6fc6-48e0-8402-dab7f0c2a41a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:08.595563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32080b1f-6fc6-48e0-8402-dab7f0c2a41a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:08.595995 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-32080b1f-6fc6-48e0-8402-dab7f0c2a41a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:08.736533 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-32080b1f-6fc6-48e0-8402-dab7f0c2a41a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:08.744931 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-32080b1f-6fc6-48e0-8402-dab7f0c2a41a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:08.746475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-32080b1f-6fc6-48e0-8402-dab7f0c2a41a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:08.747612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-32080b1f-6fc6-48e0-8402-dab7f0c2a41a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.165080 Aug 01 16:08:08.748175 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1951/3566] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:08 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:09.833146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b71a2fcd-488e-46bf-ac9e-0642b59165f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:09.833714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b71a2fcd-488e-46bf-ac9e-0642b59165f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:09.841239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b71a2fcd-488e-46bf-ac9e-0642b59165f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:09.841682 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b71a2fcd-488e-46bf-ac9e-0642b59165f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:09.842479 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b71a2fcd-488e-46bf-ac9e-0642b59165f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:09.842912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b71a2fcd-488e-46bf-ac9e-0642b59165f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:09.985058 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b71a2fcd-488e-46bf-ac9e-0642b59165f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:09.994923 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b71a2fcd-488e-46bf-ac9e-0642b59165f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:09.996424 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-b71a2fcd-488e-46bf-ac9e-0642b59165f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:09.997674 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b71a2fcd-488e-46bf-ac9e-0642b59165f6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.168799 Aug 01 16:08:09.998989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1616/3567] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:09 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:11.021023 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-288a3131-a8af-4ba9-85d6-16afca6e5796 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:11.021704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-288a3131-a8af-4ba9-85d6-16afca6e5796 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:11.028219 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-288a3131-a8af-4ba9-85d6-16afca6e5796 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:11.028672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-288a3131-a8af-4ba9-85d6-16afca6e5796 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:11.029447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-288a3131-a8af-4ba9-85d6-16afca6e5796 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:11.029925 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-288a3131-a8af-4ba9-85d6-16afca6e5796 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:11.166241 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-288a3131-a8af-4ba9-85d6-16afca6e5796 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:11.176048 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-288a3131-a8af-4ba9-85d6-16afca6e5796 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:11.177568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-288a3131-a8af-4ba9-85d6-16afca6e5796 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:11.178790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-288a3131-a8af-4ba9-85d6-16afca6e5796 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.162299 Aug 01 16:08:11.179349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1952/3568] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:11 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:12.202630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fc328f82-ea46-4b9f-848b-f152ceb3fb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:12.203334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fc328f82-ea46-4b9f-848b-f152ceb3fb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:12.210633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc328f82-ea46-4b9f-848b-f152ceb3fb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:12.211088 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc328f82-ea46-4b9f-848b-f152ceb3fb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:12.211875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc328f82-ea46-4b9f-848b-f152ceb3fb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:12.212327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fc328f82-ea46-4b9f-848b-f152ceb3fb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:12.356797 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fc328f82-ea46-4b9f-848b-f152ceb3fb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:12.365531 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fc328f82-ea46-4b9f-848b-f152ceb3fb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:12.367069 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fc328f82-ea46-4b9f-848b-f152ceb3fb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:12.368226 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fc328f82-ea46-4b9f-848b-f152ceb3fb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.170008 Aug 01 16:08:12.368905 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1617/3569] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:12 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:13.391566 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d31a1bc8-d0ea-4c5b-8c95-7daca076cc57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:13.392831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d31a1bc8-d0ea-4c5b-8c95-7daca076cc57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:13.399317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d31a1bc8-d0ea-4c5b-8c95-7daca076cc57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:13.399764 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d31a1bc8-d0ea-4c5b-8c95-7daca076cc57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:13.400525 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d31a1bc8-d0ea-4c5b-8c95-7daca076cc57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:13.400960 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d31a1bc8-d0ea-4c5b-8c95-7daca076cc57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:13.547240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d31a1bc8-d0ea-4c5b-8c95-7daca076cc57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:13.555837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d31a1bc8-d0ea-4c5b-8c95-7daca076cc57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:13.557464 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d31a1bc8-d0ea-4c5b-8c95-7daca076cc57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:13.558747 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d31a1bc8-d0ea-4c5b-8c95-7daca076cc57 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.171096 Aug 01 16:08:13.559395 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1953/3570] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:13 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:14.584178 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0c43eba5-d2a9-4e91-88a8-68fcfff0ee72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:14.585077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0c43eba5-d2a9-4e91-88a8-68fcfff0ee72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:14.594721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c43eba5-d2a9-4e91-88a8-68fcfff0ee72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:14.595384 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c43eba5-d2a9-4e91-88a8-68fcfff0ee72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:14.596470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c43eba5-d2a9-4e91-88a8-68fcfff0ee72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:14.597113 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c43eba5-d2a9-4e91-88a8-68fcfff0ee72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:14.732074 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c43eba5-d2a9-4e91-88a8-68fcfff0ee72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:14.742564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c43eba5-d2a9-4e91-88a8-68fcfff0ee72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:14.744070 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c43eba5-d2a9-4e91-88a8-68fcfff0ee72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:14.745242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0c43eba5-d2a9-4e91-88a8-68fcfff0ee72 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.168030 Aug 01 16:08:14.745802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1618/3571] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:14 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:15.768970 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-645d6148-d998-4199-90cb-d6cc3acc9b5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:15.769794 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-645d6148-d998-4199-90cb-d6cc3acc9b5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:15.776227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-645d6148-d998-4199-90cb-d6cc3acc9b5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:15.776685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-645d6148-d998-4199-90cb-d6cc3acc9b5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:15.777463 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-645d6148-d998-4199-90cb-d6cc3acc9b5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:15.777916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-645d6148-d998-4199-90cb-d6cc3acc9b5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:15.923044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-645d6148-d998-4199-90cb-d6cc3acc9b5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:15.931803 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-645d6148-d998-4199-90cb-d6cc3acc9b5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:15.933297 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-645d6148-d998-4199-90cb-d6cc3acc9b5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:15.934495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-645d6148-d998-4199-90cb-d6cc3acc9b5a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.170031 Aug 01 16:08:15.935064 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1954/3572] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:15 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:08:16.957468 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-00200ee2-adb5-4a9b-9632-317c01c1a9fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:16.958190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-00200ee2-adb5-4a9b-9632-317c01c1a9fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:16.964754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00200ee2-adb5-4a9b-9632-317c01c1a9fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:16.965204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00200ee2-adb5-4a9b-9632-317c01c1a9fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:16.966010 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00200ee2-adb5-4a9b-9632-317c01c1a9fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:16.966452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-00200ee2-adb5-4a9b-9632-317c01c1a9fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:17.118239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-00200ee2-adb5-4a9b-9632-317c01c1a9fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:17.127382 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-00200ee2-adb5-4a9b-9632-317c01c1a9fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:17.128969 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-00200ee2-adb5-4a9b-9632-317c01c1a9fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:17.130379 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-00200ee2-adb5-4a9b-9632-317c01c1a9fa tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.176660 Aug 01 16:08:17.130941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1619/3573] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:16 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:18.160789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e6c71a3a-7bb1-41f5-9f59-fc943ecf54b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:18.161618 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e6c71a3a-7bb1-41f5-9f59-fc943ecf54b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:18.172104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6c71a3a-7bb1-41f5-9f59-fc943ecf54b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:18.172905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6c71a3a-7bb1-41f5-9f59-fc943ecf54b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:18.174668 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6c71a3a-7bb1-41f5-9f59-fc943ecf54b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:18.175434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6c71a3a-7bb1-41f5-9f59-fc943ecf54b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:18.335353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e6c71a3a-7bb1-41f5-9f59-fc943ecf54b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:18.344057 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e6c71a3a-7bb1-41f5-9f59-fc943ecf54b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:18.346120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e6c71a3a-7bb1-41f5-9f59-fc943ecf54b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:18.347288 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e6c71a3a-7bb1-41f5-9f59-fc943ecf54b2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.195076 Aug 01 16:08:18.348122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1955/3574] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:18 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:08:19.370952 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-babdfebf-a583-4f21-b7a2-c8262d002f3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:19.371590 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-babdfebf-a583-4f21-b7a2-c8262d002f3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:19.378579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-babdfebf-a583-4f21-b7a2-c8262d002f3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:19.379038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-babdfebf-a583-4f21-b7a2-c8262d002f3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:19.379816 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-babdfebf-a583-4f21-b7a2-c8262d002f3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:19.380255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-babdfebf-a583-4f21-b7a2-c8262d002f3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:19.520511 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-babdfebf-a583-4f21-b7a2-c8262d002f3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:19.529288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-babdfebf-a583-4f21-b7a2-c8262d002f3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:19.530831 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-babdfebf-a583-4f21-b7a2-c8262d002f3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:19.532011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-babdfebf-a583-4f21-b7a2-c8262d002f3a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.165018 Aug 01 16:08:19.532570 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1620/3575] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:19 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:20.555950 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b8312653-4a58-4261-99ae-2494a3e9f52d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:20.556684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b8312653-4a58-4261-99ae-2494a3e9f52d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:20.564071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b8312653-4a58-4261-99ae-2494a3e9f52d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:20.564514 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b8312653-4a58-4261-99ae-2494a3e9f52d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:20.565304 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b8312653-4a58-4261-99ae-2494a3e9f52d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:20.565740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b8312653-4a58-4261-99ae-2494a3e9f52d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:20.715014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b8312653-4a58-4261-99ae-2494a3e9f52d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:20.725742 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b8312653-4a58-4261-99ae-2494a3e9f52d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:20.727296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b8312653-4a58-4261-99ae-2494a3e9f52d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:20.728529 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b8312653-4a58-4261-99ae-2494a3e9f52d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.176669 Aug 01 16:08:20.729447 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1956/3576] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:20 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:08:21.753832 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-eedd4057-4662-48a6-884d-da8e84769325 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:21.754548 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-eedd4057-4662-48a6-884d-da8e84769325 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:21.761413 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eedd4057-4662-48a6-884d-da8e84769325 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:21.761863 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eedd4057-4662-48a6-884d-da8e84769325 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:21.762675 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eedd4057-4662-48a6-884d-da8e84769325 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:21.763110 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-eedd4057-4662-48a6-884d-da8e84769325 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:21.904398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-eedd4057-4662-48a6-884d-da8e84769325 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:21.916249 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-eedd4057-4662-48a6-884d-da8e84769325 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:21.917754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-eedd4057-4662-48a6-884d-da8e84769325 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:21.918989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-eedd4057-4662-48a6-884d-da8e84769325 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.169708 Aug 01 16:08:21.919554 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1621/3577] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:21 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:22.944365 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-12b27f27-5d08-4016-aa28-5528dfcabb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:22.945261 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-12b27f27-5d08-4016-aa28-5528dfcabb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:22.946939 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=26 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:08:22.952341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-12b27f27-5d08-4016-aa28-5528dfcabb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:22.952780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-12b27f27-5d08-4016-aa28-5528dfcabb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:22.953575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-12b27f27-5d08-4016-aa28-5528dfcabb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:22.954008 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-12b27f27-5d08-4016-aa28-5528dfcabb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:22.957646 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=78 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:08:23.111854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-12b27f27-5d08-4016-aa28-5528dfcabb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:23.120890 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-12b27f27-5d08-4016-aa28-5528dfcabb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:23.122435 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-12b27f27-5d08-4016-aa28-5528dfcabb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:23.123611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-12b27f27-5d08-4016-aa28-5528dfcabb1a tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.183292 Aug 01 16:08:23.124170 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1957/3578] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:22 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:24.147490 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-06dc8c8b-80ac-4da5-9e78-18efd11766ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:24.148080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-06dc8c8b-80ac-4da5-9e78-18efd11766ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:24.150466 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=26 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:08:24.155696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06dc8c8b-80ac-4da5-9e78-18efd11766ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:24.156146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06dc8c8b-80ac-4da5-9e78-18efd11766ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:24.156913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06dc8c8b-80ac-4da5-9e78-18efd11766ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:24.157341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-06dc8c8b-80ac-4da5-9e78-18efd11766ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:24.161267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=78 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:08:24.304372 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-06dc8c8b-80ac-4da5-9e78-18efd11766ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:24.313130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-06dc8c8b-80ac-4da5-9e78-18efd11766ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:24.315138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-06dc8c8b-80ac-4da5-9e78-18efd11766ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:24.316321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-06dc8c8b-80ac-4da5-9e78-18efd11766ea tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.172717 Aug 01 16:08:24.316886 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1622/3579] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:24 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:08:25.339658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4d85aea2-9dae-4c22-b84b-ff48db8bfd14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:25.340265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4d85aea2-9dae-4c22-b84b-ff48db8bfd14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:25.347776 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d85aea2-9dae-4c22-b84b-ff48db8bfd14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:25.348460 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d85aea2-9dae-4c22-b84b-ff48db8bfd14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:25.349807 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d85aea2-9dae-4c22-b84b-ff48db8bfd14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:25.350424 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4d85aea2-9dae-4c22-b84b-ff48db8bfd14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:25.515760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4d85aea2-9dae-4c22-b84b-ff48db8bfd14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:25.526521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4d85aea2-9dae-4c22-b84b-ff48db8bfd14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:25.528169 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-4d85aea2-9dae-4c22-b84b-ff48db8bfd14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:25.529375 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4d85aea2-9dae-4c22-b84b-ff48db8bfd14 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.193801 Aug 01 16:08:25.530326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1958/3580] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:25 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:08:26.553920 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4368d09f-fc2f-428e-b4c2-66676cf68f29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:26.554528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4368d09f-fc2f-428e-b4c2-66676cf68f29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:26.560692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4368d09f-fc2f-428e-b4c2-66676cf68f29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:26.561138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4368d09f-fc2f-428e-b4c2-66676cf68f29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:26.561913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4368d09f-fc2f-428e-b4c2-66676cf68f29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:26.562350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4368d09f-fc2f-428e-b4c2-66676cf68f29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:26.700309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4368d09f-fc2f-428e-b4c2-66676cf68f29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:26.709196 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4368d09f-fc2f-428e-b4c2-66676cf68f29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:26.710741 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4368d09f-fc2f-428e-b4c2-66676cf68f29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:26.711938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4368d09f-fc2f-428e-b4c2-66676cf68f29 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.162838 Aug 01 16:08:26.712496 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1623/3581] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:26 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:27.735732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-648e5374-2208-49bb-a71b-8cba8c800816 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:27.736347 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-648e5374-2208-49bb-a71b-8cba8c800816 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:27.743353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-648e5374-2208-49bb-a71b-8cba8c800816 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:27.743798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-648e5374-2208-49bb-a71b-8cba8c800816 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:27.744556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-648e5374-2208-49bb-a71b-8cba8c800816 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:27.744985 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-648e5374-2208-49bb-a71b-8cba8c800816 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:27.889507 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-648e5374-2208-49bb-a71b-8cba8c800816 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:27.900538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-648e5374-2208-49bb-a71b-8cba8c800816 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:27.904019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-648e5374-2208-49bb-a71b-8cba8c800816 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:27.904019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-648e5374-2208-49bb-a71b-8cba8c800816 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.171560 Aug 01 16:08:27.904019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1959/3582] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:27 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:08:28.927670 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0c35e12f-1922-4f1b-8cfd-0783d7a724c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:28.928288 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0c35e12f-1922-4f1b-8cfd-0783d7a724c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:28.935386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c35e12f-1922-4f1b-8cfd-0783d7a724c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:28.935840 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c35e12f-1922-4f1b-8cfd-0783d7a724c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:28.936622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c35e12f-1922-4f1b-8cfd-0783d7a724c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:28.937066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c35e12f-1922-4f1b-8cfd-0783d7a724c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:29.075145 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c35e12f-1922-4f1b-8cfd-0783d7a724c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:29.084442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c35e12f-1922-4f1b-8cfd-0783d7a724c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:29.085966 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c35e12f-1922-4f1b-8cfd-0783d7a724c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:29.087138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0c35e12f-1922-4f1b-8cfd-0783d7a724c0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.163449 Aug 01 16:08:29.087686 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1624/3583] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:28 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:30.109952 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aeb81667-69d4-46ec-85a3-a0ba2f6b8142 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:30.110825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-aeb81667-69d4-46ec-85a3-a0ba2f6b8142 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:30.118185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aeb81667-69d4-46ec-85a3-a0ba2f6b8142 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:30.118715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aeb81667-69d4-46ec-85a3-a0ba2f6b8142 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:30.119622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aeb81667-69d4-46ec-85a3-a0ba2f6b8142 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:30.120096 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-aeb81667-69d4-46ec-85a3-a0ba2f6b8142 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:30.273565 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aeb81667-69d4-46ec-85a3-a0ba2f6b8142 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:30.282334 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aeb81667-69d4-46ec-85a3-a0ba2f6b8142 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:30.283856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-aeb81667-69d4-46ec-85a3-a0ba2f6b8142 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:30.285052 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aeb81667-69d4-46ec-85a3-a0ba2f6b8142 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.179117 Aug 01 16:08:30.285611 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1960/3584] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:30 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:31.309451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-52f15a30-618c-40c4-aad6-2a4d6ec3bd58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:31.310099 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-52f15a30-618c-40c4-aad6-2a4d6ec3bd58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:31.317546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52f15a30-618c-40c4-aad6-2a4d6ec3bd58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:31.318018 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52f15a30-618c-40c4-aad6-2a4d6ec3bd58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:31.318778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52f15a30-618c-40c4-aad6-2a4d6ec3bd58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:31.319211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-52f15a30-618c-40c4-aad6-2a4d6ec3bd58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:31.465782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-52f15a30-618c-40c4-aad6-2a4d6ec3bd58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:31.474792 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-52f15a30-618c-40c4-aad6-2a4d6ec3bd58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:31.475856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-52f15a30-618c-40c4-aad6-2a4d6ec3bd58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:31.477021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-52f15a30-618c-40c4-aad6-2a4d6ec3bd58 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.171517 Aug 01 16:08:31.477578 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1625/3585] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:31 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:32.500389 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e65c346d-f46b-45bb-8e0c-b1cd0ecda154 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:32.500988 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e65c346d-f46b-45bb-8e0c-b1cd0ecda154 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:32.508399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e65c346d-f46b-45bb-8e0c-b1cd0ecda154 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:32.508845 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e65c346d-f46b-45bb-8e0c-b1cd0ecda154 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:32.509641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e65c346d-f46b-45bb-8e0c-b1cd0ecda154 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:32.510097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e65c346d-f46b-45bb-8e0c-b1cd0ecda154 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:32.647971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e65c346d-f46b-45bb-8e0c-b1cd0ecda154 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:32.657120 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e65c346d-f46b-45bb-8e0c-b1cd0ecda154 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:32.658667 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e65c346d-f46b-45bb-8e0c-b1cd0ecda154 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:32.659848 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e65c346d-f46b-45bb-8e0c-b1cd0ecda154 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.163364 Aug 01 16:08:32.660416 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1961/3586] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:32 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:33.683569 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-1cd087c5-e1a9-430c-a0db-435929936dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:33.684209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-1cd087c5-e1a9-430c-a0db-435929936dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:33.691471 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1cd087c5-e1a9-430c-a0db-435929936dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:33.691955 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1cd087c5-e1a9-430c-a0db-435929936dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:33.692672 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1cd087c5-e1a9-430c-a0db-435929936dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:33.693114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-1cd087c5-e1a9-430c-a0db-435929936dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:33.834336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1cd087c5-e1a9-430c-a0db-435929936dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:33.842979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1cd087c5-e1a9-430c-a0db-435929936dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:33.844436 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-1cd087c5-e1a9-430c-a0db-435929936dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:33.845610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-1cd087c5-e1a9-430c-a0db-435929936dc5 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.166036 Aug 01 16:08:33.846187 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1626/3587] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:33 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:34.868350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f35e9f75-d179-4f5c-bb33-f936682493d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:34.868947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f35e9f75-d179-4f5c-bb33-f936682493d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:34.875649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f35e9f75-d179-4f5c-bb33-f936682493d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:34.876164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f35e9f75-d179-4f5c-bb33-f936682493d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:34.877642 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f35e9f75-d179-4f5c-bb33-f936682493d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:34.878108 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f35e9f75-d179-4f5c-bb33-f936682493d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:35.022503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f35e9f75-d179-4f5c-bb33-f936682493d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:35.031563 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f35e9f75-d179-4f5c-bb33-f936682493d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:35.033151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f35e9f75-d179-4f5c-bb33-f936682493d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:35.034622 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f35e9f75-d179-4f5c-bb33-f936682493d9 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.169838 Aug 01 16:08:35.035201 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1962/3588] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:34 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:36.057066 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-af241d35-b726-4cdc-805a-6163a56b1f84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:36.057685 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-af241d35-b726-4cdc-805a-6163a56b1f84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:36.064990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af241d35-b726-4cdc-805a-6163a56b1f84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:36.065438 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af241d35-b726-4cdc-805a-6163a56b1f84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:36.066333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af241d35-b726-4cdc-805a-6163a56b1f84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:36.066760 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-af241d35-b726-4cdc-805a-6163a56b1f84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:36.195576 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-af241d35-b726-4cdc-805a-6163a56b1f84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:36.205048 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-af241d35-b726-4cdc-805a-6163a56b1f84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:36.206642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-af241d35-b726-4cdc-805a-6163a56b1f84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:36.207798 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-af241d35-b726-4cdc-805a-6163a56b1f84 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.154670 Aug 01 16:08:36.208686 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1627/3589] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:36 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:37.230874 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c06bc658-1703-41fa-866d-35d72d5b0245 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:37.231526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c06bc658-1703-41fa-866d-35d72d5b0245 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:37.238916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c06bc658-1703-41fa-866d-35d72d5b0245 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:37.239364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c06bc658-1703-41fa-866d-35d72d5b0245 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:37.240140 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c06bc658-1703-41fa-866d-35d72d5b0245 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:37.240580 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c06bc658-1703-41fa-866d-35d72d5b0245 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:37.378497 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c06bc658-1703-41fa-866d-35d72d5b0245 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:37.387233 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c06bc658-1703-41fa-866d-35d72d5b0245 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:37.388757 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c06bc658-1703-41fa-866d-35d72d5b0245 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:37.389964 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c06bc658-1703-41fa-866d-35d72d5b0245 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.162998 Aug 01 16:08:37.390534 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1963/3590] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:37 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:38.414714 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4f3f17fe-9286-4f0f-8e19-526e0fe3ed7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:38.415857 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4f3f17fe-9286-4f0f-8e19-526e0fe3ed7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:38.421908 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f3f17fe-9286-4f0f-8e19-526e0fe3ed7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:38.422351 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f3f17fe-9286-4f0f-8e19-526e0fe3ed7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:38.423121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f3f17fe-9286-4f0f-8e19-526e0fe3ed7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:38.424111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4f3f17fe-9286-4f0f-8e19-526e0fe3ed7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:38.560016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4f3f17fe-9286-4f0f-8e19-526e0fe3ed7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:38.568668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4f3f17fe-9286-4f0f-8e19-526e0fe3ed7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:38.570209 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4f3f17fe-9286-4f0f-8e19-526e0fe3ed7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:38.571399 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4f3f17fe-9286-4f0f-8e19-526e0fe3ed7b tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.160586 Aug 01 16:08:38.571958 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1628/3591] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:38 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:39.594679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ef8aeeb1-ddc2-4212-878b-284cc4cd71e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:39.595455 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ef8aeeb1-ddc2-4212-878b-284cc4cd71e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:39.602704 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef8aeeb1-ddc2-4212-878b-284cc4cd71e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:39.603103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef8aeeb1-ddc2-4212-878b-284cc4cd71e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:39.603893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef8aeeb1-ddc2-4212-878b-284cc4cd71e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:39.604332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ef8aeeb1-ddc2-4212-878b-284cc4cd71e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:39.741299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ef8aeeb1-ddc2-4212-878b-284cc4cd71e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:39.749919 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ef8aeeb1-ddc2-4212-878b-284cc4cd71e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:39.751433 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ef8aeeb1-ddc2-4212-878b-284cc4cd71e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:39.752629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ef8aeeb1-ddc2-4212-878b-284cc4cd71e4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.161934 Aug 01 16:08:39.753185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1964/3592] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:39 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:40.774943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e42a32ae-049d-4603-b7d0-06364a62bdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:40.775542 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e42a32ae-049d-4603-b7d0-06364a62bdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:40.782208 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e42a32ae-049d-4603-b7d0-06364a62bdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:40.782662 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e42a32ae-049d-4603-b7d0-06364a62bdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:40.783422 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e42a32ae-049d-4603-b7d0-06364a62bdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:40.783895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e42a32ae-049d-4603-b7d0-06364a62bdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:40.921123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e42a32ae-049d-4603-b7d0-06364a62bdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:40.930505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e42a32ae-049d-4603-b7d0-06364a62bdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:40.931990 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e42a32ae-049d-4603-b7d0-06364a62bdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:40.933147 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e42a32ae-049d-4603-b7d0-06364a62bdb8 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.162106 Aug 01 16:08:40.933707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1629/3593] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:40 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:41.956861 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-1f4e4d8a-0201-4d2c-b7a0-be83337d593d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:41.957491 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-1f4e4d8a-0201-4d2c-b7a0-be83337d593d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:41.964383 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f4e4d8a-0201-4d2c-b7a0-be83337d593d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:41.964824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f4e4d8a-0201-4d2c-b7a0-be83337d593d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:41.965797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f4e4d8a-0201-4d2c-b7a0-be83337d593d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:41.966556 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-1f4e4d8a-0201-4d2c-b7a0-be83337d593d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:42.116935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1f4e4d8a-0201-4d2c-b7a0-be83337d593d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:42.125579 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1f4e4d8a-0201-4d2c-b7a0-be83337d593d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:42.127127 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-1f4e4d8a-0201-4d2c-b7a0-be83337d593d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:42.128790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-1f4e4d8a-0201-4d2c-b7a0-be83337d593d tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.176461 Aug 01 16:08:42.129359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1965/3594] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:41 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:08:43.151614 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e113f775-48f5-4f70-bdf4-4dbb06050ec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:43.152273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e113f775-48f5-4f70-bdf4-4dbb06050ec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:43.159769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e113f775-48f5-4f70-bdf4-4dbb06050ec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:43.160223 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e113f775-48f5-4f70-bdf4-4dbb06050ec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:43.160992 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e113f775-48f5-4f70-bdf4-4dbb06050ec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:43.161434 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e113f775-48f5-4f70-bdf4-4dbb06050ec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:43.291132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e113f775-48f5-4f70-bdf4-4dbb06050ec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:43.299498 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e113f775-48f5-4f70-bdf4-4dbb06050ec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:43.301192 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e113f775-48f5-4f70-bdf4-4dbb06050ec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:43.302410 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e113f775-48f5-4f70-bdf4-4dbb06050ec4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.154785 Aug 01 16:08:43.302979 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1630/3595] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:43 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:44.325124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-98eaab75-3480-40ef-9d51-f8a35c33ee17 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:44.325713 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-98eaab75-3480-40ef-9d51-f8a35c33ee17 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:44.332553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98eaab75-3480-40ef-9d51-f8a35c33ee17 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:44.333001 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98eaab75-3480-40ef-9d51-f8a35c33ee17 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:44.333773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98eaab75-3480-40ef-9d51-f8a35c33ee17 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:44.334240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-98eaab75-3480-40ef-9d51-f8a35c33ee17 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:44.470293 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-98eaab75-3480-40ef-9d51-f8a35c33ee17 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:44.479955 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-98eaab75-3480-40ef-9d51-f8a35c33ee17 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:44.481462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-98eaab75-3480-40ef-9d51-f8a35c33ee17 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:44.482674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-98eaab75-3480-40ef-9d51-f8a35c33ee17 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.161640 Aug 01 16:08:44.483237 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1966/3596] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:44 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:45.505299 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2f629e25-1eea-4c31-8787-12108ce96909 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:45.505913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2f629e25-1eea-4c31-8787-12108ce96909 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:45.512446 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f629e25-1eea-4c31-8787-12108ce96909 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:45.512891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f629e25-1eea-4c31-8787-12108ce96909 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:45.513651 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f629e25-1eea-4c31-8787-12108ce96909 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:45.514127 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2f629e25-1eea-4c31-8787-12108ce96909 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:45.648216 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2f629e25-1eea-4c31-8787-12108ce96909 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:45.660546 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2f629e25-1eea-4c31-8787-12108ce96909 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:45.663489 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2f629e25-1eea-4c31-8787-12108ce96909 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:45.664853 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2f629e25-1eea-4c31-8787-12108ce96909 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.164082 Aug 01 16:08:45.665817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1631/3597] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:45 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:46.688344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8de68ecc-324f-43a0-8792-021f477d0596 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:46.688948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8de68ecc-324f-43a0-8792-021f477d0596 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:46.696192 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8de68ecc-324f-43a0-8792-021f477d0596 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:46.696651 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8de68ecc-324f-43a0-8792-021f477d0596 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:46.697537 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8de68ecc-324f-43a0-8792-021f477d0596 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:46.697864 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8de68ecc-324f-43a0-8792-021f477d0596 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:46.829656 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8de68ecc-324f-43a0-8792-021f477d0596 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:46.838308 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8de68ecc-324f-43a0-8792-021f477d0596 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:46.839822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8de68ecc-324f-43a0-8792-021f477d0596 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:46.840987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8de68ecc-324f-43a0-8792-021f477d0596 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.156572 Aug 01 16:08:46.841553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1967/3598] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:46 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:47.864388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fdfcac55-1d25-46dd-9f58-a379adefa45f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:47.865768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fdfcac55-1d25-46dd-9f58-a379adefa45f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:47.872466 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdfcac55-1d25-46dd-9f58-a379adefa45f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:47.872903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdfcac55-1d25-46dd-9f58-a379adefa45f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:47.873669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdfcac55-1d25-46dd-9f58-a379adefa45f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:47.874130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fdfcac55-1d25-46dd-9f58-a379adefa45f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:48.012168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fdfcac55-1d25-46dd-9f58-a379adefa45f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:48.020519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fdfcac55-1d25-46dd-9f58-a379adefa45f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:48.022027 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-fdfcac55-1d25-46dd-9f58-a379adefa45f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:48.023184 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fdfcac55-1d25-46dd-9f58-a379adefa45f tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.162989 Aug 01 16:08:48.023744 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1632/3599] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:47 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:49.046778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cce98904-92ef-401f-9449-51aa53055ab2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:49.047377 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cce98904-92ef-401f-9449-51aa53055ab2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:49.054801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cce98904-92ef-401f-9449-51aa53055ab2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:49.055243 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cce98904-92ef-401f-9449-51aa53055ab2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:49.056009 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cce98904-92ef-401f-9449-51aa53055ab2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:49.056442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cce98904-92ef-401f-9449-51aa53055ab2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:49.192428 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cce98904-92ef-401f-9449-51aa53055ab2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:49.201440 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cce98904-92ef-401f-9449-51aa53055ab2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:49.202975 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cce98904-92ef-401f-9449-51aa53055ab2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:49.204133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cce98904-92ef-401f-9449-51aa53055ab2 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.161307 Aug 01 16:08:49.204690 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1968/3600] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:49 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:50.226062 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4711b14a-88b2-4303-801a-b22d30ab78be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:50.226663 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4711b14a-88b2-4303-801a-b22d30ab78be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:50.233347 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4711b14a-88b2-4303-801a-b22d30ab78be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:50.233796 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4711b14a-88b2-4303-801a-b22d30ab78be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:50.234695 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4711b14a-88b2-4303-801a-b22d30ab78be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:50.235044 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4711b14a-88b2-4303-801a-b22d30ab78be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:50.371624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4711b14a-88b2-4303-801a-b22d30ab78be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:50.381585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4711b14a-88b2-4303-801a-b22d30ab78be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:50.383146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4711b14a-88b2-4303-801a-b22d30ab78be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:50.384313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4711b14a-88b2-4303-801a-b22d30ab78be tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.162275 Aug 01 16:08:50.384871 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1633/3601] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:50 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:51.407474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5700a384-d2b7-4e05-8aa0-39d8e6f876d4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:51.408099 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5700a384-d2b7-4e05-8aa0-39d8e6f876d4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:51.415264 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5700a384-d2b7-4e05-8aa0-39d8e6f876d4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:51.415706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5700a384-d2b7-4e05-8aa0-39d8e6f876d4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:51.416462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5700a384-d2b7-4e05-8aa0-39d8e6f876d4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:51.416908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5700a384-d2b7-4e05-8aa0-39d8e6f876d4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:51.550479 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5700a384-d2b7-4e05-8aa0-39d8e6f876d4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:51.558843 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5700a384-d2b7-4e05-8aa0-39d8e6f876d4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:51.560406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5700a384-d2b7-4e05-8aa0-39d8e6f876d4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:51.561560 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5700a384-d2b7-4e05-8aa0-39d8e6f876d4 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.158001 Aug 01 16:08:51.562157 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1969/3602] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:51 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:52.585398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5e1c5055-6518-4421-9f25-fc8ac5c27635 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:52.586121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5e1c5055-6518-4421-9f25-fc8ac5c27635 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:52.593023 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e1c5055-6518-4421-9f25-fc8ac5c27635 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:52.593551 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e1c5055-6518-4421-9f25-fc8ac5c27635 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:52.594315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e1c5055-6518-4421-9f25-fc8ac5c27635 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:52.594761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5e1c5055-6518-4421-9f25-fc8ac5c27635 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:52.739446 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5e1c5055-6518-4421-9f25-fc8ac5c27635 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:52.754844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5e1c5055-6518-4421-9f25-fc8ac5c27635 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:52.756352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5e1c5055-6518-4421-9f25-fc8ac5c27635 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:52.757534 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5e1c5055-6518-4421-9f25-fc8ac5c27635 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.176723 Aug 01 16:08:52.758126 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1634/3603] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:52 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:53.780745 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2eb631de-c1a6-4d8b-ac52-1e6f868492d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:53.781302 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2eb631de-c1a6-4d8b-ac52-1e6f868492d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:53.783172 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=26 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:08:53.789340 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2eb631de-c1a6-4d8b-ac52-1e6f868492d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:53.789783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2eb631de-c1a6-4d8b-ac52-1e6f868492d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:53.790649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2eb631de-c1a6-4d8b-ac52-1e6f868492d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:53.790999 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2eb631de-c1a6-4d8b-ac52-1e6f868492d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:53.793831 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=78 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:08:53.924773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2eb631de-c1a6-4d8b-ac52-1e6f868492d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:53.933387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2eb631de-c1a6-4d8b-ac52-1e6f868492d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:53.934923 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2eb631de-c1a6-4d8b-ac52-1e6f868492d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:53.936102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2eb631de-c1a6-4d8b-ac52-1e6f868492d0 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1683 microversion: 2.20 time: 0.159536 Aug 01 16:08:53.936674 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1970/3604] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:53 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:54.958794 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-384def86-94ae-4b05-9b54-0f9ea655f98c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:54.959430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-384def86-94ae-4b05-9b54-0f9ea655f98c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:54.962067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=26 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:08:54.968045 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-384def86-94ae-4b05-9b54-0f9ea655f98c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:54.968768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-384def86-94ae-4b05-9b54-0f9ea655f98c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:54.969549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-384def86-94ae-4b05-9b54-0f9ea655f98c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:54.970157 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-384def86-94ae-4b05-9b54-0f9ea655f98c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:54.975345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=78 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:08:55.133812 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-384def86-94ae-4b05-9b54-0f9ea655f98c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:55.143959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-384def86-94ae-4b05-9b54-0f9ea655f98c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:55.145837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-384def86-94ae-4b05-9b54-0f9ea655f98c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:55.147175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-384def86-94ae-4b05-9b54-0f9ea655f98c tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1605 microversion: 2.20 time: 0.192827 Aug 01 16:08:55.163758 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1635/3605] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:54 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1605 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:55.756289 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-25a0f645-8d4f-4588-8df9-fdc4d4987dc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:55.756926 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-25a0f645-8d4f-4588-8df9-fdc4d4987dc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:55.771681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-25a0f645-8d4f-4588-8df9-fdc4d4987dc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:55.774483 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-25a0f645-8d4f-4588-8df9-fdc4d4987dc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:55.775500 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-25a0f645-8d4f-4588-8df9-fdc4d4987dc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:55.776055 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-25a0f645-8d4f-4588-8df9-fdc4d4987dc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:55.794574 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-25a0f645-8d4f-4588-8df9-fdc4d4987dc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] HTTP exception thrown: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-25a0f645-8d4f-4588-8df9-fdc4d4987dc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Request method failure captured: Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: DELETE /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 HTTP/1.1 Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_Jxd-2ufNMN6bINeUmVCl_C9neMK8VdVzqFhqxrGaNIW-B6K_BKgRY4QYs-OcVvyfk27GiPKwGgK9Vq2wAaDj7GUJJEXHP3a9XGW-l3GNaaACveTa98UrKY44ovMddLQPKJR39OU0WJEqLcH2PIF975xCsK1INaNMVRtS4ciRy7eWQ Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:08:55.796183 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:08:55.798252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}] Aug 01 16:08:55.798252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:55.798252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:08:55.798252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:55.798252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:08:55.798252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:08:55.798252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:08:55.798252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: 4001e8ec57b34f57aae1654fad9217f8 Aug 01 16:08:55.798252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:08:55.798252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 16:08:55.798252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:08:55.798252 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': 'c6e9f2d5-3104-4eec-aa3b-2fc8e8956479'} Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:08:55.799809 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:08:55.801573 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.805062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-25a0f645-8d4f-4588-8df9-fdc4d4987dc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Returning 404 to user: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:08:55.805062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-25a0f645-8d4f-4588-8df9-fdc4d4987dc7 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 404 len: 111 microversion: 2.1 time: 0.046407 Aug 01 16:08:55.805062 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1971/3606] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:08:55 2022] DELETE /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:08:55.806710 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9a8f9873-c760-4c78-ab5e-e8f592a0c48a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:55.807345 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9a8f9873-c760-4c78-ab5e-e8f592a0c48a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: c6e9f2d5-3104-4eec-aa3b-2fc8e8956479] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:55.813802 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9a8f9873-c760-4c78-ab5e-e8f592a0c48a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:55.814165 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9a8f9873-c760-4c78-ab5e-e8f592a0c48a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:55.815892 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9a8f9873-c760-4c78-ab5e-e8f592a0c48a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:55.816638 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9a8f9873-c760-4c78-ab5e-e8f592a0c48a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:55.834556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-9a8f9873-c760-4c78-ab5e-e8f592a0c48a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] HTTP exception thrown: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9a8f9873-c760-4c78-ab5e-e8f592a0c48a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Request method failure captured: Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 HTTP/1.1 Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_Jxd-2ufNMN6bINeUmVCl_C9neMK8VdVzqFhqxrGaNIW-B6K_BKgRY4QYs-OcVvyfk27GiPKwGgK9Vq2wAaDj7GUJJEXHP3a9XGW-l3GNaaACveTa98UrKY44ovMddLQPKJR39OU0WJEqLcH2PIF975xCsK1INaNMVRtS4ciRy7eWQ Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:08:55.836124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:08:55.837801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}] Aug 01 16:08:55.837801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:55.837801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:08:55.837801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:55.837801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:08:55.837801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:08:55.837801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:08:55.837801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 4001e8ec57b34f57aae1654fad9217f8 Aug 01 16:08:55.837801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:08:55.837801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:08:55.837801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:08:55.837801 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': 'c6e9f2d5-3104-4eec-aa3b-2fc8e8956479'} Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:08:55.839016 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. Aug 01 16:08:55.840827 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.842360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9a8f9873-c760-4c78-ab5e-e8f592a0c48a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Returning 404 to user: Instance c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:08:55.842360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9a8f9873-c760-4c78-ab5e-e8f592a0c48a tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479" status: 404 len: 111 microversion: 2.1 time: 0.034708 Aug 01 16:08:55.842360 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1636/3607] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:08:55 2022] GET /compute/v2.1/servers/c6e9f2d5-3104-4eec-aa3b-2fc8e8956479 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:08:55.848166 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3f93c815-efc7-48c5-a6b8-fca0a19fe605 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:55.849384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3f93c815-efc7-48c5-a6b8-fca0a19fe605 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:55.856279 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f93c815-efc7-48c5-a6b8-fca0a19fe605 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:55.856989 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f93c815-efc7-48c5-a6b8-fca0a19fe605 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:55.857786 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f93c815-efc7-48c5-a6b8-fca0a19fe605 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:55.858269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3f93c815-efc7-48c5-a6b8-fca0a19fe605 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:55.874283 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-3f93c815-efc7-48c5-a6b8-fca0a19fe605 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] HTTP exception thrown: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3f93c815-efc7-48c5-a6b8-fca0a19fe605 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Request method failure captured: Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: DELETE /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 HTTP/1.1 Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_Jxd-2ufNMN6bINeUmVCl_C9neMK8VdVzqFhqxrGaNIW-B6K_BKgRY4QYs-OcVvyfk27GiPKwGgK9Vq2wAaDj7GUJJEXHP3a9XGW-l3GNaaACveTa98UrKY44ovMddLQPKJR39OU0WJEqLcH2PIF975xCsK1INaNMVRtS4ciRy7eWQ Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:08:55.875910 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:08:55.878509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}] Aug 01 16:08:55.878509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:55.878509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:08:55.878509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:55.878509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:08:55.878509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:08:55.878509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:08:55.878509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: 4001e8ec57b34f57aae1654fad9217f8 Aug 01 16:08:55.878509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:08:55.878509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 16:08:55.878509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 16:08:55.878509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': 'd6675886-2e34-4d44-b8df-0d31d3b19c02'} Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:08:55.879822 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 16:08:55.881649 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.883956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3f93c815-efc7-48c5-a6b8-fca0a19fe605 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Returning 404 to user: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:08:55.883956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3f93c815-efc7-48c5-a6b8-fca0a19fe605 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 404 len: 111 microversion: 2.1 time: 0.034793 Aug 01 16:08:55.883956 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1972/3608] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:08:55 2022] DELETE /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:08:55.889287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-623faad0-74e1-4772-aa66-66beca058068 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:55.889938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-623faad0-74e1-4772-aa66-66beca058068 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: d6675886-2e34-4d44-b8df-0d31d3b19c02] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:55.897602 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-623faad0-74e1-4772-aa66-66beca058068 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:55.898111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-623faad0-74e1-4772-aa66-66beca058068 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:55.899013 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-623faad0-74e1-4772-aa66-66beca058068 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:55.899588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-623faad0-74e1-4772-aa66-66beca058068 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:55.922193 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-623faad0-74e1-4772-aa66-66beca058068 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] HTTP exception thrown: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-623faad0-74e1-4772-aa66-66beca058068 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Request method failure captured: Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 HTTP/1.1 Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_Jxd-2ufNMN6bINeUmVCl_C9neMK8VdVzqFhqxrGaNIW-B6K_BKgRY4QYs-OcVvyfk27GiPKwGgK9Vq2wAaDj7GUJJEXHP3a9XGW-l3GNaaACveTa98UrKY44ovMddLQPKJR39OU0WJEqLcH2PIF975xCsK1INaNMVRtS4ciRy7eWQ Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:08:55.927640 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:08:55.929327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}] Aug 01 16:08:55.929327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:55.929327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:08:55.929327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:55.929327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:08:55.929327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:08:55.929327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:08:55.929327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 4001e8ec57b34f57aae1654fad9217f8 Aug 01 16:08:55.929327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:08:55.929327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:08:55.929327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 16:08:55.929327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': 'd6675886-2e34-4d44-b8df-0d31d3b19c02'} Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:08:55.930311 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. Aug 01 16:08:55.931989 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:55.934873 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-623faad0-74e1-4772-aa66-66beca058068 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Returning 404 to user: Instance d6675886-2e34-4d44-b8df-0d31d3b19c02 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:08:55.936558 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-623faad0-74e1-4772-aa66-66beca058068 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02" status: 404 len: 111 microversion: 2.1 time: 0.051143 Aug 01 16:08:55.943411 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1637/3609] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:08:55 2022] GET /compute/v2.1/servers/d6675886-2e34-4d44-b8df-0d31d3b19c02 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:08:56.175635 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2a471f52-ce75-4387-bba8-b0da837273b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:56.176516 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2a471f52-ce75-4387-bba8-b0da837273b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:56.183321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a471f52-ce75-4387-bba8-b0da837273b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:56.183909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a471f52-ce75-4387-bba8-b0da837273b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:56.184753 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a471f52-ce75-4387-bba8-b0da837273b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:56.185421 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2a471f52-ce75-4387-bba8-b0da837273b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:56.337457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2a471f52-ce75-4387-bba8-b0da837273b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:56.348833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2a471f52-ce75-4387-bba8-b0da837273b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:56.350730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2a471f52-ce75-4387-bba8-b0da837273b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d1b6c388c7642a892c905d16f3b8d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829698141514a009e2e769854fe66f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:08:56.352291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2a471f52-ce75-4387-bba8-b0da837273b6 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 200 len: 1605 microversion: 2.20 time: 0.183294 Aug 01 16:08:56.353025 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1973/3610] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:56 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:08:56.818781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-f8589d50-27c6-4407-8087-82e66b6f732b req-b2af50eb-f095-47e1-b2ac-08593e122bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df", "name": "network-vif-deleted", "tag": "ce819b69-03c1-4584-9ef2-0228b13d3351"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:08:56.831611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-f8589d50-27c6-4407-8087-82e66b6f732b req-b2af50eb-f095-47e1-b2ac-08593e122bf3 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:56.832459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-f8589d50-27c6-4407-8087-82e66b6f732b req-b2af50eb-f095-47e1-b2ac-08593e122bf3 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:56.848914 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-f8589d50-27c6-4407-8087-82e66b6f732b req-b2af50eb-f095-47e1-b2ac-08593e122bf3 service nova] Creating event network-vif-deleted:ce819b69-03c1-4584-9ef2-0228b13d3351 for instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df on hv-cinder-84753 Aug 01 16:08:56.856392 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-f8589d50-27c6-4407-8087-82e66b6f732b req-b2af50eb-f095-47e1-b2ac-08593e122bf3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310306 Aug 01 16:08:56.858181 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1638/3611] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:08:57.217733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-413380bc-996a-4e38-9c36-04419ab47888 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:57.218673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-413380bc-996a-4e38-9c36-04419ab47888 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:57.227445 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-413380bc-996a-4e38-9c36-04419ab47888 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:57.228121 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-413380bc-996a-4e38-9c36-04419ab47888 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:57.229331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-413380bc-996a-4e38-9c36-04419ab47888 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:57.229855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-413380bc-996a-4e38-9c36-04419ab47888 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:57.255201 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-413380bc-996a-4e38-9c36-04419ab47888 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] HTTP exception thrown: Instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 could not be found. Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-413380bc-996a-4e38-9c36-04419ab47888 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Request method failure captured: Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: DELETE /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 HTTP/1.1 Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_Jxd-2ufNMN6bINeUmVCl_C9neMK8VdVzqFhqxrGaNIW-B6K_BKgRY4QYs-OcVvyfk27GiPKwGgK9Vq2wAaDj7GUJJEXHP3a9XGW-l3GNaaACveTa98UrKY44ovMddLQPKJR39OU0WJEqLcH2PIF975xCsK1INaNMVRtS4ciRy7eWQ Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:08:57.257297 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:08:57.258913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}] Aug 01 16:08:57.258913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:57.258913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:08:57.258913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:57.258913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:08:57.258913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:08:57.258913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:08:57.258913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 4001e8ec57b34f57aae1654fad9217f8 Aug 01 16:08:57.258913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:08:57.258913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:08:57.258913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 could not be found. Aug 01 16:08:57.258913 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '2122c9a8-db75-40b5-bbbe-9c83c983d961'} Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 could not be found. Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:08:57.259940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 could not be found. Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 could not be found. Aug 01 16:08:57.261363 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.266415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-413380bc-996a-4e38-9c36-04419ab47888 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Returning 404 to user: Instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:08:57.266415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-413380bc-996a-4e38-9c36-04419ab47888 tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 404 len: 111 microversion: 2.1 time: 0.047454 Aug 01 16:08:57.266415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1639/3612] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:08:57 2022] DELETE /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 16:08:57.270562 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0026433d-6c63-4f07-a669-90769a32c4cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:57.271287 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0026433d-6c63-4f07-a669-90769a32c4cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] [instance: 2122c9a8-db75-40b5-bbbe-9c83c983d961] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:57.279509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-1c4c3c2f-70c9-44ee-9458-409808b612fd req-4da9ecde-fd12-48f3-a210-23663e3ea15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93144385-4cac-4970-9814-564a351af373", "name": "network-vif-deleted", "tag": "70bc4d81-f8a1-4ace-a990-9c94674bb907"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:08:57.280330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0026433d-6c63-4f07-a669-90769a32c4cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:57.280505 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0026433d-6c63-4f07-a669-90769a32c4cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:57.281650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0026433d-6c63-4f07-a669-90769a32c4cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:57.282366 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0026433d-6c63-4f07-a669-90769a32c4cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:57.293677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-1c4c3c2f-70c9-44ee-9458-409808b612fd req-4da9ecde-fd12-48f3-a210-23663e3ea15e service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:57.294185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-1c4c3c2f-70c9-44ee-9458-409808b612fd req-4da9ecde-fd12-48f3-a210-23663e3ea15e service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:57.306388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-0026433d-6c63-4f07-a669-90769a32c4cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] HTTP exception thrown: Instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 could not be found. Aug 01 16:08:57.308273 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-1c4c3c2f-70c9-44ee-9458-409808b612fd req-4da9ecde-fd12-48f3-a210-23663e3ea15e service nova] Creating event network-vif-deleted:70bc4d81-f8a1-4ace-a990-9c94674bb907 for instance 93144385-4cac-4970-9814-564a351af373 on hv-cinder-84753 Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0026433d-6c63-4f07-a669-90769a32c4cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Request method failure captured: Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 HTTP/1.1 Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_Jxd-2ufNMN6bINeUmVCl_C9neMK8VdVzqFhqxrGaNIW-B6K_BKgRY4QYs-OcVvyfk27GiPKwGgK9Vq2wAaDj7GUJJEXHP3a9XGW-l3GNaaACveTa98UrKY44ovMddLQPKJR39OU0WJEqLcH2PIF975xCsK1INaNMVRtS4ciRy7eWQ Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:08:57.308704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:08:57.310423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ded351d7a1b4a9c8bd4901f8becfe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ded351d7a1b4a9c8bd4901f8becfe5b"}]}] Aug 01 16:08:57.310423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:57.310423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 7ded351d7a1b4a9c8bd4901f8becfe5b Aug 01 16:08:57.310423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-358638272 Aug 01 16:08:57.310423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:08:57.310423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:08:57.310423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:08:57.310423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 4001e8ec57b34f57aae1654fad9217f8 Aug 01 16:08:57.310423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeNegativeTest-358638272-project Aug 01 16:08:57.310423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:08:57.310423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 could not be found. Aug 01 16:08:57.310423 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '2122c9a8-db75-40b5-bbbe-9c83c983d961'} Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 could not be found. Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:08:57.311583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 could not be found. Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 could not be found. Aug 01 16:08:57.314433 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.317856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0026433d-6c63-4f07-a669-90769a32c4cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] Returning 404 to user: Instance 2122c9a8-db75-40b5-bbbe-9c83c983d961 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:08:57.317856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0026433d-6c63-4f07-a669-90769a32c4cc tempest-AttachVolumeNegativeTest-358638272 tempest-AttachVolumeNegativeTest-358638272-project] 10.222.0.83 "GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961" status: 404 len: 111 microversion: 2.1 time: 0.045816 Aug 01 16:08:57.317856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1640/3613] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:08:57 2022] GET /compute/v2.1/servers/2122c9a8-db75-40b5-bbbe-9c83c983d961 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:08:57.341161 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-1c4c3c2f-70c9-44ee-9458-409808b612fd req-4da9ecde-fd12-48f3-a210-23663e3ea15e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298380 Aug 01 16:08:57.356632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1974/3614] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:08:57.376197 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-75eee41b-082e-4dc3-9f49-3775c0596cf7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:08:57.376957 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-75eee41b-082e-4dc3-9f49-3775c0596cf7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] [instance: 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:08:57.387572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-75eee41b-082e-4dc3-9f49-3775c0596cf7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:57.388052 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-75eee41b-082e-4dc3-9f49-3775c0596cf7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:57.388938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-75eee41b-082e-4dc3-9f49-3775c0596cf7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:08:57.389597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-75eee41b-082e-4dc3-9f49-3775c0596cf7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:08:57.405691 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-75eee41b-082e-4dc3-9f49-3775c0596cf7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] HTTP exception thrown: Instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df could not be found. Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-75eee41b-082e-4dc3-9f49-3775c0596cf7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Request method failure captured: Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df HTTP/1.1 Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_JqCqrE9d6Rj-YKvvr1yqCsulLkWSHSQ-xUx7yqZZ0NIQRrKRdL33lIJ2-Ll2_9owvY__GsrovsVw6oTw99kqJ7zCVMDjyviYXXLNP0hgPXfcJfolBdJIqQCKkehkZPCvFusXGgSHis7oZ1rupskQbp26xOxwPe04wFccWNqkPLX74 Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: e829698141514a009e2e769854fe66f0 Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-788013046 Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:08:57.407326 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:08:57.409029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e829698141514a009e2e769854fe66f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e829698141514a009e2e769854fe66f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e829698141514a009e2e769854fe66f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e829698141514a009e2e769854fe66f0"}]}] Aug 01 16:08:57.409029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeShelveTestJSON-788013046 Aug 01 16:08:57.409029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: e829698141514a009e2e769854fe66f0 Aug 01 16:08:57.409029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-788013046 Aug 01 16:08:57.409029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeShelveTestJSON-788013046-project Aug 01 16:08:57.409029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:08:57.409029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:08:57.409029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 7d1b6c388c7642a892c905d16f3b8d50 Aug 01 16:08:57.409029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeShelveTestJSON-788013046-project Aug 01 16:08:57.409029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:08:57.409029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df could not be found. Aug 01 16:08:57.409029 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df'} Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df could not be found. Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:08:57.409932 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df could not be found. Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df could not be found. Aug 01 16:08:57.412210 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:08:57.413793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-75eee41b-082e-4dc3-9f49-3775c0596cf7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] Returning 404 to user: Instance 5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:08:57.413793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-75eee41b-082e-4dc3-9f49-3775c0596cf7 tempest-AttachVolumeShelveTestJSON-788013046 tempest-AttachVolumeShelveTestJSON-788013046-project] 10.222.0.83 "GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df" status: 404 len: 111 microversion: 2.20 time: 0.036540 Aug 01 16:08:57.413793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1641/3615] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 1 16:08:57 2022] GET /compute/v2.1/servers/5d8d8460-8a6d-4eb1-907d-6f5f4fb2e4df => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 16:09:05.324771 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-46576436-d836-454b-b49c-451cc55427bc tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] Action: 'create', calling method: .version_select at 0x7feb15ef3c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-303963318", "metadata": {"Type": "work"}}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:09:05.713981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-46576436-d836-454b-b49c-451cc55427bc tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.709516 Aug 01 16:09:05.714752 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1975/3616] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 1 16:09:04 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 720 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 01 16:09:05.729465 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-009e8570-372c-4f68-b781-baa4beaf9be2 tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] Calling method '.version_select at 0x7feb161b2670>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:05.788416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-009e8570-372c-4f68-b781-baa4beaf9be2 tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9" status: 200 len: 352 microversion: 2.1 time: 0.064539 Aug 01 16:09:05.789683 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1642/3617] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 16:09:05 2022] GET /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:09:06.807418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-0e116f2b-5881-44d4-b74d-3dd6e95f464b tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] Calling method '.version_select at 0x7feb1609dca0>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:06.865971 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-0e116f2b-5881-44d4-b74d-3dd6e95f464b tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9" status: 200 len: 353 microversion: 2.1 time: 0.064419 Aug 01 16:09:06.866553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1976/3618] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 16:09:06 2022] GET /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:09:06.880949 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c03a2557-69cf-4481-a275-342e10517b10 tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] Calling method '.version_select at 0x7feb15f508b0>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:06.937789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c03a2557-69cf-4481-a275-342e10517b10 tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9" status: 200 len: 353 microversion: 2.1 time: 0.062117 Aug 01 16:09:06.938430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1643/3619] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 16:09:06 2022] GET /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:09:06.952474 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-aeb173bf-742e-4895-880c-6063b1af4aa3 tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] Calling method '.version_select at 0x7feb1a9075e0>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:07.030717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-aeb173bf-742e-4895-880c-6063b1af4aa3 tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9" status: 202 len: 0 microversion: 2.1 time: 0.082021 Aug 01 16:09:07.031658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1977/3620] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 1 16:09:06 2022] DELETE /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:09:07.044293 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-26cfd42f-4063-497e-96d5-7a15a41c45e2 tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] Calling method '.version_select at 0x7feb15ef3e50>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:07.115717 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-26cfd42f-4063-497e-96d5-7a15a41c45e2 tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9" status: 200 len: 352 microversion: 2.1 time: 0.079129 Aug 01 16:09:07.116416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1644/3621] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 16:09:07 2022] GET /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9 => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:09:08.132102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-09f2bda8-789e-482c-82ff-0361637aac3d tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] Calling method '.version_select at 0x7feb1609d160>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:08.142029 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=9 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:09:08.143683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=17 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:09:08.180963 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-09f2bda8-789e-482c-82ff-0361637aac3d tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] HTTP exception thrown: Volume 045df465-dd68-4a90-9620-4b75fbadd4d9 could not be found. Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-09f2bda8-789e-482c-82ff-0361637aac3d tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] Request method failure captured: Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9 HTTP/1.1 Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_qgt3OaewVi7DDl_61i8WFW_8JB83mRStTqhBRbmSiizRcRWV4Li8TWDyt3mt-8bTTihANBGNin3cAVWwb9VPOMlKG_8KpLVVLI_XpI1UdjwfK9clH93Hzd9hPxobpLDx2ugY1qwAbjLcM7n1piSx1l8zeJm9d3nteEgg5475XiZj8 Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 50802b0f362042ef982dcfb1ef5c3744 Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-VolumesGetTestJSON-457194349 Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:09:08.185258 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/50802b0f362042ef982dcfb1ef5c3744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/50802b0f362042ef982dcfb1ef5c3744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_50802b0f362042ef982dcfb1ef5c3744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/50802b0f362042ef982dcfb1ef5c3744"}]}] Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-VolumesGetTestJSON-457194349 Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 50802b0f362042ef982dcfb1ef5c3744 Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-VolumesGetTestJSON-457194349 Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-VolumesGetTestJSON-457194349-project Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: fbba690216b249e6a0791e8e1bba6983 Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-VolumesGetTestJSON-457194349-project Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Volume 045df465-dd68-4a90-9620-4b75fbadd4d9 could not be found. Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': '045df465-dd68-4a90-9620-4b75fbadd4d9'} Aug 01 16:09:08.187242 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 045df465-dd68-4a90-9620-4b75fbadd4d9 could not be found. (HTTP 404) (Request-ID: req-73d31787-3d24-4d23-82a0-1083a5002270) Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:09:08.189250 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:09:08.191652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 045df465-dd68-4a90-9620-4b75fbadd4d9 could not be found. Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 16:09:08.194122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 045df465-dd68-4a90-9620-4b75fbadd4d9 could not be found. Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 045df465-dd68-4a90-9620-4b75fbadd4d9 could not be found. Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-09f2bda8-789e-482c-82ff-0361637aac3d tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] Returning 404 to user: Volume 045df465-dd68-4a90-9620-4b75fbadd4d9 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-09f2bda8-789e-482c-82ff-0361637aac3d tempest-VolumesGetTestJSON-457194349 tempest-VolumesGetTestJSON-457194349-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9" status: 404 len: 109 microversion: 2.1 time: 0.061776 Aug 01 16:09:08.195929 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1978/3622] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 16:09:08 2022] GET /compute/v2.1/os-volumes/045df465-dd68-4a90-9620-4b75fbadd4d9 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 16:09:11.653854 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=13 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:09:11.654697 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=17 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:09:11.659334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8f1079cf-7e05-43c1-bd12-21c558836e3c tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] Calling method '.version_select at 0x7feb15ef3550>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:11.713628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8f1079cf-7e05-43c1-bd12-21c558836e3c tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/a0f49efc-1f8b-4175-a576-0990f7708f94" status: 200 len: 350 microversion: 2.1 time: 0.060409 Aug 01 16:09:11.720067 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1645/3623] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 16:09:11 2022] GET /compute/v2.1/os-volumes/a0f49efc-1f8b-4175-a576-0990f7708f94 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:09:17.329204 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f354d514-d4a1-402f-8a81-ed7ea0adfff5 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] Calling method '.version_select at 0x7feb1618c820>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:17.391449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f354d514-d4a1-402f-8a81-ed7ea0adfff5 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/74b60646-d8fe-4ae7-b66c-251523d003c5" status: 200 len: 351 microversion: 2.1 time: 0.067044 Aug 01 16:09:17.392155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1979/3624] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 16:09:17 2022] GET /compute/v2.1/os-volumes/74b60646-d8fe-4ae7-b66c-251523d003c5 => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:09:21.947994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-37e1fe98-93a3-432d-93e3-722cc412aab4 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] Calling method '.version_select at 0x7feb15f50940>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:22.008190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-37e1fe98-93a3-432d-93e3-722cc412aab4 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/602a6b38-0b11-4c47-a947-a6f19d22339c" status: 200 len: 351 microversion: 2.1 time: 0.064031 Aug 01 16:09:22.008190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1646/3625] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 1 16:09:21 2022] GET /compute/v2.1/os-volumes/602a6b38-0b11-4c47-a947-a6f19d22339c => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:09:22.022661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-88e94652-710d-4e4b-aa77-198afeb58ef2 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] Calling method '.version_select at 0x7feb1a8b2430>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:22.117522 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-88e94652-710d-4e4b-aa77-198afeb58ef2 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.100162 Aug 01 16:09:22.118296 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1980/3626] 10.222.0.83 () {58 vars in 1134 bytes} [Mon Aug 1 16:09:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:09:22.132598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-46d49adf-db0b-43f1-bd98-182ff8355069 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] Calling method '.version_select at 0x7feb15f50700>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:22.221168 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-46d49adf-db0b-43f1-bd98-182ff8355069 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.092450 Aug 01 16:09:22.221731 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1647/3627] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 1 16:09:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:09:22.235774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ef256efe-3257-4247-9f22-9a0f7cdb88c1 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] Calling method '.version_select at 0x7feb1a9079d0>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:22.332501 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ef256efe-3257-4247-9f22-9a0f7cdb88c1 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.100428 Aug 01 16:09:22.333077 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1981/3628] 10.222.0.83 () {58 vars in 1134 bytes} [Mon Aug 1 16:09:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:09:22.346854 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b5a4ab51-735c-466f-9ccd-783fc5c466ee tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] Calling method '.version_select at 0x7feb1634aaf0>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:22.431321 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b5a4ab51-735c-466f-9ccd-783fc5c466ee tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089117 Aug 01 16:09:22.431895 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1648/3629] 10.222.0.83 () {58 vars in 1167 bytes} [Mon Aug 1 16:09:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:09:22.447291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-50383e52-ab19-4b0b-8e44-b2d7db807cdc tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] Calling method '.version_select at 0x7feb1a9074c0>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:22.533987 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-50383e52-ab19-4b0b-8e44-b2d7db807cdc tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.091598 Aug 01 16:09:22.534560 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1982/3630] 10.222.0.83 () {58 vars in 1170 bytes} [Mon Aug 1 16:09:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:09:22.550278 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-30535300-67c6-4254-8fd9-3c13da9c92e6 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] Calling method '.version_select at 0x7feb15f03ee0>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:22.642473 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-30535300-67c6-4254-8fd9-3c13da9c92e6 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.096433 Aug 01 16:09:22.643047 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1649/3631] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 1 16:09:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:09:22.656512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-9b993fcd-94e8-4be7-84b7-0f9546b9fa29 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] Calling method '.version_select at 0x7feb1a917a60>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:22.743655 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-9b993fcd-94e8-4be7-84b7-0f9546b9fa29 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091217 Aug 01 16:09:22.744227 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1983/3632] 10.222.0.83 () {58 vars in 1188 bytes} [Mon Aug 1 16:09:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:09:22.759998 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-db276221-1a16-43fa-a58e-30cf589651c1 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] Calling method '.version_select at 0x7feb174c29d0>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:09:22.856292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-db276221-1a16-43fa-a58e-30cf589651c1 tempest-VolumesTestJSON-183242662 tempest-VolumesTestJSON-183242662-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.101038 Aug 01 16:09:22.856861 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1650/3633] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 1 16:09:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:00.581000 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1282043776", "imageRef": "f5fbd3ac-a103-48c4-9e68-c4119e69bf9d", "flavorRef": "452"}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:10:00.640290 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.network.neutron [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] validate_networks() for None {{(pid=124526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:10:00.950921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Flavor limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:10:00.951357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Image limits 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:10:00.952040 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Flavor pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:10:00.952718 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Image pref 0:0:0 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:10:00.953136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.virt.hardware [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:10:00.962686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:00.963141 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:00.963941 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:00.964382 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:00.984155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Getting quotas for project 53f9adda77ff445b8eecd09fa7184530. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:10:00.989122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Getting quotas for user 1026208ad63143f589f05818ce082174 and project 53f9adda77ff445b8eecd09fa7184530. Resources: {'ram', 'instances', 'cores'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:10:01.003027 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Going to run 1 instances... {{(pid=124526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:10:01.006119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fbd3ac-a103-48c4-9e68-c4119e69bf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:10:01.060443 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-a8a4a060-55d2-4663-a42b-ed9aec2fc512 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.484699 Aug 01 16:10:01.061944 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1984/3634] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 16:10:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:10:01.077581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a34faa36-8d29-4e1e-80e0-aa1b6c39fbaa tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:01.078915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a34faa36-8d29-4e1e-80e0-aa1b6c39fbaa tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:01.175243 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a34faa36-8d29-4e1e-80e0-aa1b6c39fbaa tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:01.183357 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a34faa36-8d29-4e1e-80e0-aa1b6c39fbaa tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1215 microversion: 2.1 time: 0.112581 Aug 01 16:10:01.183938 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1651/3635] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:01 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:10:02.206997 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-48ca4296-8128-41eb-957a-c770d2f8bc43 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:02.207777 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-48ca4296-8128-41eb-957a-c770d2f8bc43 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:02.214039 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48ca4296-8128-41eb-957a-c770d2f8bc43 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:02.214484 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48ca4296-8128-41eb-957a-c770d2f8bc43 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:02.215245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48ca4296-8128-41eb-957a-c770d2f8bc43 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:02.215679 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-48ca4296-8128-41eb-957a-c770d2f8bc43 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:02.285676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-48ca4296-8128-41eb-957a-c770d2f8bc43 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:02.293685 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-48ca4296-8128-41eb-957a-c770d2f8bc43 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1267 microversion: 2.1 time: 0.091556 Aug 01 16:10:02.294294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1985/3636] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:02 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:03.316047 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e394edce-b004-4eb3-97ba-384d3596a86c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:03.317397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e394edce-b004-4eb3-97ba-384d3596a86c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:03.326310 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e394edce-b004-4eb3-97ba-384d3596a86c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:03.326769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e394edce-b004-4eb3-97ba-384d3596a86c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:03.328504 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e394edce-b004-4eb3-97ba-384d3596a86c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:03.328928 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e394edce-b004-4eb3-97ba-384d3596a86c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:03.546377 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e394edce-b004-4eb3-97ba-384d3596a86c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:03.555703 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e394edce-b004-4eb3-97ba-384d3596a86c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1315 microversion: 2.1 time: 0.243570 Aug 01 16:10:03.556657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1652/3637] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:03 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:04.099331 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-2f2f02ea-fcba-4694-a1b8-3dd561c62c4f req-61a50045-1e47-450a-969d-0d76decc1575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e2f270-c0ce-4a19-924a-4fdaeceb3b1f", "tag": "a90d63e8-bc35-4574-998c-d9aa9368e364"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:10:04.110683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-2f2f02ea-fcba-4694-a1b8-3dd561c62c4f req-61a50045-1e47-450a-969d-0d76decc1575 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:04.111185 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-2f2f02ea-fcba-4694-a1b8-3dd561c62c4f req-61a50045-1e47-450a-969d-0d76decc1575 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:04.123686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-2f2f02ea-fcba-4694-a1b8-3dd561c62c4f req-61a50045-1e47-450a-969d-0d76decc1575 service nova] Creating event network-changed:a90d63e8-bc35-4574-998c-d9aa9368e364 for instance 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f on hv-cinder-84753 Aug 01 16:10:04.131844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-2f2f02ea-fcba-4694-a1b8-3dd561c62c4f req-61a50045-1e47-450a-969d-0d76decc1575 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036752 Aug 01 16:10:04.132458 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1986/3638] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:10:04.578435 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-94d21d30-6f6c-48ae-8f3e-89b731dfcada tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:04.579175 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-94d21d30-6f6c-48ae-8f3e-89b731dfcada tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:04.587149 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94d21d30-6f6c-48ae-8f3e-89b731dfcada tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:04.587686 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94d21d30-6f6c-48ae-8f3e-89b731dfcada tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:04.588688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94d21d30-6f6c-48ae-8f3e-89b731dfcada tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:04.589195 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-94d21d30-6f6c-48ae-8f3e-89b731dfcada tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:04.731688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-94d21d30-6f6c-48ae-8f3e-89b731dfcada tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:04.742500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-94d21d30-6f6c-48ae-8f3e-89b731dfcada tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1315 microversion: 2.1 time: 0.168324 Aug 01 16:10:04.743395 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1653/3639] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:04 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:05.765994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-489f3edb-b3f2-49c9-a693-7ac671273472 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:05.766731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-489f3edb-b3f2-49c9-a693-7ac671273472 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:05.773423 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-489f3edb-b3f2-49c9-a693-7ac671273472 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:05.773873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-489f3edb-b3f2-49c9-a693-7ac671273472 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:05.774677 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-489f3edb-b3f2-49c9-a693-7ac671273472 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:05.775115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-489f3edb-b3f2-49c9-a693-7ac671273472 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:05.917694 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-489f3edb-b3f2-49c9-a693-7ac671273472 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:05.926199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-489f3edb-b3f2-49c9-a693-7ac671273472 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1315 microversion: 2.1 time: 0.164877 Aug 01 16:10:05.926783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1987/3640] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:05 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:06.947605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a36cc541-8a4b-4776-a1e0-8070411ad439 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:06.948219 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a36cc541-8a4b-4776-a1e0-8070411ad439 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:06.954924 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a36cc541-8a4b-4776-a1e0-8070411ad439 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:06.955371 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a36cc541-8a4b-4776-a1e0-8070411ad439 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:06.956182 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a36cc541-8a4b-4776-a1e0-8070411ad439 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:06.956650 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a36cc541-8a4b-4776-a1e0-8070411ad439 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:07.095587 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a36cc541-8a4b-4776-a1e0-8070411ad439 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:07.105294 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a36cc541-8a4b-4776-a1e0-8070411ad439 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1315 microversion: 2.1 time: 0.161524 Aug 01 16:10:07.105900 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1654/3641] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:06 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:08.127371 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ce7caaef-c194-42c1-8202-933abe78ff41 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:08.127990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ce7caaef-c194-42c1-8202-933abe78ff41 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:08.135276 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce7caaef-c194-42c1-8202-933abe78ff41 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:08.135727 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce7caaef-c194-42c1-8202-933abe78ff41 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:08.136509 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce7caaef-c194-42c1-8202-933abe78ff41 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:08.136948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce7caaef-c194-42c1-8202-933abe78ff41 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:08.275399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ce7caaef-c194-42c1-8202-933abe78ff41 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:08.283412 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ce7caaef-c194-42c1-8202-933abe78ff41 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1315 microversion: 2.1 time: 0.159987 Aug 01 16:10:08.284004 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1988/3642] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:08 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:09.306959 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c5f72ded-f734-4729-a15d-01382e89daca tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:09.307632 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c5f72ded-f734-4729-a15d-01382e89daca tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:09.314253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5f72ded-f734-4729-a15d-01382e89daca tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:09.314707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5f72ded-f734-4729-a15d-01382e89daca tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:09.315484 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5f72ded-f734-4729-a15d-01382e89daca tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:09.315983 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c5f72ded-f734-4729-a15d-01382e89daca tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:09.524657 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c5f72ded-f734-4729-a15d-01382e89daca tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:09.532543 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c5f72ded-f734-4729-a15d-01382e89daca tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1315 microversion: 2.1 time: 0.229347 Aug 01 16:10:09.533454 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1655/3643] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:09 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:10.555327 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fd5d8e83-8edb-4a0c-9609-b54c8d5ecec8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:10.555911 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fd5d8e83-8edb-4a0c-9609-b54c8d5ecec8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:10.562654 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd5d8e83-8edb-4a0c-9609-b54c8d5ecec8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:10.563100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd5d8e83-8edb-4a0c-9609-b54c8d5ecec8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:10.563865 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd5d8e83-8edb-4a0c-9609-b54c8d5ecec8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:10.564291 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fd5d8e83-8edb-4a0c-9609-b54c8d5ecec8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:10.703629 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fd5d8e83-8edb-4a0c-9609-b54c8d5ecec8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:10.711306 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fd5d8e83-8edb-4a0c-9609-b54c8d5ecec8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1315 microversion: 2.1 time: 0.160832 Aug 01 16:10:10.711893 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1989/3644] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:10 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:11.731610 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9ea33ac9-b076-4f54-b6a1-98ce8d10e867 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:11.732233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9ea33ac9-b076-4f54-b6a1-98ce8d10e867 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:11.734785 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=2 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:10:11.741077 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ea33ac9-b076-4f54-b6a1-98ce8d10e867 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:11.741525 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ea33ac9-b076-4f54-b6a1-98ce8d10e867 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:11.742323 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ea33ac9-b076-4f54-b6a1-98ce8d10e867 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:11.742768 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9ea33ac9-b076-4f54-b6a1-98ce8d10e867 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:11.898821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9ea33ac9-b076-4f54-b6a1-98ce8d10e867 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:11.907313 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9ea33ac9-b076-4f54-b6a1-98ce8d10e867 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1315 microversion: 2.1 time: 0.179477 Aug 01 16:10:11.907993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1656/3645] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:11 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:12.928789 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2ac8914b-81a2-47b5-9fba-c1f7ee4cffed tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:12.929431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2ac8914b-81a2-47b5-9fba-c1f7ee4cffed tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:12.931468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=2 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:10:12.932124 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=6 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:10:12.938406 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ac8914b-81a2-47b5-9fba-c1f7ee4cffed tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:12.938853 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ac8914b-81a2-47b5-9fba-c1f7ee4cffed tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:12.939621 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ac8914b-81a2-47b5-9fba-c1f7ee4cffed tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:12.940049 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2ac8914b-81a2-47b5-9fba-c1f7ee4cffed tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:13.082993 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2ac8914b-81a2-47b5-9fba-c1f7ee4cffed tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:13.090498 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2ac8914b-81a2-47b5-9fba-c1f7ee4cffed tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1315 microversion: 2.1 time: 0.165677 Aug 01 16:10:13.091075 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1990/3646] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:12 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:14.110677 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0e8e54b9-0293-4371-8069-496eba3f10db tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:14.111344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0e8e54b9-0293-4371-8069-496eba3f10db tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:14.119003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e8e54b9-0293-4371-8069-496eba3f10db tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:14.119459 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e8e54b9-0293-4371-8069-496eba3f10db tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:14.120233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e8e54b9-0293-4371-8069-496eba3f10db tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:14.120671 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0e8e54b9-0293-4371-8069-496eba3f10db tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:14.258872 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0e8e54b9-0293-4371-8069-496eba3f10db tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:14.266723 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0e8e54b9-0293-4371-8069-496eba3f10db tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1315 microversion: 2.1 time: 0.159843 Aug 01 16:10:14.267291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1657/3647] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:14 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:15.287920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c97edf78-d21d-44a9-9125-b2b4f49ca66b tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:15.288541 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c97edf78-d21d-44a9-9125-b2b4f49ca66b tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:15.295512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c97edf78-d21d-44a9-9125-b2b4f49ca66b tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:15.295958 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c97edf78-d21d-44a9-9125-b2b4f49ca66b tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:15.296740 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c97edf78-d21d-44a9-9125-b2b4f49ca66b tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:15.297176 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c97edf78-d21d-44a9-9125-b2b4f49ca66b tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:15.438360 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c97edf78-d21d-44a9-9125-b2b4f49ca66b tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:15.447207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c97edf78-d21d-44a9-9125-b2b4f49ca66b tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1315 microversion: 2.1 time: 0.163112 Aug 01 16:10:15.447841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1991/3648] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:15 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:15.673615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-4d03d2b2-9df5-4536-9d05-cf38bc92c1f8 req-0596492f-2172-4867-be5b-2ce7f8308dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e2f270-c0ce-4a19-924a-4fdaeceb3b1f", "name": "network-vif-plugged", "status": "completed", "tag": "a90d63e8-bc35-4574-998c-d9aa9368e364"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:10:15.685497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-4d03d2b2-9df5-4536-9d05-cf38bc92c1f8 req-0596492f-2172-4867-be5b-2ce7f8308dd2 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:15.685976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-4d03d2b2-9df5-4536-9d05-cf38bc92c1f8 req-0596492f-2172-4867-be5b-2ce7f8308dd2 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:15.698628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-4d03d2b2-9df5-4536-9d05-cf38bc92c1f8 req-0596492f-2172-4867-be5b-2ce7f8308dd2 service nova] Creating event network-vif-plugged:a90d63e8-bc35-4574-998c-d9aa9368e364 for instance 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f on hv-cinder-84753 Aug 01 16:10:15.703711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-4d03d2b2-9df5-4536-9d05-cf38bc92c1f8 req-0596492f-2172-4867-be5b-2ce7f8308dd2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193346 Aug 01 16:10:15.704556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1658/3649] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:10:16.469164 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-95cab5b0-a614-427c-bde3-3b7a35fbc9b1 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:16.469772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-95cab5b0-a614-427c-bde3-3b7a35fbc9b1 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:16.477118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-95cab5b0-a614-427c-bde3-3b7a35fbc9b1 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:16.477570 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-95cab5b0-a614-427c-bde3-3b7a35fbc9b1 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:16.478374 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-95cab5b0-a614-427c-bde3-3b7a35fbc9b1 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:16.478804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-95cab5b0-a614-427c-bde3-3b7a35fbc9b1 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:16.651338 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-95cab5b0-a614-427c-bde3-3b7a35fbc9b1 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:16.659652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-95cab5b0-a614-427c-bde3-3b7a35fbc9b1 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1315 microversion: 2.1 time: 0.194075 Aug 01 16:10:16.660716 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1992/3650] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:16 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:17.691893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d070d06a-f4bd-4426-afc4-7d6702bb509d tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:17.691893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d070d06a-f4bd-4426-afc4-7d6702bb509d tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:17.691893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d070d06a-f4bd-4426-afc4-7d6702bb509d tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:17.691893 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d070d06a-f4bd-4426-afc4-7d6702bb509d tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:17.692960 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d070d06a-f4bd-4426-afc4-7d6702bb509d tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:17.692960 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d070d06a-f4bd-4426-afc4-7d6702bb509d tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:17.845761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d070d06a-f4bd-4426-afc4-7d6702bb509d tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:17.854038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d070d06a-f4bd-4426-afc4-7d6702bb509d tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1464 microversion: 2.1 time: 0.176300 Aug 01 16:10:17.854615 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1659/3651] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:17 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1464 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:17.900623 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3ba9aaae-d554-48de-88b8-0d432ae6e070 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:17.901109 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3ba9aaae-d554-48de-88b8-0d432ae6e070 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:17.912220 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3ba9aaae-d554-48de-88b8-0d432ae6e070 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:17.912672 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3ba9aaae-d554-48de-88b8-0d432ae6e070 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:17.913459 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3ba9aaae-d554-48de-88b8-0d432ae6e070 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:17.913916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3ba9aaae-d554-48de-88b8-0d432ae6e070 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:17.942779 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3ba9aaae-d554-48de-88b8-0d432ae6e070 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:10:18.033419 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3ba9aaae-d554-48de-88b8-0d432ae6e070 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "DELETE /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 204 len: 0 microversion: 2.1 time: 0.136241 Aug 01 16:10:18.034353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1993/3652] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:10:17 2022] DELETE /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:10:18.044742 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-51fcb0a7-48fd-4911-a4c0-6799e686e294 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:18.045341 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-51fcb0a7-48fd-4911-a4c0-6799e686e294 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:18.061984 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-51fcb0a7-48fd-4911-a4c0-6799e686e294 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:18.062353 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-51fcb0a7-48fd-4911-a4c0-6799e686e294 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:18.063137 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-51fcb0a7-48fd-4911-a4c0-6799e686e294 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:18.063572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-51fcb0a7-48fd-4911-a4c0-6799e686e294 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:18.221019 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-51fcb0a7-48fd-4911-a4c0-6799e686e294 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:18.229746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-51fcb0a7-48fd-4911-a4c0-6799e686e294 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1470 microversion: 2.1 time: 0.188991 Aug 01 16:10:18.230361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1660/3653] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:18 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1470 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:19.253682 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2e31fce7-2f3b-495d-84bc-df7a36fc05f8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:19.254731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2e31fce7-2f3b-495d-84bc-df7a36fc05f8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:19.261248 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e31fce7-2f3b-495d-84bc-df7a36fc05f8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:19.261695 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e31fce7-2f3b-495d-84bc-df7a36fc05f8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:19.262506 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e31fce7-2f3b-495d-84bc-df7a36fc05f8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:19.263103 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e31fce7-2f3b-495d-84bc-df7a36fc05f8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:19.433820 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2e31fce7-2f3b-495d-84bc-df7a36fc05f8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:19.443206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2e31fce7-2f3b-495d-84bc-df7a36fc05f8 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1470 microversion: 2.1 time: 0.194295 Aug 01 16:10:19.443902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1994/3654] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:19 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:10:19.962281 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-6ee5454d-f73c-48a5-b428-87be494ca03b req-73af5d73-008e-4e47-a401-23878236d8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e2f270-c0ce-4a19-924a-4fdaeceb3b1f", "name": "network-vif-deleted", "tag": "a90d63e8-bc35-4574-998c-d9aa9368e364"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:10:19.972679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-6ee5454d-f73c-48a5-b428-87be494ca03b req-73af5d73-008e-4e47-a401-23878236d8bd service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:19.973125 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-6ee5454d-f73c-48a5-b428-87be494ca03b req-73af5d73-008e-4e47-a401-23878236d8bd service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:19.989028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-6ee5454d-f73c-48a5-b428-87be494ca03b req-73af5d73-008e-4e47-a401-23878236d8bd service nova] Creating event network-vif-deleted:a90d63e8-bc35-4574-998c-d9aa9368e364 for instance 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f on hv-cinder-84753 Aug 01 16:10:19.994230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-6ee5454d-f73c-48a5-b428-87be494ca03b req-73af5d73-008e-4e47-a401-23878236d8bd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036437 Aug 01 16:10:19.994830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1661/3655] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:10:20.465755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-081e86ed-c095-42ba-b696-4d6126aa9b32 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:20.466897 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-081e86ed-c095-42ba-b696-4d6126aa9b32 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:20.475198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-081e86ed-c095-42ba-b696-4d6126aa9b32 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:20.475198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-081e86ed-c095-42ba-b696-4d6126aa9b32 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:20.475198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-081e86ed-c095-42ba-b696-4d6126aa9b32 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:20.475198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-081e86ed-c095-42ba-b696-4d6126aa9b32 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:20.547037 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-081e86ed-c095-42ba-b696-4d6126aa9b32 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:20.555659 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-081e86ed-c095-42ba-b696-4d6126aa9b32 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1428 microversion: 2.1 time: 0.093940 Aug 01 16:10:20.556357 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1995/3656] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:20 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:21.579317 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4a760b4d-9aca-4fcc-8688-6da220ece179 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:21.580198 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4a760b4d-9aca-4fcc-8688-6da220ece179 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:21.586688 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a760b4d-9aca-4fcc-8688-6da220ece179 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:21.587132 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a760b4d-9aca-4fcc-8688-6da220ece179 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:21.587946 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a760b4d-9aca-4fcc-8688-6da220ece179 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:21.588381 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4a760b4d-9aca-4fcc-8688-6da220ece179 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:21.665272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4a760b4d-9aca-4fcc-8688-6da220ece179 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:21.673108 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4a760b4d-9aca-4fcc-8688-6da220ece179 tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1300 microversion: 2.1 time: 0.099981 Aug 01 16:10:21.674042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1662/3657] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:21 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:22.694260 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-55f35b53-c4f5-4d13-8ef0-2041c20f19ee tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:22.694844 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-55f35b53-c4f5-4d13-8ef0-2041c20f19ee tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:22.702979 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55f35b53-c4f5-4d13-8ef0-2041c20f19ee tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:22.703350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55f35b53-c4f5-4d13-8ef0-2041c20f19ee tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:22.704344 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55f35b53-c4f5-4d13-8ef0-2041c20f19ee tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:22.704994 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55f35b53-c4f5-4d13-8ef0-2041c20f19ee tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:22.746602 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55f35b53-c4f5-4d13-8ef0-2041c20f19ee tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:22.747135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-55f35b53-c4f5-4d13-8ef0-2041c20f19ee tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:22.747899 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.objects.instance [None req-55f35b53-c4f5-4d13-8ef0-2041c20f19ee tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lazy-loading 'fault' on Instance uuid 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f {{(pid=124526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:10:22.798486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-55f35b53-c4f5-4d13-8ef0-2041c20f19ee tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1026208ad63143f589f05818ce082174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9adda77ff445b8eecd09fa7184530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:10:22.806024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-55f35b53-c4f5-4d13-8ef0-2041c20f19ee tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 200 len: 1305 microversion: 2.1 time: 0.115727 Aug 01 16:10:22.806613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1996/3658] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:22 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 1305 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:10:23.830202 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c8042522-184d-41f5-b074-6f9f3edce06c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:10:23.831240 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c8042522-184d-41f5-b074-6f9f3edce06c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] [instance: 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:10:23.844112 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8042522-184d-41f5-b074-6f9f3edce06c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:23.844628 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8042522-184d-41f5-b074-6f9f3edce06c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:23.845573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8042522-184d-41f5-b074-6f9f3edce06c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:23.846180 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c8042522-184d-41f5-b074-6f9f3edce06c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:23.861833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-c8042522-184d-41f5-b074-6f9f3edce06c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] HTTP exception thrown: Instance 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f could not be found. Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c8042522-184d-41f5-b074-6f9f3edce06c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Request method failure captured: Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f HTTP/1.1 Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_rWUa4OzbB6YAjV8W1KVx872w8g4bfyG8IvG-nYGa35POVrD0VslKqhQsL3Ga9q5CGfkg1b9NObqeFOXcpXVLd9yFHF340-zcH4NDIICbJ6hfVngY6Enaazkzod10uMbdmM4ser3DTYixNndR7yOw4k7YtmA1efLKeahPQs6DatKmk Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 53f9adda77ff445b8eecd09fa7184530 Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-VolumesNegativeTest-437620524 Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:10:23.864448 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:10:23.865786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/53f9adda77ff445b8eecd09fa7184530"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f9adda77ff445b8eecd09fa7184530"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_53f9adda77ff445b8eecd09fa7184530"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/53f9adda77ff445b8eecd09fa7184530"}]}] Aug 01 16:10:23.865786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-VolumesNegativeTest-437620524 Aug 01 16:10:23.865786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 53f9adda77ff445b8eecd09fa7184530 Aug 01 16:10:23.865786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-VolumesNegativeTest-437620524 Aug 01 16:10:23.865786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-VolumesNegativeTest-437620524-project Aug 01 16:10:23.865786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:10:23.865786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:10:23.865786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: 1026208ad63143f589f05818ce082174 Aug 01 16:10:23.865786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-VolumesNegativeTest-437620524-project Aug 01 16:10:23.865786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:10:23.865786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f could not be found. Aug 01 16:10:23.865786 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '65e2f270-c0ce-4a19-924a-4fdaeceb3b1f'} Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f could not be found. Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:10:23.866564 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f could not be found. Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f could not be found. Aug 01 16:10:23.867633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:10:23.877254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c8042522-184d-41f5-b074-6f9f3edce06c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] Returning 404 to user: Instance 65e2f270-c0ce-4a19-924a-4fdaeceb3b1f could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:10:23.877254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c8042522-184d-41f5-b074-6f9f3edce06c tempest-VolumesNegativeTest-437620524 tempest-VolumesNegativeTest-437620524-project] 10.222.0.83 "GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f" status: 404 len: 111 microversion: 2.1 time: 0.041356 Aug 01 16:10:23.877254 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1663/3659] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:10:23 2022] GET /compute/v2.1/servers/65e2f270-c0ce-4a19-924a-4fdaeceb3b1f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:10:39.252292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:10:39.253656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 16:10:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:10:40.079110 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:10:40.081265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:10:40.275811 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fb62774c-1912-416c-b148-d71dfd98e367 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Action: 'create', calling method: .version_select at 0x7feb1a985d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-353552585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHDAeEWs+WdiGyhovCkzF7ahE+xF5eIg6GOTW8yFVG8TYFTdYULEx+M3xzULyyOhTmXA/cEj1yui/essZGnX5NyQEzM5mI0rOWhpCwd0RFMOes1Dh3h86UK2tZZXHuJnA=="}} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:10:40.292160 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-fb62774c-1912-416c-b148-d71dfd98e367 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Getting quotas for project c12ec1d14cb44902bed525172feed2f8. Resources: {'key_pairs'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:10:40.296021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.quota [None req-fb62774c-1912-416c-b148-d71dfd98e367 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Getting quotas for user c1e71f7596824b7e9c7a88a22a6664c3 and project c12ec1d14cb44902bed525172feed2f8. Resources: {'key_pairs'} {{(pid=124526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:10:40.322330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fb62774c-1912-416c-b148-d71dfd98e367 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.248704 Aug 01 16:10:40.322930 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1997/3660] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 1 16:10:40 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:10:58.965673 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-646701884", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-353552585", "security_groups": [{"name": "tempest-secgroup-smoke-1578515179"}], "block_device_mapping_v2": [{"uuid": "0f0e89a2-3009-414a-af6a-8a1e8d963c92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0675bac8-e75d-4d70-aa04-61c96a6c877f"}]}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:10:58.976204 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=28 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:10:58.976858 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=60 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:10:59.186502 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.network.neutron [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] validate_networks() for [('0675bac8-e75d-4d70-aa04-61c96a6c877f', None, None, None, None, None)] {{(pid=124527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:10:59.696581 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Flavor limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:10:59.697120 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Image limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:10:59.697692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Flavor pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:10:59.698146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Image pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:10:59.698565 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:10:59.709552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:59.709771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:59.710555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:10:59.710995 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:10:59.729346 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Getting quotas for project c12ec1d14cb44902bed525172feed2f8. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:10:59.733783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Getting quotas for user c1e71f7596824b7e9c7a88a22a6664c3 and project c12ec1d14cb44902bed525172feed2f8. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:10:59.795901 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Going to run 1 instances... {{(pid=124527) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:10:59.798022 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f0e89a2-3009-414a-af6a-8a1e8d963c92',volume_size=None,volume_type=None)] {{(pid=124527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:10:59.953404 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [328dc140-bea4-4b62-ba29-c225a0e78a34] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 16:11:00.960994 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [328dc140-bea4-4b62-ba29-c225a0e78a34] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 38792. Aug 01 16:11:00.964853 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f25b8202-7a24-4a9e-8ba4-01a4c85dd5d5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.003330 Aug 01 16:11:00.965491 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1664/3661] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 16:10:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:11:00.976153 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e1893c79-fa4e-456b-ad93-d870dd775a72 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:00.976774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e1893c79-fa4e-456b-ad93-d870dd775a72 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:00.979324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=4 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:11:00.980984 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:11:01.097641 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e1893c79-fa4e-456b-ad93-d870dd775a72 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:01.105415 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e1893c79-fa4e-456b-ad93-d870dd775a72 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1093 microversion: 2.1 time: 0.133007 Aug 01 16:11:01.106014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1998/3662] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:00 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1093 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:11:02.128308 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-924c4966-1320-4c4e-af99-21a11ddb63bd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:02.130296 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-924c4966-1320-4c4e-af99-21a11ddb63bd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:02.136782 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-924c4966-1320-4c4e-af99-21a11ddb63bd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:02.137292 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-924c4966-1320-4c4e-af99-21a11ddb63bd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:02.138102 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-924c4966-1320-4c4e-af99-21a11ddb63bd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:02.138868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-924c4966-1320-4c4e-af99-21a11ddb63bd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:02.230403 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-924c4966-1320-4c4e-af99-21a11ddb63bd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:02.239903 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-924c4966-1320-4c4e-af99-21a11ddb63bd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1209 microversion: 2.1 time: 0.116690 Aug 01 16:11:02.240585 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1665/3663] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:02 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:11:03.260992 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f3fcebd0-e2cf-4fe2-8e96-2771cec8eaa1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:03.261600 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f3fcebd0-e2cf-4fe2-8e96-2771cec8eaa1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:03.268751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f3fcebd0-e2cf-4fe2-8e96-2771cec8eaa1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:03.269193 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f3fcebd0-e2cf-4fe2-8e96-2771cec8eaa1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:03.270612 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f3fcebd0-e2cf-4fe2-8e96-2771cec8eaa1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:03.271045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-f3fcebd0-e2cf-4fe2-8e96-2771cec8eaa1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:03.486489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f3fcebd0-e2cf-4fe2-8e96-2771cec8eaa1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:03.495332 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f3fcebd0-e2cf-4fe2-8e96-2771cec8eaa1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1265 microversion: 2.1 time: 0.238158 Aug 01 16:11:03.495909 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 1999/3664] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:03 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:11:03.545754 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-051b9d87-ec88-4cf8-a178-735c5fdb9d33 req-2da9a346-ec02-4e7d-8af3-ab95243a52ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3598d8e9-b0e9-4076-a342-d02faaaca330", "tag": "3e989d8b-dda5-450c-96bd-bd215c3e62dc"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:11:03.557415 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-051b9d87-ec88-4cf8-a178-735c5fdb9d33 req-2da9a346-ec02-4e7d-8af3-ab95243a52ff service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:03.557931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-051b9d87-ec88-4cf8-a178-735c5fdb9d33 req-2da9a346-ec02-4e7d-8af3-ab95243a52ff service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:03.569753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-051b9d87-ec88-4cf8-a178-735c5fdb9d33 req-2da9a346-ec02-4e7d-8af3-ab95243a52ff service nova] Creating event network-changed:3e989d8b-dda5-450c-96bd-bd215c3e62dc for instance 3598d8e9-b0e9-4076-a342-d02faaaca330 on hv-cinder-84753 Aug 01 16:11:03.575336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-051b9d87-ec88-4cf8-a178-735c5fdb9d33 req-2da9a346-ec02-4e7d-8af3-ab95243a52ff service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033649 Aug 01 16:11:03.575931 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1666/3665] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:11:04.518323 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-bee6081a-72c2-4bd3-91ee-0152b5c4e9ee tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:04.518947 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-bee6081a-72c2-4bd3-91ee-0152b5c4e9ee tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:04.525715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bee6081a-72c2-4bd3-91ee-0152b5c4e9ee tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:04.526207 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bee6081a-72c2-4bd3-91ee-0152b5c4e9ee tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:04.526983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bee6081a-72c2-4bd3-91ee-0152b5c4e9ee tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:04.527427 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-bee6081a-72c2-4bd3-91ee-0152b5c4e9ee tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:04.760653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-bee6081a-72c2-4bd3-91ee-0152b5c4e9ee tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:04.768469 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-bee6081a-72c2-4bd3-91ee-0152b5c4e9ee tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1265 microversion: 2.1 time: 0.254698 Aug 01 16:11:04.769053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2000/3666] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:04 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:11:05.791492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4c0ca0c3-caae-4da5-941c-47c756868793 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:05.792194 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4c0ca0c3-caae-4da5-941c-47c756868793 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:05.798521 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c0ca0c3-caae-4da5-941c-47c756868793 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:05.798972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c0ca0c3-caae-4da5-941c-47c756868793 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:05.799737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c0ca0c3-caae-4da5-941c-47c756868793 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:05.800177 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4c0ca0c3-caae-4da5-941c-47c756868793 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:05.937350 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4c0ca0c3-caae-4da5-941c-47c756868793 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:05.945430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4c0ca0c3-caae-4da5-941c-47c756868793 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1265 microversion: 2.1 time: 0.158549 Aug 01 16:11:05.946024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1667/3667] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:05 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:11:06.966755 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fac516d1-e04d-4165-8925-cbb9be1b6fd1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:06.967369 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fac516d1-e04d-4165-8925-cbb9be1b6fd1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:06.973942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fac516d1-e04d-4165-8925-cbb9be1b6fd1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:06.974399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fac516d1-e04d-4165-8925-cbb9be1b6fd1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:06.975174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fac516d1-e04d-4165-8925-cbb9be1b6fd1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:06.975613 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fac516d1-e04d-4165-8925-cbb9be1b6fd1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:07.115154 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fac516d1-e04d-4165-8925-cbb9be1b6fd1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:07.122549 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fac516d1-e04d-4165-8925-cbb9be1b6fd1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1265 microversion: 2.1 time: 0.159642 Aug 01 16:11:07.123113 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2001/3668] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:06 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:11:08.143886 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-a7ba9451-efee-47c2-9025-50115f7912a5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:08.144986 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-a7ba9451-efee-47c2-9025-50115f7912a5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:08.151634 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7ba9451-efee-47c2-9025-50115f7912a5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:08.152076 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7ba9451-efee-47c2-9025-50115f7912a5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:08.152825 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7ba9451-efee-47c2-9025-50115f7912a5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:08.153252 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-a7ba9451-efee-47c2-9025-50115f7912a5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:08.282315 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-a7ba9451-efee-47c2-9025-50115f7912a5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:08.290817 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-a7ba9451-efee-47c2-9025-50115f7912a5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1265 microversion: 2.1 time: 0.150730 Aug 01 16:11:08.291388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1668/3669] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:08 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:11:09.311724 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-d3523aef-dbe7-4566-902a-2e44a6d542ca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:09.312341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-d3523aef-dbe7-4566-902a-2e44a6d542ca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:09.319505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3523aef-dbe7-4566-902a-2e44a6d542ca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:09.319961 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3523aef-dbe7-4566-902a-2e44a6d542ca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:09.320732 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3523aef-dbe7-4566-902a-2e44a6d542ca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:09.321174 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-d3523aef-dbe7-4566-902a-2e44a6d542ca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:09.458504 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-d3523aef-dbe7-4566-902a-2e44a6d542ca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:09.466545 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-d3523aef-dbe7-4566-902a-2e44a6d542ca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1265 microversion: 2.1 time: 0.158698 Aug 01 16:11:09.467115 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2002/3670] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:09 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:11:10.487361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-acf7b43c-cdb0-4320-bc37-c51cf59207de tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:10.488014 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-acf7b43c-cdb0-4320-bc37-c51cf59207de tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:10.490753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=2 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:11:10.491552 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=6 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:11:10.497763 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acf7b43c-cdb0-4320-bc37-c51cf59207de tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:10.498242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acf7b43c-cdb0-4320-bc37-c51cf59207de tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:10.499007 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acf7b43c-cdb0-4320-bc37-c51cf59207de tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:10.499447 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-acf7b43c-cdb0-4320-bc37-c51cf59207de tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:10.630762 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-acf7b43c-cdb0-4320-bc37-c51cf59207de tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:10.638733 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-acf7b43c-cdb0-4320-bc37-c51cf59207de tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1265 microversion: 2.1 time: 0.155268 Aug 01 16:11:10.639309 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1669/3671] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:10 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:11:11.661686 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5576780e-ad49-4214-bc50-391749dae510 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:11.662355 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5576780e-ad49-4214-bc50-391749dae510 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:11.664711 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=2 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:11:11.670326 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5576780e-ad49-4214-bc50-391749dae510 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:11.670778 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5576780e-ad49-4214-bc50-391749dae510 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:11.671538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5576780e-ad49-4214-bc50-391749dae510 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:11.671973 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5576780e-ad49-4214-bc50-391749dae510 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:11.803683 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5576780e-ad49-4214-bc50-391749dae510 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:11.811047 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5576780e-ad49-4214-bc50-391749dae510 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1265 microversion: 2.1 time: 0.153244 Aug 01 16:11:11.811606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2003/3672] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:11 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:11:12.833042 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-78f28e1d-4afc-477c-ba24-82bfdc340e43 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:12.833679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-78f28e1d-4afc-477c-ba24-82bfdc340e43 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:12.840334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-78f28e1d-4afc-477c-ba24-82bfdc340e43 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:12.840778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-78f28e1d-4afc-477c-ba24-82bfdc340e43 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:12.841536 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-78f28e1d-4afc-477c-ba24-82bfdc340e43 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:12.842031 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-78f28e1d-4afc-477c-ba24-82bfdc340e43 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:12.983855 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-78f28e1d-4afc-477c-ba24-82bfdc340e43 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:12.992383 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-78f28e1d-4afc-477c-ba24-82bfdc340e43 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1265 microversion: 2.1 time: 0.163641 Aug 01 16:11:12.992951 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1670/3673] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:12 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:11:14.012597 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-af95e96b-3607-44d4-9574-17446a86c763 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:14.013217 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-af95e96b-3607-44d4-9574-17446a86c763 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:14.019781 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af95e96b-3607-44d4-9574-17446a86c763 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:14.020245 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af95e96b-3607-44d4-9574-17446a86c763 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:14.021000 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af95e96b-3607-44d4-9574-17446a86c763 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:14.021442 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-af95e96b-3607-44d4-9574-17446a86c763 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:14.154489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-af95e96b-3607-44d4-9574-17446a86c763 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:14.162265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-af95e96b-3607-44d4-9574-17446a86c763 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1265 microversion: 2.1 time: 0.153480 Aug 01 16:11:14.162974 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2004/3674] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:14 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:11:14.654358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-f1acc9d5-c5d2-4b21-9755-4c3172bd0d3a req-c8d06810-bfe9-4de4-87f2-a7ce1390f26f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3598d8e9-b0e9-4076-a342-d02faaaca330", "name": "network-vif-plugged", "status": "completed", "tag": "3e989d8b-dda5-450c-96bd-bd215c3e62dc"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:11:14.664527 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-f1acc9d5-c5d2-4b21-9755-4c3172bd0d3a req-c8d06810-bfe9-4de4-87f2-a7ce1390f26f service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:14.664973 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-f1acc9d5-c5d2-4b21-9755-4c3172bd0d3a req-c8d06810-bfe9-4de4-87f2-a7ce1390f26f service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:14.676161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-f1acc9d5-c5d2-4b21-9755-4c3172bd0d3a req-c8d06810-bfe9-4de4-87f2-a7ce1390f26f service nova] Creating event network-vif-plugged:3e989d8b-dda5-450c-96bd-bd215c3e62dc for instance 3598d8e9-b0e9-4076-a342-d02faaaca330 on hv-cinder-84753 Aug 01 16:11:14.681322 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-f1acc9d5-c5d2-4b21-9755-4c3172bd0d3a req-c8d06810-bfe9-4de4-87f2-a7ce1390f26f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030604 Aug 01 16:11:14.681922 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1671/3675] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:11:15.185708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e12e1714-325d-42e3-9316-158913455df8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:15.186317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e12e1714-325d-42e3-9316-158913455df8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:15.193329 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e12e1714-325d-42e3-9316-158913455df8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:15.193784 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e12e1714-325d-42e3-9316-158913455df8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:15.195286 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e12e1714-325d-42e3-9316-158913455df8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:15.195726 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e12e1714-325d-42e3-9316-158913455df8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:15.333081 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e12e1714-325d-42e3-9316-158913455df8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:15.341352 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e12e1714-325d-42e3-9316-158913455df8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1265 microversion: 2.1 time: 0.159680 Aug 01 16:11:15.341932 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2005/3676] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:15 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:11:16.362687 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-03d0c066-e247-4667-a5fc-dae27e40010e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:16.363425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-03d0c066-e247-4667-a5fc-dae27e40010e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:16.370328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03d0c066-e247-4667-a5fc-dae27e40010e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:16.370784 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03d0c066-e247-4667-a5fc-dae27e40010e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:16.371555 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03d0c066-e247-4667-a5fc-dae27e40010e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:16.372000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03d0c066-e247-4667-a5fc-dae27e40010e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:16.508500 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-03d0c066-e247-4667-a5fc-dae27e40010e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:16.516425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-03d0c066-e247-4667-a5fc-dae27e40010e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1453 microversion: 2.1 time: 0.158576 Aug 01 16:11:16.516988 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1672/3677] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:16 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:11:16.539232 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e6692076-9149-4027-9b2c-9e69e7075a93 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:11:16.539975 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e6692076-9149-4027-9b2c-9e69e7075a93 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:11:16.547191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6692076-9149-4027-9b2c-9e69e7075a93 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:16.547645 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6692076-9149-4027-9b2c-9e69e7075a93 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:16.548538 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6692076-9149-4027-9b2c-9e69e7075a93 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:16.548982 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e6692076-9149-4027-9b2c-9e69e7075a93 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:16.684138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e6692076-9149-4027-9b2c-9e69e7075a93 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:11:16.692236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e6692076-9149-4027-9b2c-9e69e7075a93 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1453 microversion: 2.1 time: 0.158044 Aug 01 16:11:16.692821 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2006/3678] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:11:16 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:11:18.964976 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-92f837aa-ec23-4824-9bd6-18f8023c3253 req-a1d5f4fc-1eec-4f8d-a747-b47b23a3d68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3598d8e9-b0e9-4076-a342-d02faaaca330", "tag": "3e989d8b-dda5-450c-96bd-bd215c3e62dc"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:11:18.976795 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-92f837aa-ec23-4824-9bd6-18f8023c3253 req-a1d5f4fc-1eec-4f8d-a747-b47b23a3d68d service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:11:18.977247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-92f837aa-ec23-4824-9bd6-18f8023c3253 req-a1d5f4fc-1eec-4f8d-a747-b47b23a3d68d service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:11:18.989383 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-92f837aa-ec23-4824-9bd6-18f8023c3253 req-a1d5f4fc-1eec-4f8d-a747-b47b23a3d68d service nova] Creating event network-changed:3e989d8b-dda5-450c-96bd-bd215c3e62dc for instance 3598d8e9-b0e9-4076-a342-d02faaaca330 on hv-cinder-84753 Aug 01 16:11:18.996815 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-92f837aa-ec23-4824-9bd6-18f8023c3253 req-a1d5f4fc-1eec-4f8d-a747-b47b23a3d68d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036488 Aug 01 16:11:18.997636 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1673/3679] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:12:26.276359 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:12:26.276920 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 16:12:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:13:16.516385 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3c235975-7464-4847-bbbc-b4fde7ae1f5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:16.517015 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3c235975-7464-4847-bbbc-b4fde7ae1f5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:16.520439 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=20 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:13:16.521090 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=48 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:13:16.526835 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3c235975-7464-4847-bbbc-b4fde7ae1f5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:16.527285 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3c235975-7464-4847-bbbc-b4fde7ae1f5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:16.528065 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3c235975-7464-4847-bbbc-b4fde7ae1f5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:16.528502 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3c235975-7464-4847-bbbc-b4fde7ae1f5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:16.556206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3c235975-7464-4847-bbbc-b4fde7ae1f5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:13:16.632468 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3c235975-7464-4847-bbbc-b4fde7ae1f5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "DELETE /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 204 len: 0 microversion: 2.1 time: 0.120147 Aug 01 16:13:16.633054 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2007/3680] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:13:16 2022] DELETE /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:13:16.645539 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1146a60e-e656-4d28-8afa-befaae322a02] AMQP server on 10.222.0.83:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 01 16:13:16.646451 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:13:16.647239 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=44 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:13:16.652156 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e8e8c2d6-a928-4785-b760-ffa40d6dcbf0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:16.653231 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e8e8c2d6-a928-4785-b760-ffa40d6dcbf0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:16.661535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8e8c2d6-a928-4785-b760-ffa40d6dcbf0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:16.662021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8e8c2d6-a928-4785-b760-ffa40d6dcbf0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:16.662788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8e8c2d6-a928-4785-b760-ffa40d6dcbf0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:16.663228 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e8e8c2d6-a928-4785-b760-ffa40d6dcbf0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:16.804437 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e8e8c2d6-a928-4785-b760-ffa40d6dcbf0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:16.812057 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e8e8c2d6-a928-4785-b760-ffa40d6dcbf0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1578 microversion: 2.1 time: 0.169049 Aug 01 16:13:16.812613 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1674/3681] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:16 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:17.833477 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5fbf616e-209e-4d56-818a-afc317213de7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:17.834228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5fbf616e-209e-4d56-818a-afc317213de7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:17.840828 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5fbf616e-209e-4d56-818a-afc317213de7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:17.841274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5fbf616e-209e-4d56-818a-afc317213de7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:17.842088 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5fbf616e-209e-4d56-818a-afc317213de7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:17.842526 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5fbf616e-209e-4d56-818a-afc317213de7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:17.979019 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5fbf616e-209e-4d56-818a-afc317213de7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:17.986632 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5fbf616e-209e-4d56-818a-afc317213de7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1578 microversion: 2.1 time: 0.157707 Aug 01 16:13:17.987218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2008/3682] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:17 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:19.009915 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e15f3c7c-69bb-4cef-93e6-ce597220c0cd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:19.010550 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e15f3c7c-69bb-4cef-93e6-ce597220c0cd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:19.022333 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e15f3c7c-69bb-4cef-93e6-ce597220c0cd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:19.022781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e15f3c7c-69bb-4cef-93e6-ce597220c0cd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:19.023559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e15f3c7c-69bb-4cef-93e6-ce597220c0cd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:19.024000 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e15f3c7c-69bb-4cef-93e6-ce597220c0cd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:19.030868 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] [1146a60e-e656-4d28-8afa-befaae322a02] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 39156. Aug 01 16:13:19.439771 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-e15f3c7c-69bb-4cef-93e6-ce597220c0cd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:19.447425 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e15f3c7c-69bb-4cef-93e6-ce597220c0cd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1578 microversion: 2.1 time: 0.441307 Aug 01 16:13:19.448008 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1675/3683] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:19 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1578 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:19.937436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-f8c49e08-3023-4ea3-9e2c-7b1e4e53e7e9 req-de1f4b64-ae4b-4093-a3d2-de3767dae586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3598d8e9-b0e9-4076-a342-d02faaaca330", "name": "network-vif-deleted", "tag": "3e989d8b-dda5-450c-96bd-bd215c3e62dc"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:13:19.952434 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-f8c49e08-3023-4ea3-9e2c-7b1e4e53e7e9 req-de1f4b64-ae4b-4093-a3d2-de3767dae586 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:19.952886 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-f8c49e08-3023-4ea3-9e2c-7b1e4e53e7e9 req-de1f4b64-ae4b-4093-a3d2-de3767dae586 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:19.970214 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-f8c49e08-3023-4ea3-9e2c-7b1e4e53e7e9 req-de1f4b64-ae4b-4093-a3d2-de3767dae586 service nova] Creating event network-vif-deleted:3e989d8b-dda5-450c-96bd-bd215c3e62dc for instance 3598d8e9-b0e9-4076-a342-d02faaaca330 on hv-cinder-84753 Aug 01 16:13:19.976024 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-f8c49e08-3023-4ea3-9e2c-7b1e4e53e7e9 req-de1f4b64-ae4b-4093-a3d2-de3767dae586 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043663 Aug 01 16:13:19.976625 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2009/3684] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:13:20.470538 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-9bb7be90-7592-4d2d-a73b-5eb4441ae193 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:20.471303 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-9bb7be90-7592-4d2d-a73b-5eb4441ae193 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:20.478123 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bb7be90-7592-4d2d-a73b-5eb4441ae193 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:20.478572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bb7be90-7592-4d2d-a73b-5eb4441ae193 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:20.479336 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bb7be90-7592-4d2d-a73b-5eb4441ae193 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:20.479769 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bb7be90-7592-4d2d-a73b-5eb4441ae193 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:20.512778 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bb7be90-7592-4d2d-a73b-5eb4441ae193 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:20.513229 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-9bb7be90-7592-4d2d-a73b-5eb4441ae193 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:20.513856 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.objects.instance [None req-9bb7be90-7592-4d2d-a73b-5eb4441ae193 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lazy-loading 'fault' on Instance uuid 3598d8e9-b0e9-4076-a342-d02faaaca330 {{(pid=124527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:13:20.560247 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-9bb7be90-7592-4d2d-a73b-5eb4441ae193 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:20.569611 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-9bb7be90-7592-4d2d-a73b-5eb4441ae193 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 200 len: 1229 microversion: 2.1 time: 0.102566 Aug 01 16:13:20.581919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1676/3685] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:20 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:21.592954 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3d7d4b29-a8e5-4a0e-b59c-80b2bcb84d64 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:21.593681 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-3d7d4b29-a8e5-4a0e-b59c-80b2bcb84d64 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:21.600444 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d7d4b29-a8e5-4a0e-b59c-80b2bcb84d64 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:21.600894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d7d4b29-a8e5-4a0e-b59c-80b2bcb84d64 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:21.601661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d7d4b29-a8e5-4a0e-b59c-80b2bcb84d64 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:21.602119 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-3d7d4b29-a8e5-4a0e-b59c-80b2bcb84d64 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:21.616457 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-3d7d4b29-a8e5-4a0e-b59c-80b2bcb84d64 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] HTTP exception thrown: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3d7d4b29-a8e5-4a0e-b59c-80b2bcb84d64 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Request method failure captured: Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 HTTP/1.1 Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_r6wZ4crXH1b1SYPhrtGaGaMf5MDjqie1v9YsAMONOK-yxyl2JM3Jo0VcrmnUWj65R93LvMfqFlq5q7kaNvc8rorHKnUDzWQaS1IKT64JYcJkJ-z359vWtUzniiUW-bAgkje99_XCVERtHCknqoN6wpuYf2tgZfUuSM0TPXVWl7YNE Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: c12ec1d14cb44902bed525172feed2f8 Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-TestVolumeBootPattern-781075939 Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:13:21.618717 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:13:21.620100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c12ec1d14cb44902bed525172feed2f8"}]}] Aug 01 16:13:21.620100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-TestVolumeBootPattern-781075939 Aug 01 16:13:21.620100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: c12ec1d14cb44902bed525172feed2f8 Aug 01 16:13:21.620100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-TestVolumeBootPattern-781075939 Aug 01 16:13:21.620100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-TestVolumeBootPattern-781075939-project Aug 01 16:13:21.620100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:13:21.620100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:13:21.620100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: c1e71f7596824b7e9c7a88a22a6664c3 Aug 01 16:13:21.620100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-TestVolumeBootPattern-781075939-project Aug 01 16:13:21.620100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 16:13:21.620100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:13:21.620100 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': '3598d8e9-b0e9-4076-a342-d02faaaca330'} Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:13:21.620942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:13:21.622226 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:13:21.623352 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-3d7d4b29-a8e5-4a0e-b59c-80b2bcb84d64 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Returning 404 to user: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:13:21.623352 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-3d7d4b29-a8e5-4a0e-b59c-80b2bcb84d64 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 404 len: 111 microversion: 2.1 time: 0.031616 Aug 01 16:13:21.623352 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2010/3686] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:21 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:13:21.668822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1942590465", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-353552585", "security_groups": [{"name": "tempest-secgroup-smoke-1578515179"}], "block_device_mapping_v2": [{"uuid": "0f0e89a2-3009-414a-af6a-8a1e8d963c92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0675bac8-e75d-4d70-aa04-61c96a6c877f"}]}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:13:21.790580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.network.neutron [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] validate_networks() for [('0675bac8-e75d-4d70-aa04-61c96a6c877f', None, None, None, None, None)] {{(pid=124527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:13:22.173114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Flavor limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:13:22.173568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Image limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:13:22.174079 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Flavor pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:13:22.175183 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Image pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:13:22.175595 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:13:22.184483 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:22.184944 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:22.185740 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:22.186214 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:22.202830 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Getting quotas for project c12ec1d14cb44902bed525172feed2f8. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:13:22.206982 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Getting quotas for user c1e71f7596824b7e9c7a88a22a6664c3 and project c12ec1d14cb44902bed525172feed2f8. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:13:22.264630 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Going to run 1 instances... {{(pid=124527) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:13:22.266790 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f0e89a2-3009-414a-af6a-8a1e8d963c92',volume_size=None,volume_type=None)] {{(pid=124527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:13:22.397549 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-fffae9fb-4186-4a39-b391-a155adc5aaeb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.732574 Aug 01 16:13:22.398306 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1677/3687] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 16:13:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 16:13:22.409643 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-f8a811b6-233e-498d-8cbd-11c4cb14794c tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:22.410353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-f8a811b6-233e-498d-8cbd-11c4cb14794c tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:22.464294 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-f8a811b6-233e-498d-8cbd-11c4cb14794c tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:22.471734 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-f8a811b6-233e-498d-8cbd-11c4cb14794c tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1094 microversion: 2.1 time: 0.065723 Aug 01 16:13:22.472299 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2011/3688] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:22 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:13:23.493559 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ca271826-841b-4b4e-a55a-b1c527fc57d1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:23.494215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ca271826-841b-4b4e-a55a-b1c527fc57d1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:23.500707 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca271826-841b-4b4e-a55a-b1c527fc57d1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:23.501161 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca271826-841b-4b4e-a55a-b1c527fc57d1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:23.502152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca271826-841b-4b4e-a55a-b1c527fc57d1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:23.503279 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ca271826-841b-4b4e-a55a-b1c527fc57d1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:23.585401 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ca271826-841b-4b4e-a55a-b1c527fc57d1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:23.593189 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ca271826-841b-4b4e-a55a-b1c527fc57d1 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1210 microversion: 2.1 time: 0.104310 Aug 01 16:13:23.593753 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1678/3689] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:23 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:24.614801 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-63adb802-9306-41f4-9565-de1db52f3ad5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:24.615407 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-63adb802-9306-41f4-9565-de1db52f3ad5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:24.622736 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-63adb802-9306-41f4-9565-de1db52f3ad5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:24.623181 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-63adb802-9306-41f4-9565-de1db52f3ad5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:24.624330 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-63adb802-9306-41f4-9565-de1db52f3ad5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:24.624795 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-63adb802-9306-41f4-9565-de1db52f3ad5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:24.704378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-949c8c8f-717c-41d7-bb8f-8c197bf1bcff req-7362fe7f-538e-4600-9720-23912f07663f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79ee311-111b-41f5-ad24-09a58b7610ad", "tag": "02ebddd4-1cb3-409d-8956-c1f97086cde8"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:13:24.715845 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-949c8c8f-717c-41d7-bb8f-8c197bf1bcff req-7362fe7f-538e-4600-9720-23912f07663f service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:24.716470 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-949c8c8f-717c-41d7-bb8f-8c197bf1bcff req-7362fe7f-538e-4600-9720-23912f07663f service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:24.730238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-949c8c8f-717c-41d7-bb8f-8c197bf1bcff req-7362fe7f-538e-4600-9720-23912f07663f service nova] Creating event network-changed:02ebddd4-1cb3-409d-8956-c1f97086cde8 for instance c79ee311-111b-41f5-ad24-09a58b7610ad on hv-cinder-84753 Aug 01 16:13:24.735742 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-949c8c8f-717c-41d7-bb8f-8c197bf1bcff req-7362fe7f-538e-4600-9720-23912f07663f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035402 Aug 01 16:13:24.737038 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1679/3690] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:13:24.904972 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-63adb802-9306-41f4-9565-de1db52f3ad5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:24.913235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-63adb802-9306-41f4-9565-de1db52f3ad5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1266 microversion: 2.1 time: 0.302199 Aug 01 16:13:24.913810 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2012/3691] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:24 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:25.935808 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-257b3a7d-9179-4c44-870b-56e8901a9ab0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:25.936493 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-257b3a7d-9179-4c44-870b-56e8901a9ab0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:25.942779 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-257b3a7d-9179-4c44-870b-56e8901a9ab0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:25.943227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-257b3a7d-9179-4c44-870b-56e8901a9ab0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:25.943974 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-257b3a7d-9179-4c44-870b-56e8901a9ab0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:25.944406 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-257b3a7d-9179-4c44-870b-56e8901a9ab0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:26.078211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-257b3a7d-9179-4c44-870b-56e8901a9ab0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:26.086739 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-257b3a7d-9179-4c44-870b-56e8901a9ab0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1266 microversion: 2.1 time: 0.155445 Aug 01 16:13:26.087334 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1680/3692] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:25 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:27.110045 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c714c533-d753-4ffc-b459-c7db25b484fd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:27.110658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c714c533-d753-4ffc-b459-c7db25b484fd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:27.117773 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c714c533-d753-4ffc-b459-c7db25b484fd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:27.118238 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c714c533-d753-4ffc-b459-c7db25b484fd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:27.119026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c714c533-d753-4ffc-b459-c7db25b484fd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:27.119462 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c714c533-d753-4ffc-b459-c7db25b484fd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:27.259555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-c714c533-d753-4ffc-b459-c7db25b484fd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:27.267017 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c714c533-d753-4ffc-b459-c7db25b484fd tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1266 microversion: 2.1 time: 0.160919 Aug 01 16:13:27.267572 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2013/3693] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:27 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:28.151225 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b4c9cea5-2f1f-46e7-be8d-77e0a1c79b25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:28.151719 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-b4c9cea5-2f1f-46e7-be8d-77e0a1c79b25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:28.158227 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4c9cea5-2f1f-46e7-be8d-77e0a1c79b25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:28.158696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4c9cea5-2f1f-46e7-be8d-77e0a1c79b25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:28.159941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4c9cea5-2f1f-46e7-be8d-77e0a1c79b25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:28.160394 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-b4c9cea5-2f1f-46e7-be8d-77e0a1c79b25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:28.174188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-b4c9cea5-2f1f-46e7-be8d-77e0a1c79b25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] HTTP exception thrown: Instance c377fe1d-1c49-46de-87e3-4a70f1253e63 could not be found. Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b4c9cea5-2f1f-46e7-be8d-77e0a1c79b25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Request method failure captured: Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: DELETE /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 HTTP/1.1 Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_Jmlx2vnbnk0lKcbsy2AYy6I3lUTNvEhfM6QYvHnZh-_L4BGrhaLr2tVolhdM-UX8a6JlIclFzId09LJO9KJpeB2EOmZa72L55dENxljRav7mPMz0SFwre86rMW5QruOjTZB_gqp0d2PT15Byz-h9VgrDrBvw_ypL7uzZPgi6BxoQc Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: 85354737a87146729a06bf22ddb3fefc Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:13:28.176344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:13:28.177747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/85354737a87146729a06bf22ddb3fefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/85354737a87146729a06bf22ddb3fefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_85354737a87146729a06bf22ddb3fefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/85354737a87146729a06bf22ddb3fefc"}]}] Aug 01 16:13:28.177747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:13:28.177747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: 85354737a87146729a06bf22ddb3fefc Aug 01 16:13:28.177747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:13:28.177747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-AttachVolumeTestJSON-2001489868-project Aug 01 16:13:28.177747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:13:28.177747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:13:28.177747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: ba149d1623e849328e399d6dbdca3e0c Aug 01 16:13:28.177747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-AttachVolumeTestJSON-2001489868-project Aug 01 16:13:28.177747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:13:28.177747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance c377fe1d-1c49-46de-87e3-4a70f1253e63 could not be found. Aug 01 16:13:28.177747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': 'c377fe1d-1c49-46de-87e3-4a70f1253e63'} Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c377fe1d-1c49-46de-87e3-4a70f1253e63 could not be found. Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:13:28.178579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c377fe1d-1c49-46de-87e3-4a70f1253e63 could not be found. Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c377fe1d-1c49-46de-87e3-4a70f1253e63 could not be found. Aug 01 16:13:28.179608 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:13:28.180652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-b4c9cea5-2f1f-46e7-be8d-77e0a1c79b25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Returning 404 to user: Instance c377fe1d-1c49-46de-87e3-4a70f1253e63 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:13:28.180652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-b4c9cea5-2f1f-46e7-be8d-77e0a1c79b25 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 404 len: 111 microversion: 2.1 time: 0.030311 Aug 01 16:13:28.180652 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1681/3694] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:13:28 2022] DELETE /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:13:28.186282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c612fc08-67c8-49c8-874c-a90acbd6c394 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:28.186888 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-c612fc08-67c8-49c8-874c-a90acbd6c394 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] [instance: c377fe1d-1c49-46de-87e3-4a70f1253e63] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:28.193436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c612fc08-67c8-49c8-874c-a90acbd6c394 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:28.193879 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c612fc08-67c8-49c8-874c-a90acbd6c394 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:28.194678 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c612fc08-67c8-49c8-874c-a90acbd6c394 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:28.195105 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-c612fc08-67c8-49c8-874c-a90acbd6c394 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:28.208265 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-c612fc08-67c8-49c8-874c-a90acbd6c394 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] HTTP exception thrown: Instance c377fe1d-1c49-46de-87e3-4a70f1253e63 could not be found. Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c612fc08-67c8-49c8-874c-a90acbd6c394 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Request method failure captured: Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 HTTP/1.1 Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_Jmlx2vnbnk0lKcbsy2AYy6I3lUTNvEhfM6QYvHnZh-_L4BGrhaLr2tVolhdM-UX8a6JlIclFzId09LJO9KJpeB2EOmZa72L55dENxljRav7mPMz0SFwre86rMW5QruOjTZB_gqp0d2PT15Byz-h9VgrDrBvw_ypL7uzZPgi6BxoQc Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: 85354737a87146729a06bf22ddb3fefc Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:13:28.209780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:13:28.211177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/85354737a87146729a06bf22ddb3fefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/85354737a87146729a06bf22ddb3fefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_85354737a87146729a06bf22ddb3fefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/85354737a87146729a06bf22ddb3fefc"}]}] Aug 01 16:13:28.211177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:13:28.211177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: 85354737a87146729a06bf22ddb3fefc Aug 01 16:13:28.211177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2001489868 Aug 01 16:13:28.211177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-AttachVolumeTestJSON-2001489868-project Aug 01 16:13:28.211177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:13:28.211177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:13:28.211177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: ba149d1623e849328e399d6dbdca3e0c Aug 01 16:13:28.211177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-AttachVolumeTestJSON-2001489868-project Aug 01 16:13:28.211177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 16:13:28.211177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance c377fe1d-1c49-46de-87e3-4a70f1253e63 could not be found. Aug 01 16:13:28.211177 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': 'c377fe1d-1c49-46de-87e3-4a70f1253e63'} Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c377fe1d-1c49-46de-87e3-4a70f1253e63 could not be found. Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:13:28.211873 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c377fe1d-1c49-46de-87e3-4a70f1253e63 could not be found. Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c377fe1d-1c49-46de-87e3-4a70f1253e63 could not be found. Aug 01 16:13:28.213155 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:13:28.214311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-c612fc08-67c8-49c8-874c-a90acbd6c394 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] Returning 404 to user: Instance c377fe1d-1c49-46de-87e3-4a70f1253e63 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:13:28.214311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-c612fc08-67c8-49c8-874c-a90acbd6c394 tempest-AttachVolumeTestJSON-2001489868 tempest-AttachVolumeTestJSON-2001489868-project] 10.222.0.83 "GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63" status: 404 len: 111 microversion: 2.1 time: 0.028701 Aug 01 16:13:28.214311 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2014/3695] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:28 2022] GET /compute/v2.1/servers/c377fe1d-1c49-46de-87e3-4a70f1253e63 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:13:28.288783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-03a39699-819f-46d8-b25d-da596c3c8784 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:28.289390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-03a39699-819f-46d8-b25d-da596c3c8784 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:28.295669 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03a39699-819f-46d8-b25d-da596c3c8784 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:28.296124 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03a39699-819f-46d8-b25d-da596c3c8784 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:28.296888 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03a39699-819f-46d8-b25d-da596c3c8784 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:28.297328 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-03a39699-819f-46d8-b25d-da596c3c8784 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:28.430428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-03a39699-819f-46d8-b25d-da596c3c8784 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:28.437792 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-03a39699-819f-46d8-b25d-da596c3c8784 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1266 microversion: 2.1 time: 0.153425 Aug 01 16:13:28.438398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1682/3696] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:28 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:29.460235 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-dc1de283-9cde-488c-9e82-a13b50d5226a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:29.460774 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-dc1de283-9cde-488c-9e82-a13b50d5226a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:29.467475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc1de283-9cde-488c-9e82-a13b50d5226a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:29.467933 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc1de283-9cde-488c-9e82-a13b50d5226a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:29.468710 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc1de283-9cde-488c-9e82-a13b50d5226a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:29.469151 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-dc1de283-9cde-488c-9e82-a13b50d5226a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:29.613942 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-dc1de283-9cde-488c-9e82-a13b50d5226a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:29.622043 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-dc1de283-9cde-488c-9e82-a13b50d5226a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1266 microversion: 2.1 time: 0.166001 Aug 01 16:13:29.622830 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2015/3697] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:29 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:30.647656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-3f970f0c-c0c4-4867-843e-6118b566b0bc tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:30.648291 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-3f970f0c-c0c4-4867-843e-6118b566b0bc tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:30.656742 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3f970f0c-c0c4-4867-843e-6118b566b0bc tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:30.657194 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3f970f0c-c0c4-4867-843e-6118b566b0bc tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:30.658185 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3f970f0c-c0c4-4867-843e-6118b566b0bc tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:30.658621 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-3f970f0c-c0c4-4867-843e-6118b566b0bc tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:30.863397 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-3f970f0c-c0c4-4867-843e-6118b566b0bc tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:30.878573 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-3f970f0c-c0c4-4867-843e-6118b566b0bc tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1266 microversion: 2.1 time: 0.237115 Aug 01 16:13:30.879344 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1683/3698] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:30 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:31.905657 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-876ca193-ae03-4311-9bf4-d7fc5c941ab6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:31.906815 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-876ca193-ae03-4311-9bf4-d7fc5c941ab6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:31.914505 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-876ca193-ae03-4311-9bf4-d7fc5c941ab6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:31.914966 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-876ca193-ae03-4311-9bf4-d7fc5c941ab6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:31.915760 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-876ca193-ae03-4311-9bf4-d7fc5c941ab6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:31.916206 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-876ca193-ae03-4311-9bf4-d7fc5c941ab6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:32.064903 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-876ca193-ae03-4311-9bf4-d7fc5c941ab6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:32.072935 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-876ca193-ae03-4311-9bf4-d7fc5c941ab6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1266 microversion: 2.1 time: 0.172089 Aug 01 16:13:32.073349 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2016/3699] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:31 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:33.096068 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-264d1d45-75af-41b2-b0dc-cb59c90eb480 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:33.096697 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-264d1d45-75af-41b2-b0dc-cb59c90eb480 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:33.099202 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=2 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:13:33.099875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=6 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:13:33.106220 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-264d1d45-75af-41b2-b0dc-cb59c90eb480 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:33.106678 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-264d1d45-75af-41b2-b0dc-cb59c90eb480 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:33.107452 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-264d1d45-75af-41b2-b0dc-cb59c90eb480 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:33.107891 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-264d1d45-75af-41b2-b0dc-cb59c90eb480 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:33.268430 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-264d1d45-75af-41b2-b0dc-cb59c90eb480 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:33.281242 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-264d1d45-75af-41b2-b0dc-cb59c90eb480 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1266 microversion: 2.1 time: 0.188608 Aug 01 16:13:33.282003 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1684/3700] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:33 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:34.302797 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-06ed5f7e-0480-40c6-ad8e-3d9374bd5e12 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:34.303405 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-06ed5f7e-0480-40c6-ad8e-3d9374bd5e12 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:34.305582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=2 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:13:34.311684 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06ed5f7e-0480-40c6-ad8e-3d9374bd5e12 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:34.312138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06ed5f7e-0480-40c6-ad8e-3d9374bd5e12 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:34.312916 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06ed5f7e-0480-40c6-ad8e-3d9374bd5e12 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:34.313356 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-06ed5f7e-0480-40c6-ad8e-3d9374bd5e12 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:34.445948 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-06ed5f7e-0480-40c6-ad8e-3d9374bd5e12 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:34.453475 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-06ed5f7e-0480-40c6-ad8e-3d9374bd5e12 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1266 microversion: 2.1 time: 0.154665 Aug 01 16:13:34.454068 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2017/3701] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:34 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:35.303746 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-83bf6964-e968-438e-9c00-6efa77ea43de req-66d923f5-7c20-4d78-8440-06daa5f2d480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79ee311-111b-41f5-ad24-09a58b7610ad", "name": "network-vif-plugged", "status": "completed", "tag": "02ebddd4-1cb3-409d-8956-c1f97086cde8"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:13:35.314899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-83bf6964-e968-438e-9c00-6efa77ea43de req-66d923f5-7c20-4d78-8440-06daa5f2d480 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:35.315352 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-83bf6964-e968-438e-9c00-6efa77ea43de req-66d923f5-7c20-4d78-8440-06daa5f2d480 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:35.327999 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-83bf6964-e968-438e-9c00-6efa77ea43de req-66d923f5-7c20-4d78-8440-06daa5f2d480 service nova] Creating event network-vif-plugged:02ebddd4-1cb3-409d-8956-c1f97086cde8 for instance c79ee311-111b-41f5-ad24-09a58b7610ad on hv-cinder-84753 Aug 01 16:13:35.333799 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-83bf6964-e968-438e-9c00-6efa77ea43de req-66d923f5-7c20-4d78-8440-06daa5f2d480 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034027 Aug 01 16:13:35.334528 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1685/3702] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:13:35.474896 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8595d8f8-72e1-40bf-bb87-02359ac29e10 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:35.475741 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8595d8f8-72e1-40bf-bb87-02359ac29e10 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:35.483208 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8595d8f8-72e1-40bf-bb87-02359ac29e10 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:35.483658 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8595d8f8-72e1-40bf-bb87-02359ac29e10 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:35.484422 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8595d8f8-72e1-40bf-bb87-02359ac29e10 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:35.484856 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8595d8f8-72e1-40bf-bb87-02359ac29e10 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:35.677823 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8595d8f8-72e1-40bf-bb87-02359ac29e10 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:35.685333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8595d8f8-72e1-40bf-bb87-02359ac29e10 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1266 microversion: 2.1 time: 0.215117 Aug 01 16:13:35.685906 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2018/3703] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:35 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:36.708941 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-ed3e53c8-4290-4a49-b5bb-1696fb1e5eca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:36.709704 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-ed3e53c8-4290-4a49-b5bb-1696fb1e5eca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:36.724725 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed3e53c8-4290-4a49-b5bb-1696fb1e5eca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:36.725416 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed3e53c8-4290-4a49-b5bb-1696fb1e5eca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:36.726442 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed3e53c8-4290-4a49-b5bb-1696fb1e5eca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:36.728497 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-ed3e53c8-4290-4a49-b5bb-1696fb1e5eca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:36.887111 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-ed3e53c8-4290-4a49-b5bb-1696fb1e5eca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:36.895055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-ed3e53c8-4290-4a49-b5bb-1696fb1e5eca tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1266 microversion: 2.1 time: 0.191423 Aug 01 16:13:36.895624 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1686/3704] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:36 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:37.918399 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b0006170-2d22-4121-b848-4c8f7cea2bd0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:37.918981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b0006170-2d22-4121-b848-4c8f7cea2bd0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:37.926751 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0006170-2d22-4121-b848-4c8f7cea2bd0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:37.927486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0006170-2d22-4121-b848-4c8f7cea2bd0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:37.928411 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0006170-2d22-4121-b848-4c8f7cea2bd0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:37.928895 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b0006170-2d22-4121-b848-4c8f7cea2bd0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:38.070134 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b0006170-2d22-4121-b848-4c8f7cea2bd0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:38.077980 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b0006170-2d22-4121-b848-4c8f7cea2bd0 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1454 microversion: 2.1 time: 0.164630 Aug 01 16:13:38.078650 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2019/3705] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:37 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:38.099930 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-397bbbd4-03b8-4317-87da-780629e3e1a6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:13:38.101211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-397bbbd4-03b8-4317-87da-780629e3e1a6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:13:38.108804 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-397bbbd4-03b8-4317-87da-780629e3e1a6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:38.109390 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-397bbbd4-03b8-4317-87da-780629e3e1a6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:38.110370 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-397bbbd4-03b8-4317-87da-780629e3e1a6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:38.110820 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-397bbbd4-03b8-4317-87da-780629e3e1a6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:38.244580 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-397bbbd4-03b8-4317-87da-780629e3e1a6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:13:38.252253 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-397bbbd4-03b8-4317-87da-780629e3e1a6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1454 microversion: 2.1 time: 0.156886 Aug 01 16:13:38.252916 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1687/3706] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:13:38 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:13:40.205937 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-5accdae2-aabd-4a3a-bae9-9eb0e8c7b610 req-235329a5-fa01-4a5b-8c20-c4ce34b2dbb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79ee311-111b-41f5-ad24-09a58b7610ad", "tag": "02ebddd4-1cb3-409d-8956-c1f97086cde8"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:13:40.216138 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-5accdae2-aabd-4a3a-bae9-9eb0e8c7b610 req-235329a5-fa01-4a5b-8c20-c4ce34b2dbb9 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:13:40.216854 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-5accdae2-aabd-4a3a-bae9-9eb0e8c7b610 req-235329a5-fa01-4a5b-8c20-c4ce34b2dbb9 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:13:40.231053 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-5accdae2-aabd-4a3a-bae9-9eb0e8c7b610 req-235329a5-fa01-4a5b-8c20-c4ce34b2dbb9 service nova] Creating event network-changed:02ebddd4-1cb3-409d-8956-c1f97086cde8 for instance c79ee311-111b-41f5-ad24-09a58b7610ad on hv-cinder-84753 Aug 01 16:13:40.236666 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-5accdae2-aabd-4a3a-bae9-9eb0e8c7b610 req-235329a5-fa01-4a5b-8c20-c4ce34b2dbb9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034324 Aug 01 16:13:40.237548 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2020/3707] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:13:59.263004 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:13:59.263575 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 16:13:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:15:28.142021 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:15:28.142761 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=70 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:15:28.146681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1141467180", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-353552585", "security_groups": [{"name": "tempest-secgroup-smoke-1578515179"}], "block_device_mapping_v2": [{"uuid": "43f8de54-3def-451c-b0b2-ae233b4f4523", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0675bac8-e75d-4d70-aa04-61c96a6c877f"}]}} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:15:28.264361 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.network.neutron [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] validate_networks() for [('0675bac8-e75d-4d70-aa04-61c96a6c877f', None, None, None, None, None)] {{(pid=124527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:15:28.634222 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Flavor limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:15:28.634679 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Image limits 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:15:28.635162 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Flavor pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:15:28.636188 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Image pref 0:0:0 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:15:28.636634 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.virt.hardware [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:15:28.645598 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:28.646116 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:28.646919 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:28.647359 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:28.664307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Getting quotas for project c12ec1d14cb44902bed525172feed2f8. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:15:28.668398 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.quota [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Getting quotas for user c1e71f7596824b7e9c7a88a22a6664c3 and project c12ec1d14cb44902bed525172feed2f8. Resources: {'ram', 'instances', 'cores'} {{(pid=124527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:15:28.726174 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Going to run 1 instances... {{(pid=124527) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:15:28.728330 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='43f8de54-3def-451c-b0b2-ae233b4f4523',volume_size=None,volume_type=None)] {{(pid=124527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:15:28.859089 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c9a82a5d-03f8-44c4-9480-db632191ea5d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.718725 Aug 01 16:15:28.859899 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1688/3708] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 1 16:15:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:15:28.868715 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR oslo.messaging._drivers.impl_rabbit [-] [893acd05-9420-4cd5-b518-8f2b33be6b98] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 16:15:28.869553 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:15:28.870676 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:15:28.875518 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-83cbbfae-c937-4644-bf17-ca01e86e5af6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:28.876200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-83cbbfae-c937-4644-bf17-ca01e86e5af6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:28.934277 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-83cbbfae-c937-4644-bf17-ca01e86e5af6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:28.941026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-83cbbfae-c937-4644-bf17-ca01e86e5af6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1094 microversion: 2.1 time: 0.074071 Aug 01 16:15:28.941582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2021/3709] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:28 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:29.962230 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-059fd2f6-5d6c-4f81-bfb8-68a60b05df52 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:29.962929 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-059fd2f6-5d6c-4f81-bfb8-68a60b05df52 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:29.971248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-059fd2f6-5d6c-4f81-bfb8-68a60b05df52 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:29.971605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-059fd2f6-5d6c-4f81-bfb8-68a60b05df52 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:29.972583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-059fd2f6-5d6c-4f81-bfb8-68a60b05df52 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:29.972781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-059fd2f6-5d6c-4f81-bfb8-68a60b05df52 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:30.048276 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-059fd2f6-5d6c-4f81-bfb8-68a60b05df52 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:30.075051 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-059fd2f6-5d6c-4f81-bfb8-68a60b05df52 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1200 microversion: 2.1 time: 0.116631 Aug 01 16:15:30.076255 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1689/3710] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:29 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1200 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:31.097156 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-fafad133-f00b-4cbd-a059-350dde16e828 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:31.097880 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-fafad133-f00b-4cbd-a059-350dde16e828 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:31.109282 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] [893acd05-9420-4cd5-b518-8f2b33be6b98] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 39862. Aug 01 16:15:31.114841 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fafad133-f00b-4cbd-a059-350dde16e828 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:31.115524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fafad133-f00b-4cbd-a059-350dde16e828 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:31.116310 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fafad133-f00b-4cbd-a059-350dde16e828 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:31.116748 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-fafad133-f00b-4cbd-a059-350dde16e828 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:31.371833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-fafad133-f00b-4cbd-a059-350dde16e828 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:31.379606 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-fafad133-f00b-4cbd-a059-350dde16e828 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1266 microversion: 2.1 time: 0.287033 Aug 01 16:15:31.380409 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2022/3711] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:31 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:31.846563 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-74f97af4-54bf-45d5-a94a-eef6a219d025 req-823f2b72-e8ab-4342-8085-cebb34939070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29fefc14-7a39-4fbd-8554-e3f537c73689", "tag": "a8913d32-eb1b-41e8-8835-00b86625eae3"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:15:31.856718 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-74f97af4-54bf-45d5-a94a-eef6a219d025 req-823f2b72-e8ab-4342-8085-cebb34939070 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:31.857246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-74f97af4-54bf-45d5-a94a-eef6a219d025 req-823f2b72-e8ab-4342-8085-cebb34939070 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:31.868211 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-74f97af4-54bf-45d5-a94a-eef6a219d025 req-823f2b72-e8ab-4342-8085-cebb34939070 service nova] Creating event network-changed:a8913d32-eb1b-41e8-8835-00b86625eae3 for instance 29fefc14-7a39-4fbd-8554-e3f537c73689 on hv-cinder-84753 Aug 01 16:15:31.874135 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-74f97af4-54bf-45d5-a94a-eef6a219d025 req-823f2b72-e8ab-4342-8085-cebb34939070 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179611 Aug 01 16:15:31.874747 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1690/3712] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:15:32.400837 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e5a7e7db-ecaf-49a4-85b2-1071d0da8697 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:32.401445 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e5a7e7db-ecaf-49a4-85b2-1071d0da8697 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:32.408454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e5a7e7db-ecaf-49a4-85b2-1071d0da8697 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:32.408908 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e5a7e7db-ecaf-49a4-85b2-1071d0da8697 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:32.409661 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e5a7e7db-ecaf-49a4-85b2-1071d0da8697 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:32.410118 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e5a7e7db-ecaf-49a4-85b2-1071d0da8697 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:32.628783 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e5a7e7db-ecaf-49a4-85b2-1071d0da8697 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:32.636884 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e5a7e7db-ecaf-49a4-85b2-1071d0da8697 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1266 microversion: 2.1 time: 0.239321 Aug 01 16:15:32.637575 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2023/3713] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:32 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:33.662439 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-d86f4fd2-87de-46ea-85c5-a0acb2403c82 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:33.663143 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-d86f4fd2-87de-46ea-85c5-a0acb2403c82 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:33.669461 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d86f4fd2-87de-46ea-85c5-a0acb2403c82 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:33.669940 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d86f4fd2-87de-46ea-85c5-a0acb2403c82 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:33.670709 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d86f4fd2-87de-46ea-85c5-a0acb2403c82 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:33.671152 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-d86f4fd2-87de-46ea-85c5-a0acb2403c82 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:33.804644 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-d86f4fd2-87de-46ea-85c5-a0acb2403c82 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:33.812676 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-d86f4fd2-87de-46ea-85c5-a0acb2403c82 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1266 microversion: 2.1 time: 0.155013 Aug 01 16:15:33.813235 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1691/3714] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:33 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:34.833346 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-cf223298-51c2-41e9-a5b2-553e9852b5ef tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:34.833983 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-cf223298-51c2-41e9-a5b2-553e9852b5ef tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:34.840894 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf223298-51c2-41e9-a5b2-553e9852b5ef tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:34.841341 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf223298-51c2-41e9-a5b2-553e9852b5ef tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:34.842122 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf223298-51c2-41e9-a5b2-553e9852b5ef tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:34.842555 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-cf223298-51c2-41e9-a5b2-553e9852b5ef tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:34.973836 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-cf223298-51c2-41e9-a5b2-553e9852b5ef tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:34.981384 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-cf223298-51c2-41e9-a5b2-553e9852b5ef tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1266 microversion: 2.1 time: 0.151846 Aug 01 16:15:34.981969 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2024/3715] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:34 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:36.002887 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-7e992587-182f-43df-8b8b-f5955b46d6eb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:36.003501 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-7e992587-182f-43df-8b8b-f5955b46d6eb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:36.010100 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7e992587-182f-43df-8b8b-f5955b46d6eb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:36.010556 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7e992587-182f-43df-8b8b-f5955b46d6eb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:36.011358 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7e992587-182f-43df-8b8b-f5955b46d6eb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:36.012512 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-7e992587-182f-43df-8b8b-f5955b46d6eb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:36.147272 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-7e992587-182f-43df-8b8b-f5955b46d6eb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:36.154922 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-7e992587-182f-43df-8b8b-f5955b46d6eb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1266 microversion: 2.1 time: 0.155968 Aug 01 16:15:36.155475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1692/3716] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:35 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:37.175593 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-ce3ff05a-37d1-48d7-83b8-9a22bbe50ec7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:37.176200 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-ce3ff05a-37d1-48d7-83b8-9a22bbe50ec7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:37.182764 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce3ff05a-37d1-48d7-83b8-9a22bbe50ec7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:37.183317 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce3ff05a-37d1-48d7-83b8-9a22bbe50ec7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:37.184104 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce3ff05a-37d1-48d7-83b8-9a22bbe50ec7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:37.184536 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-ce3ff05a-37d1-48d7-83b8-9a22bbe50ec7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:37.319087 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-ce3ff05a-37d1-48d7-83b8-9a22bbe50ec7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:37.327387 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-ce3ff05a-37d1-48d7-83b8-9a22bbe50ec7 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1266 microversion: 2.1 time: 0.155761 Aug 01 16:15:37.327962 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2025/3717] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:37 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:38.348681 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-2253ddd3-7cb0-4de0-a6be-0e7c0844efb2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:38.349290 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-2253ddd3-7cb0-4de0-a6be-0e7c0844efb2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:38.356522 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2253ddd3-7cb0-4de0-a6be-0e7c0844efb2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:38.356965 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2253ddd3-7cb0-4de0-a6be-0e7c0844efb2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:38.358146 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2253ddd3-7cb0-4de0-a6be-0e7c0844efb2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:38.358622 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-2253ddd3-7cb0-4de0-a6be-0e7c0844efb2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:38.487839 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-2253ddd3-7cb0-4de0-a6be-0e7c0844efb2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:38.496190 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-2253ddd3-7cb0-4de0-a6be-0e7c0844efb2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1266 microversion: 2.1 time: 0.151064 Aug 01 16:15:38.497138 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1693/3718] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:38 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:39.521731 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell0:SELECT=2 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:15:39.581652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-b5a62380-6186-4bab-9104-01e3f2df573f tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:39.582307 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-b5a62380-6186-4bab-9104-01e3f2df573f tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:39.588364 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5a62380-6186-4bab-9104-01e3f2df573f tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:39.588812 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5a62380-6186-4bab-9104-01e3f2df573f tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:39.589582 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5a62380-6186-4bab-9104-01e3f2df573f tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:39.590198 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-b5a62380-6186-4bab-9104-01e3f2df573f tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:39.725503 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-b5a62380-6186-4bab-9104-01e3f2df573f tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:39.733430 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-b5a62380-6186-4bab-9104-01e3f2df573f tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1266 microversion: 2.1 time: 0.216740 Aug 01 16:15:39.734652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2026/3719] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:39 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:40.755841 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-c4adc611-5ecf-416b-bfac-a1ffa8e7db21 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:40.756478 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-c4adc611-5ecf-416b-bfac-a1ffa8e7db21 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:40.758579 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=2 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:15:40.759238 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell0:SELECT=6 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:15:40.768389 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c4adc611-5ecf-416b-bfac-a1ffa8e7db21 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:40.768842 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c4adc611-5ecf-416b-bfac-a1ffa8e7db21 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:40.770080 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c4adc611-5ecf-416b-bfac-a1ffa8e7db21 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:40.770788 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-c4adc611-5ecf-416b-bfac-a1ffa8e7db21 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:40.906633 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-c4adc611-5ecf-416b-bfac-a1ffa8e7db21 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:40.914250 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-c4adc611-5ecf-416b-bfac-a1ffa8e7db21 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1266 microversion: 2.1 time: 0.162281 Aug 01 16:15:40.914809 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1694/3720] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:40 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:41.935218 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-8b36fd76-ddb6-4fa5-92b4-0c935a0e2d0d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:41.935862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-8b36fd76-ddb6-4fa5-92b4-0c935a0e2d0d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:41.942350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b36fd76-ddb6-4fa5-92b4-0c935a0e2d0d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:41.942793 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b36fd76-ddb6-4fa5-92b4-0c935a0e2d0d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:41.943583 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b36fd76-ddb6-4fa5-92b4-0c935a0e2d0d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:41.944014 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-8b36fd76-ddb6-4fa5-92b4-0c935a0e2d0d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:42.098230 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-8b36fd76-ddb6-4fa5-92b4-0c935a0e2d0d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:42.107229 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-8b36fd76-ddb6-4fa5-92b4-0c935a0e2d0d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1266 microversion: 2.1 time: 0.176276 Aug 01 16:15:42.108284 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2027/3721] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:41 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:42.153823 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-f8dadbe6-777e-4e15-8412-7b4addf07969 req-724def90-43d0-42e1-a93d-bcc4f0aa78d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fefc14-7a39-4fbd-8554-e3f537c73689", "name": "network-vif-plugged", "status": "completed", "tag": "a8913d32-eb1b-41e8-8835-00b86625eae3"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:15:42.163270 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-f8dadbe6-777e-4e15-8412-7b4addf07969 req-724def90-43d0-42e1-a93d-bcc4f0aa78d7 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:42.163696 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-f8dadbe6-777e-4e15-8412-7b4addf07969 req-724def90-43d0-42e1-a93d-bcc4f0aa78d7 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:42.174789 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-f8dadbe6-777e-4e15-8412-7b4addf07969 req-724def90-43d0-42e1-a93d-bcc4f0aa78d7 service nova] Creating event network-vif-plugged:a8913d32-eb1b-41e8-8835-00b86625eae3 for instance 29fefc14-7a39-4fbd-8554-e3f537c73689 on hv-cinder-84753 Aug 01 16:15:42.179721 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-f8dadbe6-777e-4e15-8412-7b4addf07969 req-724def90-43d0-42e1-a93d-bcc4f0aa78d7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093744 Aug 01 16:15:42.180307 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1695/3722] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:15:43.129032 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-edfdd3b3-bd2c-4eb4-9ce8-016df5358f33 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:43.129637 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-edfdd3b3-bd2c-4eb4-9ce8-016df5358f33 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:43.136670 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-edfdd3b3-bd2c-4eb4-9ce8-016df5358f33 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:43.137121 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-edfdd3b3-bd2c-4eb4-9ce8-016df5358f33 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:43.137872 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-edfdd3b3-bd2c-4eb4-9ce8-016df5358f33 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:43.138333 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-edfdd3b3-bd2c-4eb4-9ce8-016df5358f33 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:43.268524 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-edfdd3b3-bd2c-4eb4-9ce8-016df5358f33 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:43.276097 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-edfdd3b3-bd2c-4eb4-9ce8-016df5358f33 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1266 microversion: 2.1 time: 0.151000 Aug 01 16:15:43.276652 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2028/3723] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:43 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:44.299501 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8e209315-5f05-4cab-a1e9-10477831e0e5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:44.300114 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8e209315-5f05-4cab-a1e9-10477831e0e5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:44.306431 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e209315-5f05-4cab-a1e9-10477831e0e5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:44.306876 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e209315-5f05-4cab-a1e9-10477831e0e5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:44.307642 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e209315-5f05-4cab-a1e9-10477831e0e5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:44.308065 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8e209315-5f05-4cab-a1e9-10477831e0e5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:44.441588 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-8e209315-5f05-4cab-a1e9-10477831e0e5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:44.450221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8e209315-5f05-4cab-a1e9-10477831e0e5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1454 microversion: 2.1 time: 0.155574 Aug 01 16:15:44.450221 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1696/3724] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:44 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:15:44.470159 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-2e35c6a0-664f-4624-8d36-69010950f6c2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:15:44.470905 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-2e35c6a0-664f-4624-8d36-69010950f6c2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:15:44.477425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e35c6a0-664f-4624-8d36-69010950f6c2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:44.477870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e35c6a0-664f-4624-8d36-69010950f6c2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:44.478660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e35c6a0-664f-4624-8d36-69010950f6c2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:44.479271 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-2e35c6a0-664f-4624-8d36-69010950f6c2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:44.608772 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-2e35c6a0-664f-4624-8d36-69010950f6c2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:15:44.616456 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-2e35c6a0-664f-4624-8d36-69010950f6c2 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1454 microversion: 2.1 time: 0.150783 Aug 01 16:15:44.617029 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2029/3725] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:15:44 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:15:46.285425 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:15:46.286436 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 16:15:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:15:46.304572 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-0155d427-aabe-47e7-ad0d-3361272515ff req-30edaff2-aeaf-4231-aa25-5a0dfd8fa26f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29fefc14-7a39-4fbd-8554-e3f537c73689", "tag": "a8913d32-eb1b-41e8-8835-00b86625eae3"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:15:46.314783 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-0155d427-aabe-47e7-ad0d-3361272515ff req-30edaff2-aeaf-4231-aa25-5a0dfd8fa26f service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:15:46.315233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-0155d427-aabe-47e7-ad0d-3361272515ff req-30edaff2-aeaf-4231-aa25-5a0dfd8fa26f service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:15:46.326432 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-0155d427-aabe-47e7-ad0d-3361272515ff req-30edaff2-aeaf-4231-aa25-5a0dfd8fa26f service nova] Creating event network-changed:a8913d32-eb1b-41e8-8835-00b86625eae3 for instance 29fefc14-7a39-4fbd-8554-e3f537c73689 on hv-cinder-84753 Aug 01 16:15:46.333005 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-0155d427-aabe-47e7-ad0d-3361272515ff req-30edaff2-aeaf-4231-aa25-5a0dfd8fa26f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095941 Aug 01 16:15:46.334122 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1697/3726] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:16:02.826240 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:16:02.826825 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 16:16:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:16:20.980660 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:16:20.981318 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 16:16:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:17:18.419569 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_api:SELECT=20 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:17:18.420981 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG dbcounter [-] [124526] Writing DB stats nova_cell1:SELECT=48 {{(pid=124526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:17:18.422822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:17:18.424233 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG dbcounter [-] [124527] Writing DB stats nova_cell1:SELECT=44 {{(pid=124527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:17:18.425552 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-4e659a40-bf55-4279-bb30-c3c99dbc2bf6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:18.426135 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4e659a40-bf55-4279-bb30-c3c99dbc2bf6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:17:18.430130 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-aa09dd27-3d06-4421-a993-cebfe270584b req-92ccbadc-2921-43bf-92ea-6b3a051b861d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29fefc14-7a39-4fbd-8554-e3f537c73689", "tag": "a8913d32-eb1b-41e8-8835-00b86625eae3"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:17:18.433431 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e659a40-bf55-4279-bb30-c3c99dbc2bf6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:18.433902 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e659a40-bf55-4279-bb30-c3c99dbc2bf6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:18.434669 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e659a40-bf55-4279-bb30-c3c99dbc2bf6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:18.435102 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-4e659a40-bf55-4279-bb30-c3c99dbc2bf6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:18.443212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-aa09dd27-3d06-4421-a993-cebfe270584b req-92ccbadc-2921-43bf-92ea-6b3a051b861d service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:18.443212 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-aa09dd27-3d06-4421-a993-cebfe270584b req-92ccbadc-2921-43bf-92ea-6b3a051b861d service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:18.458378 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-aa09dd27-3d06-4421-a993-cebfe270584b req-92ccbadc-2921-43bf-92ea-6b3a051b861d service nova] Creating event network-changed:a8913d32-eb1b-41e8-8835-00b86625eae3 for instance 29fefc14-7a39-4fbd-8554-e3f537c73689 on hv-cinder-84753 Aug 01 16:17:18.464033 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-4e659a40-bf55-4279-bb30-c3c99dbc2bf6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:17:18.464793 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-aa09dd27-3d06-4421-a993-cebfe270584b req-92ccbadc-2921-43bf-92ea-6b3a051b861d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044275 Aug 01 16:17:18.465822 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1698/3727] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:17:18.583236 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-4e659a40-bf55-4279-bb30-c3c99dbc2bf6 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "DELETE /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 204 len: 0 microversion: 2.1 time: 0.165751 Aug 01 16:17:18.588145 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2030/3728] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:17:18 2022] DELETE /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:17:18.593844 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-0c27d618-544c-44b4-bc12-871ba43ab6cb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:18.595446 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-0c27d618-544c-44b4-bc12-871ba43ab6cb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:17:18.601386 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c27d618-544c-44b4-bc12-871ba43ab6cb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:18.601833 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c27d618-544c-44b4-bc12-871ba43ab6cb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:18.603094 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c27d618-544c-44b4-bc12-871ba43ab6cb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:18.603668 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-0c27d618-544c-44b4-bc12-871ba43ab6cb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:18.802759 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-0c27d618-544c-44b4-bc12-871ba43ab6cb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:17:18.811268 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-0c27d618-544c-44b4-bc12-871ba43ab6cb tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1579 microversion: 2.1 time: 0.221629 Aug 01 16:17:18.811854 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1699/3729] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:17:18 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1579 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:17:19.271024 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:17:19.271218 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 16:17:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:17:19.834182 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-5f6a519f-24dc-4309-b517-71361181cfa5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:19.835321 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-5f6a519f-24dc-4309-b517-71361181cfa5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:17:19.842363 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f6a519f-24dc-4309-b517-71361181cfa5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:19.842804 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f6a519f-24dc-4309-b517-71361181cfa5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:19.843561 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f6a519f-24dc-4309-b517-71361181cfa5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:19.843990 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-5f6a519f-24dc-4309-b517-71361181cfa5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:20.083512 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-5f6a519f-24dc-4309-b517-71361181cfa5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:17:20.091976 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-5f6a519f-24dc-4309-b517-71361181cfa5 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1579 microversion: 2.1 time: 0.262033 Aug 01 16:17:20.106136 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2031/3730] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:17:19 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1579 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:17:21.114302 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-4b79fa75-63c3-47f1-b16e-4401e5a7a57d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:21.114912 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-4b79fa75-63c3-47f1-b16e-4401e5a7a57d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:17:21.122028 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b79fa75-63c3-47f1-b16e-4401e5a7a57d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:21.122617 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b79fa75-63c3-47f1-b16e-4401e5a7a57d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:21.123388 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b79fa75-63c3-47f1-b16e-4401e5a7a57d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:21.123821 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-4b79fa75-63c3-47f1-b16e-4401e5a7a57d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:21.204964 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-4b79fa75-63c3-47f1-b16e-4401e5a7a57d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:17:21.215011 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-4b79fa75-63c3-47f1-b16e-4401e5a7a57d tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 200 len: 1392 microversion: 2.1 time: 0.104206 Aug 01 16:17:21.219061 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1700/3731] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:17:21 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 1392 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:17:21.220975 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [req-3d29e601-4243-4d18-b69c-c993ab3e561d req-5f3be55d-63d7-44e8-9994-0532d6f8c8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fefc14-7a39-4fbd-8554-e3f537c73689", "name": "network-vif-deleted", "tag": "a8913d32-eb1b-41e8-8835-00b86625eae3"}]} {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:17:21.231640 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-3d29e601-4243-4d18-b69c-c993ab3e561d req-5f3be55d-63d7-44e8-9994-0532d6f8c8a8 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:21.232026 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [req-3d29e601-4243-4d18-b69c-c993ab3e561d req-5f3be55d-63d7-44e8-9994-0532d6f8c8a8 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:21.245586 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.compute.server_external_events [req-3d29e601-4243-4d18-b69c-c993ab3e561d req-5f3be55d-63d7-44e8-9994-0532d6f8c8a8 service nova] Creating event network-vif-deleted:a8913d32-eb1b-41e8-8835-00b86625eae3 for instance 29fefc14-7a39-4fbd-8554-e3f537c73689 on hv-cinder-84753 Aug 01 16:17:21.251213 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [req-3d29e601-4243-4d18-b69c-c993ab3e561d req-5f3be55d-63d7-44e8-9994-0532d6f8c8a8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035354 Aug 01 16:17:21.251898 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2032/3732] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:17:22.240475 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f24a3f49-a1de-4503-8065-bd63e3753332 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:22.241634 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-f24a3f49-a1de-4503-8065-bd63e3753332 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 29fefc14-7a39-4fbd-8554-e3f537c73689] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:17:22.248520 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f24a3f49-a1de-4503-8065-bd63e3753332 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:22.248970 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f24a3f49-a1de-4503-8065-bd63e3753332 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:22.249737 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f24a3f49-a1de-4503-8065-bd63e3753332 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:22.250215 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-f24a3f49-a1de-4503-8065-bd63e3753332 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:22.263236 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-f24a3f49-a1de-4503-8065-bd63e3753332 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] HTTP exception thrown: Instance 29fefc14-7a39-4fbd-8554-e3f537c73689 could not be found. Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f24a3f49-a1de-4503-8065-bd63e3753332 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Request method failure captured: Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 HTTP/1.1 Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_r6wZ4crXH1b1SYPhrtGaGaMf5MDjqie1v9YsAMONOK-yxyl2JM3Jo0VcrmnUWj65R93LvMfqFlq5q7kaNvc8rorHKnUDzWQaS1IKT64JYcJkJ-z359vWtUzniiUW-bAgkje99_XCVERtHCknqoN6wpuYf2tgZfUuSM0TPXVWl7YNE Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: c12ec1d14cb44902bed525172feed2f8 Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-TestVolumeBootPattern-781075939 Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:17:22.264918 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:17:22.266325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c12ec1d14cb44902bed525172feed2f8"}]}] Aug 01 16:17:22.266325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-TestVolumeBootPattern-781075939 Aug 01 16:17:22.266325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: c12ec1d14cb44902bed525172feed2f8 Aug 01 16:17:22.266325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-TestVolumeBootPattern-781075939 Aug 01 16:17:22.266325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-TestVolumeBootPattern-781075939-project Aug 01 16:17:22.266325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:17:22.266325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:17:22.266325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: c1e71f7596824b7e9c7a88a22a6664c3 Aug 01 16:17:22.266325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-TestVolumeBootPattern-781075939-project Aug 01 16:17:22.266325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:17:22.266325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance 29fefc14-7a39-4fbd-8554-e3f537c73689 could not be found. Aug 01 16:17:22.266325 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '29fefc14-7a39-4fbd-8554-e3f537c73689'} Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29fefc14-7a39-4fbd-8554-e3f537c73689 could not be found. Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:17:22.267273 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29fefc14-7a39-4fbd-8554-e3f537c73689 could not be found. Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29fefc14-7a39-4fbd-8554-e3f537c73689 could not be found. Aug 01 16:17:22.268711 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:22.269972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-f24a3f49-a1de-4503-8065-bd63e3753332 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Returning 404 to user: Instance 29fefc14-7a39-4fbd-8554-e3f537c73689 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:17:22.269972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-f24a3f49-a1de-4503-8065-bd63e3753332 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689" status: 404 len: 111 microversion: 2.1 time: 0.029980 Aug 01 16:17:22.269972 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1701/3733] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:17:22 2022] GET /compute/v2.1/servers/29fefc14-7a39-4fbd-8554-e3f537c73689 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 16:17:25.605780 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7fec45de-883f-43d8-8f3a-61da94b16c6a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:25.606489 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7fec45de-883f-43d8-8f3a-61da94b16c6a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:17:25.607939 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-816335bc-2326-42fd-879b-ce98395c5f58 req-ddc6a245-8745-4a99-9c7e-2ce7c5c81b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79ee311-111b-41f5-ad24-09a58b7610ad", "tag": "02ebddd4-1cb3-409d-8956-c1f97086cde8"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:17:25.613708 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fec45de-883f-43d8-8f3a-61da94b16c6a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:25.614730 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fec45de-883f-43d8-8f3a-61da94b16c6a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:25.614977 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fec45de-883f-43d8-8f3a-61da94b16c6a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:25.615454 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7fec45de-883f-43d8-8f3a-61da94b16c6a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:25.620875 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-816335bc-2326-42fd-879b-ce98395c5f58 req-ddc6a245-8745-4a99-9c7e-2ce7c5c81b0b service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:25.621282 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-816335bc-2326-42fd-879b-ce98395c5f58 req-ddc6a245-8745-4a99-9c7e-2ce7c5c81b0b service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:25.638583 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-816335bc-2326-42fd-879b-ce98395c5f58 req-ddc6a245-8745-4a99-9c7e-2ce7c5c81b0b service nova] Creating event network-changed:02ebddd4-1cb3-409d-8956-c1f97086cde8 for instance c79ee311-111b-41f5-ad24-09a58b7610ad on hv-cinder-84753 Aug 01 16:17:25.645267 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-816335bc-2326-42fd-879b-ce98395c5f58 req-ddc6a245-8745-4a99-9c7e-2ce7c5c81b0b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041889 Aug 01 16:17:25.645486 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7fec45de-883f-43d8-8f3a-61da94b16c6a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Going to try to terminate instance {{(pid=124526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:17:25.646367 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1702/3734] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:17:25.739798 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7fec45de-883f-43d8-8f3a-61da94b16c6a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 204 len: 0 microversion: 2.1 time: 0.138126 Aug 01 16:17:25.741350 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2033/3735] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:17:25 2022] DELETE /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:17:25.752993 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-5b8d9d02-5b45-406d-a371-40eab1a2997e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:25.753692 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-5b8d9d02-5b45-406d-a371-40eab1a2997e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:17:25.763839 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b8d9d02-5b45-406d-a371-40eab1a2997e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:25.764331 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b8d9d02-5b45-406d-a371-40eab1a2997e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:25.765127 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b8d9d02-5b45-406d-a371-40eab1a2997e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:25.765568 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-5b8d9d02-5b45-406d-a371-40eab1a2997e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:25.916049 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.policy [None req-5b8d9d02-5b45-406d-a371-40eab1a2997e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124527) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:17:25.923757 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-5b8d9d02-5b45-406d-a371-40eab1a2997e tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1579 microversion: 2.1 time: 0.175502 Aug 01 16:17:25.924316 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1703/3736] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:17:25 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1579 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:17:26.945274 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-50e3f379-cd7b-4c5a-b7d0-844bf10e05b8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:26.946022 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-50e3f379-cd7b-4c5a-b7d0-844bf10e05b8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:17:26.952564 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-50e3f379-cd7b-4c5a-b7d0-844bf10e05b8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:26.953021 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-50e3f379-cd7b-4c5a-b7d0-844bf10e05b8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:26.953792 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-50e3f379-cd7b-4c5a-b7d0-844bf10e05b8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:26.954259 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-50e3f379-cd7b-4c5a-b7d0-844bf10e05b8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:27.087071 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-50e3f379-cd7b-4c5a-b7d0-844bf10e05b8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:17:27.095833 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-50e3f379-cd7b-4c5a-b7d0-844bf10e05b8 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1579 microversion: 2.1 time: 0.154692 Aug 01 16:17:27.096418 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2034/3737] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:17:26 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:17:27.876453 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [req-3a820072-5557-48fc-a518-5b5811d908d6 req-7ec4ebb2-b8d5-41fe-95e2-c38e2c57fa40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79ee311-111b-41f5-ad24-09a58b7610ad", "name": "network-vif-deleted", "tag": "02ebddd4-1cb3-409d-8956-c1f97086cde8"}]} {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:17:27.888837 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-3a820072-5557-48fc-a518-5b5811d908d6 req-7ec4ebb2-b8d5-41fe-95e2-c38e2c57fa40 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:27.889283 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [req-3a820072-5557-48fc-a518-5b5811d908d6 req-7ec4ebb2-b8d5-41fe-95e2-c38e2c57fa40 service nova] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:27.901327 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.compute.server_external_events [req-3a820072-5557-48fc-a518-5b5811d908d6 req-7ec4ebb2-b8d5-41fe-95e2-c38e2c57fa40 service nova] Creating event network-vif-deleted:02ebddd4-1cb3-409d-8956-c1f97086cde8 for instance c79ee311-111b-41f5-ad24-09a58b7610ad on hv-cinder-84753 Aug 01 16:17:27.907246 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [req-3a820072-5557-48fc-a518-5b5811d908d6 req-7ec4ebb2-b8d5-41fe-95e2-c38e2c57fa40 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034603 Aug 01 16:17:27.907846 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1704/3738] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 1 16:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:17:28.117921 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-e3a777a3-55de-443f-b97a-747faf3dba63 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:28.119452 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-e3a777a3-55de-443f-b97a-747faf3dba63 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:17:28.126191 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3a777a3-55de-443f-b97a-747faf3dba63 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:28.126653 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3a777a3-55de-443f-b97a-747faf3dba63 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:28.127429 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3a777a3-55de-443f-b97a-747faf3dba63 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:28.127870 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-e3a777a3-55de-443f-b97a-747faf3dba63 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:28.209328 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.policy [None req-e3a777a3-55de-443f-b97a-747faf3dba63 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e71f7596824b7e9c7a88a22a6664c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ec1d14cb44902bed525172feed2f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:17:28.217478 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-e3a777a3-55de-443f-b97a-747faf3dba63 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 200 len: 1225 microversion: 2.1 time: 0.103604 Aug 01 16:17:28.218228 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2035/3739] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:17:28 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:17:29.240616 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8b69e7c4-f79b-4445-aa59-4e664d954bf4 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:29.241305 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-8b69e7c4-f79b-4445-aa59-4e664d954bf4 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: c79ee311-111b-41f5-ad24-09a58b7610ad] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:17:29.248591 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b69e7c4-f79b-4445-aa59-4e664d954bf4 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:29.249032 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b69e7c4-f79b-4445-aa59-4e664d954bf4 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:29.249781 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b69e7c4-f79b-4445-aa59-4e664d954bf4 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:29.250265 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-8b69e7c4-f79b-4445-aa59-4e664d954bf4 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:29.263667 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-8b69e7c4-f79b-4445-aa59-4e664d954bf4 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] HTTP exception thrown: Instance c79ee311-111b-41f5-ad24-09a58b7610ad could not be found. Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8b69e7c4-f79b-4445-aa59-4e664d954bf4 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Request method failure captured: Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad HTTP/1.1 Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_r6wZ4crXH1b1SYPhrtGaGaMf5MDjqie1v9YsAMONOK-yxyl2JM3Jo0VcrmnUWj65R93LvMfqFlq5q7kaNvc8rorHKnUDzWQaS1IKT64JYcJkJ-z359vWtUzniiUW-bAgkje99_XCVERtHCknqoN6wpuYf2tgZfUuSM0TPXVWl7YNE Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: c12ec1d14cb44902bed525172feed2f8 Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-TestVolumeBootPattern-781075939 Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:17:29.265248 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:17:29.266577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c12ec1d14cb44902bed525172feed2f8"}]}] Aug 01 16:17:29.266577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-TestVolumeBootPattern-781075939 Aug 01 16:17:29.266577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: c12ec1d14cb44902bed525172feed2f8 Aug 01 16:17:29.266577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-TestVolumeBootPattern-781075939 Aug 01 16:17:29.266577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-TestVolumeBootPattern-781075939-project Aug 01 16:17:29.266577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:17:29.266577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:17:29.266577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: c1e71f7596824b7e9c7a88a22a6664c3 Aug 01 16:17:29.266577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-TestVolumeBootPattern-781075939-project Aug 01 16:17:29.266577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:17:29.266577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance c79ee311-111b-41f5-ad24-09a58b7610ad could not be found. Aug 01 16:17:29.266577 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': 'c79ee311-111b-41f5-ad24-09a58b7610ad'} Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79ee311-111b-41f5-ad24-09a58b7610ad could not be found. Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:17:29.267380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79ee311-111b-41f5-ad24-09a58b7610ad could not be found. Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79ee311-111b-41f5-ad24-09a58b7610ad could not be found. Aug 01 16:17:29.268738 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.269985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-8b69e7c4-f79b-4445-aa59-4e664d954bf4 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Returning 404 to user: Instance c79ee311-111b-41f5-ad24-09a58b7610ad could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:17:29.269985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-8b69e7c4-f79b-4445-aa59-4e664d954bf4 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad" status: 404 len: 111 microversion: 2.1 time: 0.030205 Aug 01 16:17:29.269985 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1705/3740] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:17:29 2022] GET /compute/v2.1/servers/c79ee311-111b-41f5-ad24-09a58b7610ad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:17:29.711691 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7ef87af5-e9e1-44a8-ada7-eefbcb784abf tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:29.712199 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.compute.api [None req-7ef87af5-e9e1-44a8-ada7-eefbcb784abf tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:17:29.719044 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ef87af5-e9e1-44a8-ada7-eefbcb784abf tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:29.719495 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ef87af5-e9e1-44a8-ada7-eefbcb784abf tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:29.720266 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ef87af5-e9e1-44a8-ada7-eefbcb784abf tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:29.720706 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG oslo_concurrency.lockutils [None req-7ef87af5-e9e1-44a8-ada7-eefbcb784abf tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:29.734324 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.wsgi [None req-7ef87af5-e9e1-44a8-ada7-eefbcb784abf tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] HTTP exception thrown: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7ef87af5-e9e1-44a8-ada7-eefbcb784abf tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Request method failure captured: Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: request: DELETE /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 HTTP/1.1 Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept: application/json Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Accept-Encoding: identity Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Connection: close Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Length: 0 Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Content-Type: application/json Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Host: 10.222.0.83 Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Openstack-System-Scope: None Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: User-Agent: python-urllib3/1.26.10 Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Auth-Token: gAAAAABi5_r6wZ4crXH1b1SYPhrtGaGaMf5MDjqie1v9YsAMONOK-yxyl2JM3Jo0VcrmnUWj65R93LvMfqFlq5q7kaNvc8rorHKnUDzWQaS1IKT64JYcJkJ-z359vWtUzniiUW-bAgkje99_XCVERtHCknqoN6wpuYf2tgZfUuSM0TPXVWl7YNE Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Id: None Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Domain-Name: None Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Identity-Status: Confirmed Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Is-Admin-Project: True Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Id: default Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Domain-Name: Default Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Id: c12ec1d14cb44902bed525172feed2f8 Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Project-Name: tempest-TestVolumeBootPattern-781075939 Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Role: member,reader Aug 01 16:17:29.736013 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Roles: member,reader Aug 01 16:17:29.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c12ec1d14cb44902bed525172feed2f8"}]}] Aug 01 16:17:29.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant: tempest-TestVolumeBootPattern-781075939 Aug 01 16:17:29.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Id: c12ec1d14cb44902bed525172feed2f8 Aug 01 16:17:29.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-Tenant-Name: tempest-TestVolumeBootPattern-781075939 Aug 01 16:17:29.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User: tempest-TestVolumeBootPattern-781075939-project Aug 01 16:17:29.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Id: default Aug 01 16:17:29.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Domain-Name: Default Aug 01 16:17:29.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Id: c1e71f7596824b7e9c7a88a22a6664c3 Aug 01 16:17:29.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: X-User-Name: tempest-TestVolumeBootPattern-781075939-project Aug 01 16:17:29.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: method: > Aug 01 16:17:29.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: exception: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:17:29.737449 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: action_args: {'id': '3598d8e9-b0e9-4076-a342-d02faaaca330'} Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:17:29.738253 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:17:29.739521 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.740790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-7ef87af5-e9e1-44a8-ada7-eefbcb784abf tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Returning 404 to user: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. {{(pid=124526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:17:29.740790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-7ef87af5-e9e1-44a8-ada7-eefbcb784abf tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "DELETE /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 404 len: 111 microversion: 2.1 time: 0.029657 Aug 01 16:17:29.740790 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2036/3741] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 1 16:17:29 2022] DELETE /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:17:29.746829 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e7c6008d-12a4-4622-92ac-2b016c471a9a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '>' {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:29.747492 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.compute.api [None req-e7c6008d-12a4-4622-92ac-2b016c471a9a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] [instance: 3598d8e9-b0e9-4076-a342-d02faaaca330] Fetching instance by UUID {{(pid=124527) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:17:29.753428 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e7c6008d-12a4-4622-92ac-2b016c471a9a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:29.753866 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e7c6008d-12a4-4622-92ac-2b016c471a9a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:29.754656 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e7c6008d-12a4-4622-92ac-2b016c471a9a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:17:29.755086 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG oslo_concurrency.lockutils [None req-e7c6008d-12a4-4622-92ac-2b016c471a9a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Lock "67c0a4a7-1fcd-43c5-96b9-b81917d6c715" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:17:29.768519 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.wsgi [None req-e7c6008d-12a4-4622-92ac-2b016c471a9a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] HTTP exception thrown: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e7c6008d-12a4-4622-92ac-2b016c471a9a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Request method failure captured: Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: request: GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 HTTP/1.1 Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept: application/json Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Accept-Encoding: identity Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Connection: close Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Length: 0 Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Content-Type: application/json Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Host: 10.222.0.83 Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Openstack-System-Scope: None Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: User-Agent: python-urllib3/1.26.10 Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Auth-Token: gAAAAABi5_r6wZ4crXH1b1SYPhrtGaGaMf5MDjqie1v9YsAMONOK-yxyl2JM3Jo0VcrmnUWj65R93LvMfqFlq5q7kaNvc8rorHKnUDzWQaS1IKT64JYcJkJ-z359vWtUzniiUW-bAgkje99_XCVERtHCknqoN6wpuYf2tgZfUuSM0TPXVWl7YNE Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Id: None Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Domain-Name: None Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Identity-Status: Confirmed Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Is-Admin-Project: True Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Id: default Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Domain-Name: Default Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Id: c12ec1d14cb44902bed525172feed2f8 Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Project-Name: tempest-TestVolumeBootPattern-781075939 Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Role: member,reader Aug 01 16:17:29.770106 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Roles: member,reader Aug 01 16:17:29.771605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c12ec1d14cb44902bed525172feed2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c12ec1d14cb44902bed525172feed2f8"}]}] Aug 01 16:17:29.771605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant: tempest-TestVolumeBootPattern-781075939 Aug 01 16:17:29.771605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Id: c12ec1d14cb44902bed525172feed2f8 Aug 01 16:17:29.771605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-Tenant-Name: tempest-TestVolumeBootPattern-781075939 Aug 01 16:17:29.771605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User: tempest-TestVolumeBootPattern-781075939-project Aug 01 16:17:29.771605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Id: default Aug 01 16:17:29.771605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Domain-Name: Default Aug 01 16:17:29.771605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Id: c1e71f7596824b7e9c7a88a22a6664c3 Aug 01 16:17:29.771605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: X-User-Name: tempest-TestVolumeBootPattern-781075939-project Aug 01 16:17:29.771605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: method: > Aug 01 16:17:29.771605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: exception: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:17:29.771605 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: action_args: {'id': '3598d8e9-b0e9-4076-a342-d02faaaca330'} Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: {{(pid=124527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:17:29.772329 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. Aug 01 16:17:29.773597 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: ERROR nova.api.openstack.wsgi Aug 01 16:17:29.774943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: DEBUG nova.api.openstack.wsgi [None req-e7c6008d-12a4-4622-92ac-2b016c471a9a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Returning 404 to user: Instance 3598d8e9-b0e9-4076-a342-d02faaaca330 could not be found. {{(pid=124527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:17:29.774943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO nova.api.openstack.requestlog [None req-e7c6008d-12a4-4622-92ac-2b016c471a9a tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330" status: 404 len: 111 microversion: 2.1 time: 0.029127 Aug 01 16:17:29.774943 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: [pid: 124527|app: 0|req: 1706/3742] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 1 16:17:29 2022] GET /compute/v2.1/servers/3598d8e9-b0e9-4076-a342-d02faaaca330 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:17:31.070568 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: DEBUG nova.api.openstack.wsgi [None req-16c6878c-2355-42a6-8a30-813cff3a3870 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] Calling method '.version_select at 0x7feb1a87ac10>' {{(pid=124526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:17:31.107269 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO nova.api.openstack.requestlog [None req-16c6878c-2355-42a6-8a30-813cff3a3870 tempest-TestVolumeBootPattern-781075939 tempest-TestVolumeBootPattern-781075939-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-353552585" status: 202 len: 0 microversion: 2.1 time: 0.040336 Aug 01 16:17:31.107862 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: [pid: 124526|app: 0|req: 2037/3743] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 1 16:17:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-353552585 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:19:06.295133 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:19:06.295824 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 16:19:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:19:36.560516 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:19:36.561055 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 16:19:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:20:39.279981 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:20:39.280535 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 16:20:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:21:01.878380 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:21:01.879095 dv-cinder-847536-3-iscsi devstack@n-api.service[124527]: Mon Aug 1 16:21:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:22:26.304441 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:22:26.305018 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 16:22:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:22:42.838373 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:22:42.839353 dv-cinder-847536-3-iscsi devstack@n-api.service[124526]: Mon Aug 1 16:22:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!